Ordinality of Visible-Thermal Image Intensities for Intrinsic Image Decomposition

• URL: http://arxiv.org/abs/2509.10388v1
• Date: Fri, 12 Sep 2025 16:29:02 GMT
• Title: Ordinality of Visible-Thermal Image Intensities for Intrinsic Image Decomposition
• Authors: Zeqing Leo Yuan, Mani Ramanagopal, Aswin C. Sankaranarayanan, Srinivasa G. Narasimhan,
• Abstract summary: We introduce a training-free approach for intrinsic image decomposition using only a pair of visible and thermal images.<n>We leverage the principle that light not reflected from an opaque surface is absorbed and detected as heat by a thermal camera.<n>This allows us to relate the ordinalities between visible and thermal image intensities to the ordinalities of shading and reflectance.
• Score: 25.579052761222513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Decomposing an image into its intrinsic photometric factors--shading and reflectance--is a long-standing challenge due to the lack of extensive ground-truth data for real-world scenes. Recent methods rely on synthetic data or sparse annotations for limited indoor and even fewer outdoor scenes. We introduce a novel training-free approach for intrinsic image decomposition using only a pair of visible and thermal images. We leverage the principle that light not reflected from an opaque surface is absorbed and detected as heat by a thermal camera. This allows us to relate the ordinalities between visible and thermal image intensities to the ordinalities of shading and reflectance, which can densely self-supervise an optimizing neural network to recover shading and reflectance. We perform quantitative evaluations with known reflectance and shading under natural and artificial lighting, and qualitative experiments across diverse outdoor scenes. The results demonstrate superior performance over recent learning-based models and point toward a scalable path to curating real-world ordinal supervision, previously infeasible via manual labeling.

Related papers

• MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference [83.38607296779423]
  We show that multi-view consistent material inference with more physically-based environment modeling is key to learning accurate reflections with Gaussian Splatting.<n>Our method faithfully recovers both illumination and geometry, achieving state-of-the-art rendering quality in novel views synthesis.
  arXiv  Detail & Related papers  (2025-10-13T13:29:20Z)
• Bright-NeRF:Brightening Neural Radiance Field with Color Restoration from Low-light Raw Images [8.679462472714942]
  We propose a novel approach, Bright-NeRF, which learns enhanced and high-quality radiance fields from low-light raw images in an unsupervised manner.<n>Our method simultaneously achieves color restoration, denoising, and enhanced novel view synthesis.
  arXiv  Detail & Related papers  (2024-12-19T05:55:18Z)
• PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularization [46.146783750386994]
  We propose a new method for neural inverse rendering.<n>Our method jointly optimize the light source position to account for the self-shadows in images.<n>To enhance surface reflectance decomposition, we introduce a new regularization.
  arXiv  Detail & Related papers  (2024-08-13T11:39:14Z)
• SIRe-IR: Inverse Rendering for BRDF Reconstruction with Shadow and Illumination Removal in High-Illuminance Scenes [51.50157919750782]
  We present SIRe-IR, an implicit neural rendering inverse approach that decomposes the scene into environment map, albedo, and roughness. By accurately modeling the indirect radiance field, normal, visibility, and direct light simultaneously, we are able to remove both shadows and indirect illumination. Even in the presence of intense illumination, our method recovers high-quality albedo and roughness with no shadow interference.
  arXiv  Detail & Related papers  (2023-10-19T10:44:23Z)
• Advancing Unsupervised Low-light Image Enhancement: Noise Estimation, Illumination Interpolation, and Self-Regulation [55.07472635587852]
  Low-Light Image Enhancement (LLIE) techniques have made notable advancements in preserving image details and enhancing contrast. These approaches encounter persistent challenges in efficiently mitigating dynamic noise and accommodating diverse low-light scenarios. We first propose a method for estimating the noise level in low light images in a quick and accurate way. We then devise a Learnable Illumination Interpolator (LII) to satisfy general constraints between illumination and input.
  arXiv  Detail & Related papers  (2023-05-17T13:56:48Z)
• TensoIR: Tensorial Inverse Rendering [51.57268311847087]
  TensoIR is a novel inverse rendering approach based on tensor factorization and neural fields. TensoRF is a state-of-the-art approach for radiance field modeling.
  arXiv  Detail & Related papers  (2023-04-24T21:39:13Z)
• Semi-supervised atmospheric component learning in low-light image problem [0.0]
  Ambient lighting conditions play a crucial role in determining the perceptual quality of images from photographic devices. This study presents a semi-supervised training method using no-reference image quality metrics for low-light image restoration.
  arXiv  Detail & Related papers  (2022-04-15T17:06:33Z)
• Neural Relightable Participating Media Rendering [26.431106015677]
  We learn neural representations for participating media with a complete simulation of global illumination. Our approach achieves superior visual quality and numerical performance compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-10-25T14:36:15Z)
• Learning Flow-based Feature Warping for Face Frontalization with Illumination Inconsistent Supervision [73.18554605744842]
  Flow-based Feature Warping Model (FFWM) learns to synthesize photo-realistic and illumination preserving frontal images. An Illumination Preserving Module (IPM) is proposed to learn illumination preserving image synthesis. A Warp Attention Module (WAM) is introduced to reduce the pose discrepancy in the feature level.
  arXiv  Detail & Related papers  (2020-08-16T06:07:00Z)
• Neural Reflectance Fields for Appearance Acquisition [61.542001266380375]
  We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene. We combine this representation with a physically-based differentiable ray marching framework that can render images from a neural reflectance field under any viewpoint and light.
  arXiv  Detail & Related papers  (2020-08-09T22:04:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.