Invariant Descriptors for Intrinsic Reflectance Optimization

• URL: http://arxiv.org/abs/2204.04076v1
• Date: Fri, 8 Apr 2022 13:52:13 GMT
• Title: Invariant Descriptors for Intrinsic Reflectance Optimization
• Authors: Anil S. Baslamisli, Theo Gevers
• Abstract summary: Intrinsic image decomposition aims to factorize an image into albedo (reflectance) and shading (illumination) sub-components. Being ill-posed and under-constrained, it is a very challenging computer vision problem. Our approach is physics-based, learning-free and leads to more accurate and robust reflectance decompositions.
• Score: 15.638996731038231
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Intrinsic image decomposition aims to factorize an image into albedo (reflectance) and shading (illumination) sub-components. Being ill-posed and under-constrained, it is a very challenging computer vision problem. There are infinite pairs of reflectance and shading images that can reconstruct the same input. To address the problem, Intrinsic Images in the Wild provides an optimization framework based on a dense conditional random field (CRF) formulation that considers long-range material relations. We improve upon their model by introducing illumination invariant image descriptors: color ratios. The color ratios and the reflectance intrinsic are both invariant to illumination and thus are highly correlated. Through detailed experiments, we provide ways to inject the color ratios into the dense CRF optimization. Our approach is physics-based, learning-free and leads to more accurate and robust reflectance decompositions.

Related papers

• Photometric Inverse Rendering: Shading Cues Modeling and Surface Reflectance Regularization [46.146783750386994]
  We propose a new method for neural inverse rendering. Our method jointly optimize the light source position to account for the self-shadows in images. To enhance surface reflectance decomposition, we introduce a new regularization.
  arXiv  Detail & Related papers  (2024-08-13T11:39:14Z)
• NeISF: Neural Incident Stokes Field for Geometry and Material Estimation [50.588983686271284]
  Multi-view inverse rendering is the problem of estimating the scene parameters such as shapes, materials, or illuminations from a sequence of images captured under different viewpoints. We propose Neural Incident Stokes Fields (NeISF), a multi-view inverse framework that reduces ambiguities using polarization cues.
  arXiv  Detail & Related papers  (2023-11-22T06:28:30Z)
• Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering [63.24476194987721]
  Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. Most existing solutions incorporate priors into the inverse-rendering pipeline to encourage plausible solutions. We propose a novel scheme that integrates a denoising probabilistic diffusion model pre-trained on natural illumination maps into an optimization framework.
  arXiv  Detail & Related papers  (2023-09-30T12:39:28Z)
• NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect Illumination [48.42173911185454]
  Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images. We propose an end-to-end inverse rendering pipeline that decomposes materials and illumination from multi-view images.
  arXiv  Detail & Related papers  (2023-03-29T12:05:19Z)
• DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering [75.86523223933912]
  Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by the unknown light. We propose DANI-Net, an inverse rendering framework with differentiable shadow handling and anisotropic reflectance modeling. Our network benefits from cues of shadow and anisotropic reflectance through two differentiable paths.
  arXiv  Detail & Related papers  (2023-03-27T11:10:54Z)
• NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo [70.71400320657035]
  Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by unknown light. This paper establishes an implicit relation between light clues and light estimation and solves UPS in an unsupervised manner.
  arXiv  Detail & Related papers  (2022-08-18T15:11:24Z)
• Self-Supervised Intrinsic Image Decomposition Network Considering Reflectance Consistency [23.300763504208593]
  Intrinsic image decomposition aims to decompose an image into illumination-invariant and illumination-variant components. Our network can decompose images into reflectance and shading components.
  arXiv  Detail & Related papers  (2021-11-05T07:52:06Z)
• Efficient and Differentiable Shadow Computation for Inverse Problems [64.70468076488419]
  Differentiable geometric computation has received increasing interest for image-based inverse problems. We propose an efficient yet efficient approach for differentiable visibility and soft shadow computation. As our formulation is differentiable, it can be used to solve inverse problems such as texture, illumination, rigid pose, and deformation recovery from images.
  arXiv  Detail & Related papers  (2021-04-01T09:29:05Z)
• A Switched View of Retinex: Deep Self-Regularized Low-Light Image Enhancement [5.217306793654357]
  Self-regularized low-light image enhancement does not require any normal-light image in training, thereby freeing from the chains on paired or unpaired low-/normal-images. This paper presents a novel self-regularized method based on Retinex, which preserves all colors (Hue, Saturation) and only integrates Retinex theory into brightness (Value) Our method is efficient as a low-light image is decoupled into two subspaces, color and brightness, for better preservation and enhancement.
  arXiv  Detail & Related papers  (2021-01-03T10:40:31Z)
• Physics-based Shading Reconstruction for Intrinsic Image Decomposition [20.44458250060927]
  We propose albedo and shading gradient descriptors which are derived from physics-based models. An initial sparse shading map is calculated directly from the corresponding RGB image gradients in a learning-free unsupervised manner. An optimization method is proposed to reconstruct the full dense shading map. We are the first to directly address the texture and intensity ambiguity problems of the shading estimations.
  arXiv  Detail & Related papers  (2020-09-03T09:30:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.