A Survey on Intrinsic Images: Delving Deep Into Lambert and Beyond
- URL: http://arxiv.org/abs/2112.03842v1
- Date: Tue, 7 Dec 2021 17:26:35 GMT
- Title: A Survey on Intrinsic Images: Delving Deep Into Lambert and Beyond
- Authors: Elena Garces, Carlos Rodriguez-Pardo, Dan Casas, Jorge Lopez-Moreno
- Abstract summary: Intrinsic imaging or intrinsic image decomposition has traditionally been described as the problem of decomposing an image into two layers.
Deep learning techniques have been broadly applied in recent years to increase the accuracy of those separations.
We show that there is increasing awareness on the potential of more sophisticated physically-principled components of the image formation process.
- Score: 8.313161485540338
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Intrinsic imaging or intrinsic image decomposition has traditionally been
described as the problem of decomposing an image into two layers: a
reflectance, the albedo invariant color of the material; and a shading,
produced by the interaction between light and geometry. Deep learning
techniques have been broadly applied in recent years to increase the accuracy
of those separations. In this survey, we overview those results in context of
well-known intrinsic image data sets and relevant metrics used in the
literature, discussing their suitability to predict a desirable intrinsic image
decomposition. Although the Lambertian assumption is still a foundational basis
for many methods, we show that there is increasing awareness on the potential
of more sophisticated physically-principled components of the image formation
process, that is, optically accurate material models and geometry, and more
complete inverse light transport estimations. We classify these methods in
terms of the type of decomposition, considering the priors and models used, as
well as the learning architecture and methodology driving the decomposition
process. We also provide insights about future directions for research, given
the recent advances in neural, inverse and differentiable rendering techniques.
Related papers
- IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination [37.96484120807323]
This paper aims to recover object materials from posed images captured under an unknown static lighting condition.
We learn the material prior with a generative model for regularizing the optimization process.
Experiments on real-world and synthetic datasets demonstrate that our approach achieves state-of-the-art performance on material recovery.
arXiv Detail & Related papers (2024-04-17T17:45:08Z) - Intrinsic Image Diffusion for Indoor Single-view Material Estimation [55.276815106443976]
We present Intrinsic Image Diffusion, a generative model for appearance decomposition of indoor scenes.
Given a single input view, we sample multiple possible material explanations represented as albedo, roughness, and metallic maps.
Our method produces significantly sharper, more consistent, and more detailed materials, outperforming state-of-the-art methods by $1.5dB$ on PSNR and by $45%$ better FID score on albedo prediction.
arXiv Detail & Related papers (2023-12-19T15:56:19Z) - Diffusion Posterior Illumination for Ambiguity-aware Inverse Rendering [63.24476194987721]
Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem.
Most existing solutions incorporate priors into the inverse-rendering pipeline to encourage plausible solutions.
We propose a novel scheme that integrates a denoising probabilistic diffusion model pre-trained on natural illumination maps into an optimization framework.
arXiv Detail & Related papers (2023-09-30T12:39:28Z) - TexPose: Neural Texture Learning for Self-Supervised 6D Object Pose
Estimation [55.94900327396771]
We introduce neural texture learning for 6D object pose estimation from synthetic data.
We learn to predict realistic texture of objects from real image collections.
We learn pose estimation from pixel-perfect synthetic data.
arXiv Detail & Related papers (2022-12-25T13:36:32Z) - Deep Learning Methods for Calibrated Photometric Stereo and Beyond [86.57469194387264]
Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues.
Deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces.
arXiv Detail & Related papers (2022-12-16T11:27:44Z) - Incorporating Texture Information into Dimensionality Reduction for
High-Dimensional Images [65.74185962364211]
We present a method for incorporating neighborhood information into distance-based dimensionality reduction methods.
Based on a classification of different methods for comparing image patches, we explore a number of different approaches.
arXiv Detail & Related papers (2022-02-18T13:17:43Z) - An Optical physics inspired CNN approach for intrinsic image
decomposition [0.0]
Intrinsic Image Decomposition is an open problem of generating the constituents of an image.
We propose a neural network architecture capable of this decomposition using physics-based parameters derived from the image.
arXiv Detail & Related papers (2021-05-21T00:54:01Z) - Prior Image-Constrained Reconstruction using Style-Based Generative
Models [15.757204774959366]
We propose a framework for estimating an object of interest that is semantically related to a known prior image.
An optimization problem is formulated in the disentangled latent space of a style-based generative model.
Semantically meaningful constraints are imposed using the disentangled latent representation of the prior image.
arXiv Detail & Related papers (2021-02-24T19:36:55Z) - Depth image denoising using nuclear norm and learning graph model [107.51199787840066]
Group-based image restoration methods are more effective in gathering the similarity among patches.
For each patch, we find and group the most similar patches within a searching window.
The proposed method is superior to other current state-of-the-art denoising methods in both subjective and objective criterion.
arXiv Detail & Related papers (2020-08-09T15:12:16Z) - Learning Spatial Relationships between Samples of Patent Image Shapes [14.37369942979269]
We propose a method suitable to binary images which bridges some of the successes of deep learning (DL)
The method consists on extracting the shape of interest from the binary image and applying a non-Euclidean geometric neural-net architecture to learn the local and global spatial relationships of the shape.
arXiv Detail & Related papers (2020-04-12T23:05:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.