LUCES: A Dataset for Near-Field Point Light Source Photometric Stereo
- URL: http://arxiv.org/abs/2104.13135v1
- Date: Tue, 27 Apr 2021 12:30:42 GMT
- Title: LUCES: A Dataset for Near-Field Point Light Source Photometric Stereo
- Authors: Roberto Mecca, Fotios Logothetis, Ignas Budvytis, Roberto Cipolla
- Abstract summary: We introduce LUCES, the first real-world 'dataset for near-fieLd point light soUrCe photomEtric Stereo' of 14 objects of a varying of materials.
A device counting 52 LEDs has been designed to lit each object positioned 10 to 30 centimeters away from the camera.
We evaluate the performance of the latest near-field Photometric Stereo algorithms on the proposed dataset.
- Score: 30.31403197697561
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Three-dimensional reconstruction of objects from shading information is a
challenging task in computer vision. As most of the approaches facing the
Photometric Stereo problem use simplified far-field assumptions, real-world
scenarios have essentially more complex physical effects that need to be
handled for accurately reconstructing the 3D shape. An increasing number of
methods have been proposed to address the problem when point light sources are
assumed to be nearby the target object. The proximity of the light sources
complicates the modeling of the image formation as the light behaviour requires
non-linear parameterisation to describe its propagation and attenuation.
To understand the capability of the approaches dealing with this near-field
scenario, the literature till now has used synthetically rendered photometric
images or minimal and very customised real-world data. In order to fill the gap
in evaluating near-field photometric stereo methods, we introduce LUCES the
first real-world 'dataset for near-fieLd point light soUrCe photomEtric Stereo'
of 14 objects of a varying of materials. A device counting 52 LEDs has been
designed to lit each object positioned 10 to 30 centimeters away from the
camera. Together with the raw images, in order to evaluate the 3D
reconstructions, the dataset includes both normal and depth maps for comparing
different features of the retrieved 3D geometry. Furthermore, we evaluate the
performance of the latest near-field Photometric Stereo algorithms on the
proposed dataset to assess the SOTA method with respect to actual close range
effects and object materials.
Related papers
- Multi-Modal Dataset Acquisition for Photometrically Challenging Object [56.30027922063559]
This paper addresses the limitations of current datasets for 3D vision tasks in terms of accuracy, size, realism, and suitable imaging modalities for photometrically challenging objects.
We propose a novel annotation and acquisition pipeline that enhances existing 3D perception and 6D object pose datasets.
arXiv Detail & Related papers (2023-08-21T10:38:32Z) - Deep Learning Methods for Calibrated Photometric Stereo and Beyond [86.57469194387264]
Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues.
Deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces.
arXiv Detail & Related papers (2022-12-16T11:27:44Z) - A CNN Based Approach for the Point-Light Photometric Stereo Problem [26.958763133729846]
We propose a CNN-based approach capable of handling realistic assumptions by leveraging recent improvements of deep neural networks for far-field Photometric Stereo.
Our approach outperforms the state-of-the-art on the DiLiGenT real world dataset.
In order to measure the performance of our approach for near-field point-light source PS data, we introduce LUCES the first real-world 'dataset for near-fieLd point light soUrCe photomEtric Stereo'
arXiv Detail & Related papers (2022-10-10T12:57:12Z) - Self-calibrating Photometric Stereo by Neural Inverse Rendering [88.67603644930466]
This paper tackles the task of uncalibrated photometric stereo for 3D object reconstruction.
We propose a new method that jointly optimize object shape, light directions, and light intensities.
Our method demonstrates state-of-the-art accuracy in light estimation and shape recovery on real-world datasets.
arXiv Detail & Related papers (2022-07-16T02:46:15Z) - Neural Radiance Fields Approach to Deep Multi-View Photometric Stereo [103.08512487830669]
We present a modern solution to the multi-view photometric stereo problem (MVPS)
We procure the surface orientation using a photometric stereo (PS) image formation model and blend it with a multi-view neural radiance field representation to recover the object's surface geometry.
Our method performs neural rendering of multi-view images while utilizing surface normals estimated by a deep photometric stereo network.
arXiv Detail & Related papers (2021-10-11T20:20:03Z) - A CNN Based Approach for the Near-Field Photometric Stereo Problem [26.958763133729846]
We propose the first CNN based approach capable of handling realistic assumptions in Photometric Stereo.
We leverage recent improvements of deep neural networks for far-field Photometric Stereo and adapt them to near field setup.
Our method outperforms competing state-of-the-art near-field Photometric Stereo approaches on both synthetic and real experiments.
arXiv Detail & Related papers (2020-09-12T13:28:28Z) - Single View Metrology in the Wild [94.7005246862618]
We present a novel approach to single view metrology that can recover the absolute scale of a scene represented by 3D heights of objects or camera height above the ground.
Our method relies on data-driven priors learned by a deep network specifically designed to imbibe weakly supervised constraints from the interplay of the unknown camera with 3D entities such as object heights.
We demonstrate state-of-the-art qualitative and quantitative results on several datasets as well as applications including virtual object insertion.
arXiv Detail & Related papers (2020-07-18T22:31:33Z) - Multi-View Photometric Stereo: A Robust Solution and Benchmark Dataset
for Spatially Varying Isotropic Materials [65.95928593628128]
We present a method to capture both 3D shape and spatially varying reflectance with a multi-view photometric stereo technique.
Our algorithm is suitable for perspective cameras and nearby point light sources.
arXiv Detail & Related papers (2020-01-18T12:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.