Structured Light with Redundancy Codes
- URL: http://arxiv.org/abs/2206.09243v1
- Date: Sat, 18 Jun 2022 16:52:30 GMT
- Title: Structured Light with Redundancy Codes
- Abstract summary: Structured light (SL) systems acquire high-fidelity 3D geometry with active illumination projection.
This paper proposes a technique to improve the robustness of SL by projecting redundant optical signals in addition to the native SL patterns.
- Score: 14.828194821588456
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Structured light (SL) systems acquire high-fidelity 3D geometry with active
illumination projection. Conventional systems exhibit challenges when working
in environments with strong ambient illumination, global illumination and
cross-device interference. This paper proposes a general-purposed technique to
improve the robustness of SL by projecting redundant optical signals in
addition to the native SL patterns. In this way, projected signals become more
distinguishable from errors. Thus the geometry information can be more easily
recovered using simple signal processing and the ``coding gain" in performance
is obtained. We propose three applications using our redundancy codes: (1) Self
error-correction for SL imaging under strong ambient light, (2) Error detection
for adaptive reconstruction under global illumination, and (3) Interference
filtering with device-specific projection sequence encoding, especially for
event camera-based SL and light curtain devices. We systematically analyze the
design rules and signal processing algorithms in these applications.
Corresponding hardware prototypes are built for evaluations on real-world
complex scenes. Experimental results on the synthetic and real data demonstrate
the significant performance improvements in SL systems with our redundancy
codes.
Related papers
- SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception [20.515607443256073]
We extend Dark Gaussian Splatting to a more accurate and flexible relightable 3D reconstruction framework.<n>We introduce a low-frequency illumination model based on spherical harmonics to capture spatially varying residual and ambient lighting effects.<n> Experiments on synthetic and real-world datasets demonstrate that our method effectively mitigates illumination artifacts while improving rendering quality and quantitative performance over prior approaches.
arXiv Detail & Related papers (2026-08-11T17:35:34Z) - Unifying Color and Lightness Correction with View-Adaptive Curve Adjustment for Robust 3D Novel View Synthesis [73.27997579020233]
We propose Luminance-GS++, a 3DGS-based framework for robust NVS under diverse illumination conditions.<n>Our method combines a globally view-adaptive lightness adjustment with a local pixel-wise residual refinement for precise color correction.
arXiv Detail & Related papers (2026-02-20T16:20:50Z) - SAIGFormer: A Spatially-Adaptive Illumination-Guided Network for Low-Light Image Enhancement [58.79901582809091]
Recent Transformer-based low-light enhancement methods have made promising progress in recovering global illumination.<n>Recent Transformer-based low-light enhancement methods have made promising progress in recovering global illumination.<n>We present a Spatially-Adaptive Illumination-Guided Transformer framework that enables accurate illumination restoration.
arXiv Detail & Related papers (2025-07-21T11:38:56Z) - Low-Light Enhancement via Encoder-Decoder Network with Illumination Guidance [0.0]
This paper introduces a novel deep learning framework for low-light image enhancement, named the.<n>the-Decoder Network with Illumination Guidance (EDNIG)<n>EDNIG integrates an illumination map, derived from Bright Channel Prior (BCP), as a guidance input.<n>It is optimized within a Generative Adversarial Network (GAN) framework using a composite loss function that combines adversarial loss, pixel-wise mean squared error (MSE), and perceptual loss.
arXiv Detail & Related papers (2025-07-04T09:35:00Z) - Light of Normals: Unified Feature Representation for Universal Photometric Stereo [69.95514862547174]
Current encoders cannot guarantee that illumination and normal information are decoupled.<n>We introduce LINO UniPS with two key components: (i) Light Register Tokens with light alignment supervision to aggregate point, direction, and environment lights.<n>We also introduce PS-Verse, a large-scale synthetic dataset graded by geometric complexity and lighting diversity.
arXiv Detail & Related papers (2025-06-23T17:53:11Z) - Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis [49.67420486373202]
GRGS is a generalizable and relightable 3D Gaussian framework for high-fidelity human novel view synthesis under diverse lighting conditions.<n>We introduce a Lighting-aware Geometry Refinement (LGR) module trained on synthetically relit data to predict accurate depth and surface normals.
arXiv Detail & Related papers (2025-05-27T17:59:47Z) - LL-Gaussian: Low-Light Scene Reconstruction and Enhancement via Gaussian Splatting for Novel View Synthesis [17.470869402542533]
Novel view synthesis (NVS) in low-light scenes remains a significant challenge due to degraded inputs.
We propose LL-Gaussian, a novel framework for 3D reconstruction and enhancement from low-light sRGB images.
Compared to state-of-the-art NeRF-based methods, LL-Gaussian achieves up to 2,000 times faster inference and reduces training time to just 2%.
arXiv Detail & Related papers (2025-04-14T15:39:31Z) - LITA-GS: Illumination-Agnostic Novel View Synthesis via Reference-Free 3D Gaussian Splatting and Physical Priors [14.160637565120231]
LITA-GS is a novel illumination-agnostic novel view synthesis method via reference-free 3DGS and physical priors.
We develop the lighting-agnostic structure rendering strategy, which facilitates the optimization of the scene structure and object appearance.
We adopt the unsupervised strategy for the training of LITA-GS and extensive experiments demonstrate that LITA-GS surpasses the state-of-the-art (SOTA) NeRF-based method.
arXiv Detail & Related papers (2025-03-31T20:44:39Z) - Towards Unified Structured Light Optimization [2.4823372746556442]
Structured light (SL) 3D reconstruction captures the precise surface shape of objects.
We present a unified framework for SL optimization, adaptable to diverse lighting conditions, object types, and different types of SL.
Key contributions include a novel global matching method for projectors, enabling precise projector-camera alignment with just one projected image.
arXiv Detail & Related papers (2025-01-24T17:29:17Z) - IG-SLAM: Instant Gaussian SLAM [6.228980850646457]
3D Gaussian Splatting has recently shown promising results as an alternative scene representation in SLAM systems.
We present IG-SLAM, a dense RGB-only SLAM system that employs robust Dense-SLAM methods for tracking and combines them with Gaussian Splatting.
We demonstrate competitive performance with state-of-the-art RGB-only SLAM systems while achieving faster operation speeds.
arXiv Detail & Related papers (2024-08-02T09:07:31Z) - A Single Transformer for Scalable Vision-Language Modeling [74.05173379908703]
We present SOLO, a single transformer for visiOn-Language mOdeling.
A unified single Transformer architecture, like SOLO, effectively addresses these scalability concerns in LVLMs.
In this paper, we introduce the first open-source training recipe for developing SOLO, an open-source 7B LVLM.
arXiv Detail & Related papers (2024-07-08T22:40:15Z) - Diffusion-based Light Field Synthesis [50.24624071354433]
LFdiff is a diffusion-based generative framework tailored for LF synthesis.
We propose DistgUnet, a disentanglement-based noise estimation network, to harness comprehensive LF representations.
Extensive experiments demonstrate that LFdiff excels in synthesizing visually pleasing and disparity-controllable light fields.
arXiv Detail & Related papers (2024-02-01T13:13:16Z) - GS-IR: 3D Gaussian Splatting for Inverse Rendering [71.14234327414086]
We propose GS-IR, a novel inverse rendering approach based on 3D Gaussian Splatting (GS)
We extend GS, a top-performance representation for novel view synthesis, to estimate scene geometry, surface material, and environment illumination from multi-view images captured under unknown lighting conditions.
The flexible and expressive GS representation allows us to achieve fast and compact geometry reconstruction, photorealistic novel view synthesis, and effective physically-based rendering.
arXiv Detail & Related papers (2023-11-26T02:35:09Z) - NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAM [111.83168930989503]
NICER-SLAM is a dense RGB SLAM system that simultaneously optimize for camera poses and a hierarchical neural implicit map representation.
We show strong performance in dense mapping, tracking, and novel view synthesis, even competitive with recent RGB-D SLAM systems.
arXiv Detail & Related papers (2023-02-07T17:06:34Z) - Progressively-connected Light Field Network for Efficient View Synthesis [69.29043048775802]
We present a Progressively-connected Light Field network (ProLiF) for the novel view synthesis of complex forward-facing scenes.
ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step for image- or patch-level losses.
arXiv Detail & Related papers (2022-07-10T13:47:20Z) - Cycle-Interactive Generative Adversarial Network for Robust Unsupervised
Low-Light Enhancement [109.335317310485]
Cycle-Interactive Generative Adversarial Network (CIGAN) is capable of not only better transferring illumination distributions between low/normal-light images but also manipulating detailed signals.
In particular, the proposed low-light guided transformation feed-forwards the features of low-light images from the generator of enhancement GAN into the generator of degradation GAN.
arXiv Detail & Related papers (2022-07-03T06:37:46Z) - Phase-SLAM: Phase Based Simultaneous Localization and Mapping for Mobile
Structured Light Illumination Systems [14.9174946109114]
Phase-SLAM is a framework for fast and accurate SLI sensor pose estimation and 3D object reconstruction.
We build datasets from both a simulation platform and a robotic arm based SLI system in real-world to verify the proposed approach.
Experiment results demonstrate that the proposed Phase-SLAM outperforms other state-of-the-art methods in terms of pose estimation and 3D reconstruction.
arXiv Detail & Related papers (2022-01-22T13:47:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.