Adaptive Illumination Control for Robot Perception

• URL: http://arxiv.org/abs/2602.15900v1
• Date: Fri, 13 Feb 2026 03:34:01 GMT
• Title: Adaptive Illumination Control for Robot Perception
• Abstract summary: Lightning is a closed-loop illumination-control framework for visual SLAM.<n>It combines relighting, offline optimization, and imitation learning.<n>It substantially improves SLAM trajectory while reducing unnecessary illumination power.
• Score: 6.718749267591075
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Robot perception under low light or high dynamic range is usually improved downstream - via more robust feature extraction, image enhancement, or closed-loop exposure control. However, all of these approaches are limited by the image captured these conditions. An alternate approach is to utilize a programmable onboard light that adds to ambient illumination and improves captured images. However, it is not straightforward to predict its impact on image formation. Illumination interacts nonlinearly with depth, surface reflectance, and scene geometry. It can both reveal structure and induce failure modes such as specular highlights and saturation. We introduce Lightning, a closed-loop illumination-control framework for visual SLAM that combines relighting, offline optimization, and imitation learning. This is performed in three stages. First, we train a Co-Located Illumination Decomposition (CLID) relighting model that decomposes a robot observation into an ambient component and a light-contribution field. CLID enables physically consistent synthesis of the same scene under alternative light intensities and thereby creates dense multi-intensity training data without requiring us to repeatedly re-run trajectories. Second, using these synthesized candidates, we formulate an offline Optimal Intensity Schedule (OIS) problem that selects illumination levels over a sequence trading off SLAM-relevant image utility against power consumption and temporal smoothness. Third, we distill this ideal solution into a real-time controller through behavior cloning, producing an Illumination Control Policy (ILC) that generalizes beyond the initial training distribution and runs online on a mobile robot to command discrete light-intensity levels. Across our evaluation, Lightning substantially improves SLAM trajectory robustness while reducing unnecessary illumination power.

Related papers

• SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception [20.515607443256073]
  We extend Dark Gaussian Splatting to a more accurate and flexible relightable 3D reconstruction framework.<n>We introduce a low-frequency illumination model based on spherical harmonics to capture spatially varying residual and ambient lighting effects.<n> Experiments on synthetic and real-world datasets demonstrate that our method effectively mitigates illumination artifacts while improving rendering quality and quantitative performance over prior approaches.
  arXiv  Detail & Related papers  (2026-08-11T17:35:34Z)
• LiveLight: Real-time Streaming Video Relighting with Interactive Control [50.08584152649119]
  We present LiveLight, the first diffusion-based framework for real-time streaming video relighting with interactive 3D lighting control.<n>We overcome three critical challenges: effectively injecting dynamic 3D lighting into a diffusion model, maintaining high-fidelity generation under a low NFE budget, and facilitating continuous streaming for interactive control.<n>Experiments on real-world and synthetic benchmarks demonstrate that LiveLight achieves state-of-the-art relighting quality while running at real-time speed.
  arXiv  Detail & Related papers  (2026-08-03T06:45:00Z)
• InterLight: Leveraging Intrinsic Illumination Priors for Low-Light Image Enhancement [17.150076992068733]
  Low-Light Image Enhancement (LLIE) has long been a challenging problem in low-level vision.<n>Recent studies show that deep learning-based Retinex theory can effectively decouple illumination and reflectance.<n>We propose InterLight, a novel framework that systematically excavates and operationalizes intrinsic illumination priors for LLIE.
  arXiv  Detail & Related papers  (2026-05-19T15:24:00Z)
• Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting [11.31291385822484]
  UAV navigation in unstructured outdoor environments using passive monocular vision is hindered by the substantial visual domain gap between simulation and reality.<n>We propose a novel end-to-end reinforcement learning framework designed for effective zero-shot transfer to unstructured outdoors.<n>We show that a lightweight quadrotor achieves robust, collision-free navigation in complex forest environments at speeds up to 10 m/s.
  arXiv  Detail & Related papers  (2026-02-06T15:51:03Z)
• HeadLighter: Disentangling Illumination in Generative 3D Gaussian Heads via Lightstage Captures [69.99269185793929]
  Recent 3D-aware head generative models based on 3D Gaussian Splatting achieve real-time, photorealistic and view-consistent head synthesis.<n>Deep entanglement of illumination and intrinsic appearance prevents controllable relighting.<n>We introduce HeadLighter, a novel supervised framework that learns a physically plausible decomposition of appearance and illumination in head generative models.
  arXiv  Detail & Related papers  (2026-01-05T13:32:37Z)
• Light-X: Generative 4D Video Rendering with Camera and Illumination Control [52.87059646145144]
  Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control.<n>To address the lack of paired multi-view and multi-illumination videos, we introduce Light-Syn, a degradation-based pipeline with inverse-mapping.
  arXiv  Detail & Related papers  (2025-12-04T18:59:57Z)
• GLOW: Global Illumination-Aware Inverse Rendering of Indoor Scenes Captured with Dynamic Co-Located Light & Camera [18.90141473604964]
  Inverse rendering of indoor scenes remains challenging due to the ambiguity between reflectance and lighting.<n>We present GLOW, a Global Illumination-aware Inverse Rendering framework designed to address these challenges.
  arXiv  Detail & Related papers  (2025-11-28T03:24:12Z)
• DIME-Net: A Dual-Illumination Adaptive Enhancement Network Based on Retinex and Mixture-of-Experts [7.6894262288762665]
  We propose a dual-illumination enhancement framework called DIME-Net.<n>By integrating Retinex theory, this module effectively performs enhancement tailored to both low-light and backlit images.<n>We show that DIME-Net achieves competitive performance on both synthetic and real-world low-light and backlit datasets without any retraining.
  arXiv  Detail & Related papers  (2025-08-19T15:17:47Z)
• LightLab: Controlling Light Sources in Images with Diffusion Models [49.83835236202516]
  We present a diffusion-based method for fine-grained, parametric control over light sources in an image.<n>We leverage the linearity of light to synthesize image pairs depicting controlled light changes of either a target light source or ambient illumination.<n>We show how our method can achieve compelling light editing results, and outperforms existing methods based on user preference.
  arXiv  Detail & Related papers  (2025-05-14T17:57:27Z)
• When Lighting Deceives: Exposing Vision-Language Models' Illumination Vulnerability Through Illumination Transformation Attack [13.197468488144038]
  Vision-Language Models (VLMs) have achieved remarkable success in various tasks, yet their robustness to real-world illumination variations remains largely unexplored.<n>We propose textbfIllumination textbfTransformation textbfAttack (textbfITA), the first framework to systematically assess VLMs' robustness against illumination changes.
  arXiv  Detail & Related papers  (2025-03-10T04:12:56Z)
• DAP-LED: Learning Degradation-Aware Priors with CLIP for Joint Low-light Enhancement and Deblurring [14.003870853594972]
  We propose a novel transformer-based joint learning framework, named DAP-LED. It can jointly achieve low-light enhancement and deblurring, benefiting downstream tasks, such as depth estimation, segmentation, and detection in the dark. The key insight is to leverage CLIP to adaptively learn the degradation levels from images at night.
  arXiv  Detail & Related papers  (2024-09-20T13:37:53Z)
• Zero-Reference Low-Light Enhancement via Physical Quadruple Priors [58.77377454210244]
  We propose a new zero-reference low-light enhancement framework trainable solely with normal light images. This framework is able to restore our illumination-invariant prior back to images, automatically achieving low-light enhancement.
  arXiv  Detail & Related papers  (2024-03-19T17:36:28Z)
• Cycle-Interactive Generative Adversarial Network for Robust Unsupervised Low-Light Enhancement [109.335317310485]
  Cycle-Interactive Generative Adversarial Network (CIGAN) is capable of not only better transferring illumination distributions between low/normal-light images but also manipulating detailed signals. In particular, the proposed low-light guided transformation feed-forwards the features of low-light images from the generator of enhancement GAN into the generator of degradation GAN.
  arXiv  Detail & Related papers  (2022-07-03T06:37:46Z)
• When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimation [47.617222712429026]
  We show how to use a combination of three techniques to allow the existing photometric losses to work for both day and nighttime images. First, we introduce a per-pixel neural intensity transformation to compensate for the light changes that occur between successive frames. Second, we predict a per-pixel residual flow map that we use to correct the reprojection correspondences induced by the estimated ego-motion and depth.
  arXiv  Detail & Related papers  (2022-06-28T09:29:55Z)
• Unsupervised Low-light Image Enhancement with Decoupled Networks [103.74355338972123]
  We learn a two-stage GAN-based framework to enhance the real-world low-light images in a fully unsupervised fashion. Our proposed method outperforms the state-of-the-art unsupervised image enhancement methods in terms of both illumination enhancement and noise reduction.
  arXiv  Detail & Related papers  (2020-05-06T13:37:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.