Taming the Light: Illumination-Invariant Semantic 3DGS-SLAM

• URL: http://arxiv.org/abs/2511.22968v1
• Date: Fri, 28 Nov 2025 08:19:40 GMT
• Title: Taming the Light: Illumination-Invariant Semantic 3DGS-SLAM
• Abstract summary: Extreme exposure degrades 3D map reconstruction and semantic segmentation accuracy.<n>We propose a novel semantic SLAM framework with two designs.<n>First, the Intrinsic Appearance Normalization module proactively disentangles the scene's intrinsic properties, such as albedo, from transient lighting.<n>Second, the Dynamic Radiance Balancing Loss (DRB-Loss) reactively handles frames with extreme exposure.
• Score: 17.050977825997617
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Extreme exposure degrades both the 3D map reconstruction and semantic segmentation accuracy, which is particularly detrimental to tightly-coupled systems. To achieve illumination invariance, we propose a novel semantic SLAM framework with two designs. First, the Intrinsic Appearance Normalization (IAN) module proactively disentangles the scene's intrinsic properties, such as albedo, from transient lighting. By learning a standardized, illumination-invariant appearance model, it assigns a stable and consistent color representation to each Gaussian primitive. Second, the Dynamic Radiance Balancing Loss (DRB-Loss) reactively handles frames with extreme exposure. It activates only when an image's exposure is poor, operating directly on the radiance field to guide targeted optimization. This prevents error accumulation from extreme lighting without compromising performance under normal conditions. The synergy between IAN's proactive invariance and DRB-Loss's reactive correction endows our system with unprecedented robustness. Evaluations on public datasets demonstrate state-of-the-art performance in camera tracking, map quality, and semantic and geometric accuracy.

Related papers

• SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception [20.515607443256073]
  We extend Dark Gaussian Splatting to a more accurate and flexible relightable 3D reconstruction framework.<n>We introduce a low-frequency illumination model based on spherical harmonics to capture spatially varying residual and ambient lighting effects.<n> Experiments on synthetic and real-world datasets demonstrate that our method effectively mitigates illumination artifacts while improving rendering quality and quantitative performance over prior approaches.
  arXiv  Detail & Related papers  (2026-08-11T17:35:34Z)
• Do Image Editing Models Understand Lighting? [52.657799986035464]
  We introduce the 3D-anchored Light Probe (3DLP) benchmark, for which we have captured a new high-fidelity HDR dataset of real-world lighting changes.<n>The dataset consists of 1K image pairs of diverse indoor scenery in which light probes are physically turned on and off.<n>We evaluate a range of state-of-the-art image editing models by measuring how well their light probe edits align with reality.
  arXiv  Detail & Related papers  (2026-06-25T08:20:34Z)
• P2GS: Physical Prior-guided Gaussian Splatting for Photometrically Consistent Urban Reconstruction [17.200962739706767]
  3D Gaussian Splatting (3DGS) has recently emerged as a powerful explicit representation enabling fast, high-fidelity rendering.<n>We introduce P2GS, a physically consistent framework that jointly decomposes a view-invariant linear HDR radiance field, per-view exposure scales, and tone-mapping functions.<n>Experiments show that P2GS matches or surpasses prior methods in LDR reconstruction while providing substantially improved photometric consistency.
  arXiv  Detail & Related papers  (2026-05-16T10:36:23Z)
• R-PGA: Robust Physical Adversarial Camouflage Generation via Relightable 3D Gaussian Splatting [59.29134814041703]
  Physical adversarial camouflage poses a severe security threat to autonomous driving systems.<n>Current methods fail to generalize across diverse geometric (e.g., viewing configurations) and radiometric variations.<n>We propose the Relightable Physical 3D Gaussian Splatting framework (R-PGA)
  arXiv  Detail & Related papers  (2026-03-27T04:38:04Z)
• E2EGS: Event-to-Edge Gaussian Splatting for Pose-Free 3D Reconstruction [16.506055417458153]
  We present E2EGS, a pose-free framework operating solely on event streams.<n>We exploit the distincttemporal-weighted characteristics of edges and non-edge regions.<n>E2EGS achieves superior reconstruction quality and trajectory accuracy.
  arXiv  Detail & Related papers  (2026-03-16T00:40:28Z)
• WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos [68.43355277637882]
  We introduce WildGHand, an optimization-based framework that enables self-adaptive 3D Gaussian splatting on in-the-wild videos.<n>We further curate a dataset of monocular hand videos captured under diverse perturbations to benchmark in-the-wild hand avatar reconstruction.
  arXiv  Detail & Related papers  (2026-02-24T05:14:05Z)
• UP-Fuse: Uncertainty-guided LiDAR-Camera Fusion for 3D Panoptic Segmentation [17.310791153991975]
  We introduce UP-Fuse, a novel uncertainty-aware fusion framework in the 2D range-view.<n>Raw LiDAR data is first projected into the range-view and encoded by a LiDAR encoder.<n>Camera features are simultaneously extracted and projected into the same shared space.
  arXiv  Detail & Related papers  (2026-02-22T21:34:29Z)
• Unifying Color and Lightness Correction with View-Adaptive Curve Adjustment for Robust 3D Novel View Synthesis [73.27997579020233]
  We propose Luminance-GS++, a 3DGS-based framework for robust NVS under diverse illumination conditions.<n>Our method combines a globally view-adaptive lightness adjustment with a local pixel-wise residual refinement for precise color correction.
  arXiv  Detail & Related papers  (2026-02-20T16:20:50Z)
• EAG-PT: Emission-Aware Gaussians and Path Tracing for Indoor Scene Reconstruction and Editing [63.64931392651423]
  We propose Emission-Aware Gaussians and Path Tracing (EAG-PT), aiming for physically based light transport with a unified 2D Gaussian representation.<n>Our design is based on three cores: (1) using 2D Gaussians as a unified scene representation and transport-friendly geometry proxy that avoids reconstructed mesh, (2) explicitly separating emissive and non-emissive components during reconstruction for further scene editing, and (3) decoupling reconstruction from final rendering by using efficient single-bounce optimization and high-quality multi-bounce path tracing after scene editing.
  arXiv  Detail & Related papers  (2026-01-30T15:16:37Z)
• ROSGS: Relightable Outdoor Scenes With Gaussian Splatting [33.2992160880414]
  We propose ROSGS, a two-stage pipeline designed to reconstruct relightable outdoor scenes using the Gaussian Splatting representation.<n>We show that ROSGS achieves state-of-the-art performance in relighting outdoor scenes and highlight its ability to deliver superior relighting accuracy and rendering efficiency.
  arXiv  Detail & Related papers  (2025-09-14T13:58:58Z)
• EBAD-Gaussian: Event-driven Bundle Adjusted Deblur Gaussian Splatting [21.46091843175779]
  Event-driven Bundle Adjusted Deblur Gaussian Splatting (EBAD-Gaussian)<n>EBAD-Gaussian reconstructs sharp 3D Gaussians from event streams and severely blurred images.<n>Experiments on synthetic and real-world datasets show that EBAD-Gaussian can achieve high-quality 3D scene reconstruction.
  arXiv  Detail & Related papers  (2025-04-14T09:17:00Z)
• D3DR: Lighting-Aware Object Insertion in Gaussian Splatting [48.80431740983095]
  We propose a method, dubbed D3DR, for inserting a 3DGS-parametrized object into 3DGS scenes.<n>We leverage advances in diffusion models, which, trained on real-world data, implicitly understand correct scene lighting.<n>We demonstrate the method's effectiveness by comparing it to existing approaches.
  arXiv  Detail & Related papers  (2025-03-09T19:48:00Z)
• GUS-IR: Gaussian Splatting with Unified Shading for Inverse Rendering [83.69136534797686]
  We present GUS-IR, a novel framework designed to address the inverse rendering problem for complicated scenes featuring rough and glossy surfaces. This paper starts by analyzing and comparing two prominent shading techniques popularly used for inverse rendering, forward shading and deferred shading. We propose a unified shading solution that combines the advantages of both techniques for better decomposition.
  arXiv  Detail & Related papers  (2024-11-12T01:51:05Z)
• GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Rendering [6.820642721852439]
  We present GI-GS, a novel inverse rendering framework that leverages 3D Gaussian Splatting (3DGS) and deferred shading.<n>In our framework, we first render a G-buffer to capture the detailed geometry and material properties of the scene.<n>With the G-buffer and previous rendering results, the indirect lighting can be calculated through a lightweight path tracing.
  arXiv  Detail & Related papers  (2024-10-03T15:58:18Z)
• GS-ID: Illumination Decomposition on Gaussian Splatting via Adaptive Light Aggregation and Diffusion-Guided Material Priors [5.7153963416911]
  Gaussian Splatting (GS) has emerged as an effective representation for rendering, but the underlying geometry, material, and lighting remain entangled.<n>We propose textbfGS-ID, an end-to-end framework for illumination decomposition.<n> Experiments demonstrate the effectiveness of GS-ID for downstream applications such as relighting and scene composition.
  arXiv  Detail & Related papers  (2024-08-16T04:38:31Z)
• MetaGS: A Meta-Learned Gaussian-Phong Model for Out-of-Distribution 3D Scene Relighting [63.5925701087252]
  Out-of-distribution (OOD) 3D relighting requires novel view synthesis under unseen lighting conditions.<n>We introduce MetaGS to tackle this challenge from two perspectives.
  arXiv  Detail & Related papers  (2024-05-31T13:48:54Z)
• DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading [50.331929164207324]
  We introduce DeferredGS, a method for decoupling and editing the Gaussian splatting representation using deferred shading. Both qualitative and quantitative experiments demonstrate the superior performance of DeferredGS in novel view and editing tasks.
  arXiv  Detail & Related papers  (2024-04-15T01:58:54Z)
• NeIF: Representing General Reflectance as Neural Intrinsics Fields for Uncalibrated Photometric Stereo [70.71400320657035]
  Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by unknown light. This paper establishes an implicit relation between light clues and light estimation and solves UPS in an unsupervised manner.
  arXiv  Detail & Related papers  (2022-08-18T15:11:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.