TRGS-SLAM: IMU-Aided Gaussian Splatting SLAM for Blurry, Rolling Shutter, and Noisy Thermal Images
- URL: http://arxiv.org/abs/2603.20443v1
- Date: Fri, 20 Mar 2026 19:18:31 GMT
- Title: TRGS-SLAM: IMU-Aided Gaussian Splatting SLAM for Blurry, Rolling Shutter, and Noisy Thermal Images
- Abstract summary: We present TRGS-SLAM, a 3D Gaussian Splatting (3DGS) based thermal inertial SLAM system.<n>To overcome the challenges of thermal data, we introduce a model-aware 3DGS rendering method and several general innovations to 3DGS SLAM.<n>Our system demonstrates accurate tracking on real-world, fast motion, and high-noise thermal data that causes all other tested SLAM methods to fail.
- Score: 9.011910869866702
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Thermal cameras offer several advantages for simultaneous localization and mapping (SLAM) with mobile robots: they provide a passive, low-power solution to operating in darkness, are invariant to rapidly changing or high dynamic range illumination, and can see through fog, dust, and smoke. However, uncooled microbolometer thermal cameras, the only practical option in most robotics applications, suffer from significant motion blur, rolling shutter distortions, and fixed pattern noise. In this paper, we present TRGS-SLAM, a 3D Gaussian Splatting (3DGS) based thermal inertial SLAM system uniquely capable of handling these degradations. To overcome the challenges of thermal data, we introduce a model-aware 3DGS rendering method and several general innovations to 3DGS SLAM, including B-spline trajectory optimization with a two-stage IMU loss, view-diversity-based opacity resetting, and pose drift correction schemes. Our system demonstrates accurate tracking on real-world, fast motion, and high-noise thermal data that causes all other tested SLAM methods to fail. Moreover, through offline refinement of our SLAM results, we demonstrate thermal image restoration competitive with prior work that required ground truth poses.
Related papers
- SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception [20.515607443256073]
We extend Dark Gaussian Splatting to a more accurate and flexible relightable 3D reconstruction framework.<n>We introduce a low-frequency illumination model based on spherical harmonics to capture spatially varying residual and ambient lighting effects.<n> Experiments on synthetic and real-world datasets demonstrate that our method effectively mitigates illumination artifacts while improving rendering quality and quantitative performance over prior approaches.
arXiv Detail & Related papers (2026-08-11T17:35:34Z) - Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM [55.56111618153049]
We propose an efficient framework for dynamic 3DGS SLAM guided by optical flow.<n>We boost the training speed of dynamic 3DGS by explicitly modeling their temporal centers.<n>The empirical results demonstrate our state-of-the-art performance in tracking, dynamic reconstruction, and training efficiency.
arXiv Detail & Related papers (2026-04-24T08:13:01Z) - LST-SLAM: A Stereo Thermal SLAM System for Kilometer-Scale Dynamic Environments [9.986292956956953]
LST-SLAM is a novel large-scale stereo thermal SLAM system that achieves robust performance in complex, dynamic scenes.<n>Our approach combines self-supervised thermal feature learning, stereo dual-level motion tracking, and geometric pose optimization.<n>Experiments on kilometer-scale dynamic thermal datasets show that LST-SLAM significantly outperforms recent representative SLAM systems.
arXiv Detail & Related papers (2026-02-24T14:04:54Z) - RobustSplat++: Decoupling Densification, Dynamics, and Illumination for In-the-Wild 3DGS [85.90134051583368]
3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling.<n>Existing methods struggle with accurately modeling in-the-wild scenes affected by transient objects and illuminations.<n>We propose RobustSplat++, a robust solution based on several critical designs.
arXiv Detail & Related papers (2025-12-04T14:05:09Z) - VIGS-SLAM: Visual Inertial Gaussian Splatting SLAM [75.55522219717137]
We present VIGS-SLAM, a visual-inertial 3D Gaussian Splatting SLAM system.<n>It achieves robust real-time tracking and high-fidelity reconstruction.<n>Our method tightly couples visual and inertial cues within a unified optimization framework.
arXiv Detail & Related papers (2025-12-02T00:19:13Z) - MCGS-SLAM: A Multi-Camera SLAM Framework Using Gaussian Splatting for High-Fidelity Mapping [52.99503784067417]
We present MCGS-SLAM, the first purely RGB-based multi-camera SLAM system built on 3D Gaussian Splatting (3DGS)<n>A multi-camera bundle adjustment (MCBA) jointly refines poses and depths via dense photometric and geometric residuals, while a scale consistency module enforces metric alignment across views.<n>Experiments on synthetic and real-world datasets show that MCGS-SLAM consistently yields accurate trajectories and photorealistic reconstructions.
arXiv Detail & Related papers (2025-09-17T17:27:53Z) - GI-SLAM: Gaussian-Inertial SLAM [2.186901738997927]
3D Gaussian Splatting (3DGS) has emerged as a powerful representation of geometry and appearance for dense Simultaneous Localization and Mapping (SLAM)<n>We present GI-SLAM, a novel gaussian-inertial SLAM system which consists of an IMU-enhanced camera tracking module and a realistic 3D Gaussian-based representation for mapping.
arXiv Detail & Related papers (2025-03-24T01:45:40Z) - FlashSLAM: Accelerated RGB-D SLAM for Real-Time 3D Scene Reconstruction with Gaussian Splatting [14.130327598928778]
FlashSLAM is a novel SLAM approach that leverages 3D Gaussian Splatting for efficient and robust 3D scene reconstruction.<n>Existing 3DGS-based SLAM methods often fall short in sparse view settings and during large camera movements.<n>Our method achieves up to a 92% improvement in average tracking accuracy over previous methods.
arXiv Detail & Related papers (2024-12-01T05:44:38Z) - MBA-SLAM: Motion Blur Aware Gaussian Splatting SLAM [15.752529196306648]
We propose a dense visual deblur SLAM pipeline (i.e. MBA-SLAM) to handle severe motion-blurred inputs and enhance image deblurring.<n>Our approach integrates an efficient motion blur-aware tracker with either neural fields or Gaussian Splatting based mapper.<n>In experiments, we demonstrate that MBA-SLAM surpasses previous state-of-the-art methods in both camera localization and map reconstruction.
arXiv Detail & Related papers (2024-11-13T01:38:06Z) - GUS-IR: Gaussian Splatting with Unified Shading for Inverse Rendering [83.69136534797686]
We present GUS-IR, a novel framework designed to address the inverse rendering problem for complicated scenes featuring rough and glossy surfaces.
This paper starts by analyzing and comparing two prominent shading techniques popularly used for inverse rendering, forward shading and deferred shading.
We propose a unified shading solution that combines the advantages of both techniques for better decomposition.
arXiv Detail & Related papers (2024-11-12T01:51:05Z) - Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotion [54.197343533492486]
Event3DGS can reconstruct high-fidelity 3D structure and appearance under high-speed egomotion.
Experiments on multiple synthetic and real-world datasets demonstrate the superiority of Event3DGS compared with existing event-based dense 3D scene reconstruction frameworks.
Our framework also allows one to incorporate a few motion-blurred frame-based measurements into the reconstruction process to further improve appearance fidelity without loss of structural accuracy.
arXiv Detail & Related papers (2024-06-05T06:06:03Z) - MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements [59.70107451308687]
We show for the first time that using 3D Gaussians for map representation with unposed camera images and inertial measurements can enable accurate SLAM.
Our method, MM3DGS, addresses the limitations of prior rendering by enabling faster scale awareness, and improved trajectory tracking.
We also release a multi-modal dataset, UT-MM, collected from a mobile robot equipped with a camera and an inertial measurement unit.
arXiv Detail & Related papers (2024-04-01T04:57:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.