Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2603.06061v1
• Date: Fri, 06 Mar 2026 09:12:51 GMT
• Title: Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting
• Abstract summary: The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving.<n> deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs.<n>However, a significant portion of these sensor data is directly discarded or strictly underutilized.
• Score: 1.7023041773480836
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The demand for large-scale digital twins is rapidly growing in robotics and autonomous driving. However, constructing these environments with 3D Gaussian Splatting (3DGS) usually requires expensive, purpose-built data collection. Meanwhile, deployed platforms routinely collect extensive omnidirectional RGB and LiDAR logs, but a significant portion of these sensor data is directly discarded or strictly underutilized due to transmission constraints and the lack of scalable reuse pipeline. In this paper, we present an omnidirectional RGB-LiDAR reuse pipeline that transforms these archived logs into robust initialization assets for 3DGS. Direct conversion of such raw logs introduces practical bottlenecks: inherent non-linear distortion leads to unreliable Structure-from-Motion (SfM) tracking, and dense, unorganized LiDAR clouds cause computational overhead during 3DGS optimization. To overcome these challenges, our pipeline strategically integrates an ERP-to-cubemap conversion module for deterministic spatial anchoring, alongside PRISM-a color stratified downsampling strategy. By bridging these multi-modal inputs via Fast Point Feature Histograms (FPFH) based global registration and Iterative Closest Point (ICP), our pipeline successfully repurposes a considerable fraction of discarded data into usable SfM geometry. Furthermore, our LiDAR-reinforced initialization consistently enhances the final 3DGS rendering fidelity in structurally complex scenes compared to vision-only baselines. Ultimately, this work provides a deterministic workflow for creating simulation-grade digital twins from standard archived sensor logs.

Related papers

• GSBF: Gaussian Splatting for Environment-Aware Beamforming [38.39752476018955]
  We develop a 3D Gaussian splatting for environment-aware beamforming (GSBF) pipeline based on multi-fold data.<n>GSBF consistently outperforms baselines such as exhaustive beam alignment (EBA) with lower latency.
  arXiv  Detail & Related papers  (2026-08-06T11:22:34Z)
• Seeing What Matters: Perceptual Wrapper with Common Randomness for 3D Gaussian Splatting [8.053023331297602]
  3D Gaussian Splatting (3DGS) achieves real-time rendering but struggles to synthesize high-frequency textures.<n>We propose a versatile 2D perceptual wrapper that enhances the rendered outputs of existing 3DGS representations in a content- and view-dependent manner.
  arXiv  Detail & Related papers  (2026-06-10T08:14:47Z)
• NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation [65.34304674634713]
  We introduce NG-GS, a framework for high-quality object segmentation in 3DGS that explicitly addresses boundary discretization.<n>We show that our method achieves photorealistic state-of-the-art performance, with significant gains in boundary mIoU.
  arXiv  Detail & Related papers  (2026-04-16T07:14:07Z)
• RegFormer++: An Efficient Large-Scale 3D LiDAR Point Registration Network with Projection-Aware 2D Transformer [71.59462491691819]
  We propose a novel end-to-end differential transformer network, termed RegFormer++, for large-scale point cloud alignment.<n>Because we fill original 3D coordinates into 2D projected positions, our designed transformer can benefit from both high efficiency in 2D processing and accuracy from 3D geometric information.<n>Experiments on KITTI, NuScenes, and Argoverse datasets demonstrate that our model achieves state-of-the-art performance in terms of both accuracy and efficiency.
  arXiv  Detail & Related papers  (2026-03-15T09:03:10Z)
• Tail-Aware Post-Training Quantization for 3D Geometry Models [58.79500829118265]
  Post-Training Quantization (PTQ) enables efficient inference without retraining.<n>PTQ fails to transfer effectively to 3D models due to intricate feature distributions and prohibitive calibration overhead.<n>We propose TAPTQ, a Tail-Aware Post-Training Quantization pipeline for 3D geometric learning.
  arXiv  Detail & Related papers  (2026-02-02T07:21:15Z)
• Quantized Visual Geometry Grounded Transformer [67.15451442018258]
  This paper proposes the first Quantization framework for VGGTs, namely QuantVGGT.<n>We introduce Dual-Smoothed Fine-Grained Quantization, which integrates pre-global Hadamard rotation and post-local channel smoothing.<n>We also design Noise-Filtered Diverse Sampling, which filters outliers via deep-layer statistics.
  arXiv  Detail & Related papers  (2025-09-25T15:17:11Z)
• Pseudo Depth Meets Gaussian: A Feed-forward RGB SLAM Baseline [64.42938561167402]
  We propose an online 3D reconstruction method using 3D Gaussian-based SLAM, combined with a feed-forward recurrent prediction module.<n>This approach replaces slow test-time optimization with fast network inference, significantly improving tracking speed.<n>Our method achieves performance on par with the state-of-the-art SplaTAM, while reducing tracking time by more than 90%.
  arXiv  Detail & Related papers  (2025-08-06T16:16:58Z)
• GSFusion:Globally Optimized LiDAR-Inertial-Visual Mapping for Gaussian Splatting [20.665306154754564]
  We propose GSFusion, an online LiDAR-Inertial-Visual mapping system that ensures high-precision map consistency through a surfel-to-surfel constraint in the global pose-graph optimization.<n> Experiments on public and our datasets demonstrate our system outperforms existing 3DGS SLAM systems in terms of rendering quality and map-building efficiency.
  arXiv  Detail & Related papers  (2025-07-31T06:15:51Z)
• 3DGS_LSR:Large_Scale Relocation for Autonomous Driving Based on 3D Gaussian Splatting [3.2768514034762863]
  3DGS-LSR: a large-scale relocalization framework leveraging 3DGS, enabling centimeter-level positioning using only a single monocular RGB image on the client side.<n>We combine multi-sensor data to construct high-accuracy 3DGS maps in large outdoor scenes, while the robot-side localization requires just a standard camera input.<n>Our core innovation is an iterative optimization strategy that refines localization results through step-by-step rendering, making it suitable for real-time autonomous navigation.
  arXiv  Detail & Related papers  (2025-07-08T04:43:46Z)
• From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splatting [5.026688852582894]
  AutoOpti3DGS is a training-time framework that automatically restrains Gaussian proliferation without sacrificing visual fidelity.<n>Wavelet-driven, coarse-to-fine process delays the formation of redundant fine Gaussians.
  arXiv  Detail & Related papers  (2025-06-29T00:27:17Z)
• RGE-GS: Reward-Guided Expansive Driving Scene Reconstruction via Diffusion Priors [54.81109375939306]
  RGE-GS is a novel expansive reconstruction framework that synergizes diffusion-based generation with reward-guided Gaussian integration.<n>We propose a reward network that learns to identify and prioritize consistently generated patterns prior to reconstruction phases.<n>During the reconstruction process, we devise a differentiated training strategy that automatically adjust Gaussian optimization progress according to scene converge metrics.
  arXiv  Detail & Related papers  (2025-06-28T08:02:54Z)
• FALO: Fast and Accurate LiDAR 3D Object Detection on Resource-Constrained Devices [38.61635285386612]
  Existing LiDAR 3D object detection methods rely on sparse convolutions and/or transformers, which can be challenging to run on resource-constrained edge devices.<n>We propose FALO, a hardware-friendly approach to LiDAR 3D detection, which offers both state-of-the-art (SOTA) detection accuracy and fast inference speed.
  arXiv  Detail & Related papers  (2025-06-04T22:46:28Z)
• It's All Around You: Range-Guided Cylindrical Network for 3D Object Detection [4.518012967046983]
  This work presents a novel approach for analyzing 3D data produced by 360-degree depth scanners. We introduce a novel notion of range-guided convolutions, adapting the receptive field by distance from the ego vehicle and the object's scale. Our network demonstrates powerful results on the nuScenes challenge, comparable to current state-of-the-art architectures.
  arXiv  Detail & Related papers  (2020-12-05T21:02:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.