PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstruction
- URL: http://arxiv.org/abs/2601.22046v2
- Date: Fri, 30 Jan 2026 08:26:59 GMT
- Title: PLANING: A Loosely Coupled Triangle-Gaussian Framework for Streaming 3D Reconstruction
- Abstract summary: We present PLANING, an efficient on-the-fly reconstruction framework built on a hybrid representation.<n>PLANING improves dense mesh Chamfer-L2 by 18.52% over PGSR, surpasses ARTDECO by 1.31 dB PSNR, and reconstructs ScanNetV2 scenes in under 100 seconds.<n>PLANING makes it well suited for a broad range of downstream applications, such as enabling large-scale scene modeling and simulation-ready environments for embodied AI.
- Score: 24.582810014546524
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Streaming reconstruction from monocular image sequences remains challenging, as existing methods typically favor either high-quality rendering or accurate geometry, but rarely both. We present PLANING, an efficient on-the-fly reconstruction framework built on a hybrid representation that loosely couples explicit geometric primitives with neural Gaussians, enabling geometry and appearance to be modeled in a decoupled manner. This decoupling supports an online initialization and optimization strategy that separates geometry and appearance updates, yielding stable streaming reconstruction with substantially reduced structural redundancy. PLANING improves dense mesh Chamfer-L2 by 18.52% over PGSR, surpasses ARTDECO by 1.31 dB PSNR, and reconstructs ScanNetV2 scenes in under 100 seconds, over 5x faster than 2D Gaussian Splatting, while matching the quality of offline per-scene optimization. Beyond reconstruction quality, the structural clarity and computational efficiency of PLANING make it well suited for a broad range of downstream applications, such as enabling large-scale scene modeling and simulation-ready environments for embodied AI. Project page: https://city-super.github.io/PLANING/ .
Related papers
- Stable and Scalable Bundle Adjustment of Holistic 3D Structures [99.03818732955783]
We present a new version of Bundle Adjustment (BA) for 3D computer vision.<n>BA is developed to jointly optimize cameras, poses and 3D points.<n>By group-induced measurements and cross-feature reprojection, we preserve the sparsity of classical point-only 3D regularization.
arXiv Detail & Related papers (2026-09-03T16:08:03Z) - GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction [69.35136600319714]
We introduce a new approach to high-fidelity 3D scene reconstruction from multi-view RGB images.<n>We cast scene reconstruction as conditional 3D generation over a set of spatially-localized, overlapping chunks.<n>We obtain high-fidelity results that outperform cutting-edge reconstruction methods by 16%.
arXiv Detail & Related papers (2026-05-22T17:49:59Z) - Geometric Context Transformer for Streaming 3D Reconstruction [51.19524805829903]
LingBot-Map is a feed-forward 3D foundation model for reconstructing scenes from streaming data.<n>A defining aspect of LingBot-Map lies in its carefully designed attention mechanism, which integrates an anchor context, a pose-reference window, and a trajectory memory.<n>This design keeps the streaming state compact while retaining rich geometric context, enabling stable efficient inference at around 20 FPS on 518 x 378 resolution inputs.
arXiv Detail & Related papers (2026-04-15T17:58:13Z) - LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows [10.300202521638274]
We introduce the Large Sparse Reconstruction Model to study how scaling transformer context windows impacts feed-forward 3D reconstruction.<n>We show that expanding the context window -- by substantially increasing the number of active object and image tokens -- remarkably narrows this gap and enables high-fidelity 3D object reconstruction and inverse rendering.
arXiv Detail & Related papers (2026-04-06T21:21:12Z) - LG-HCC: Local Geometry-Aware Hierarchical Context Compression for 3D Gaussian Splatting [77.81227097905865]
Anchor-based 3DGS compression schemes reduce gaussian redundancy through some advanced context models.<n>We propose a Local Geometry-aware Hierarchical Context Compression framework for 3DGS that incorporates inter-anchor geometric correlations into anchor pruning and entropy coding for compact representation.<n>Experiments show that LG-HCC effectively alleviates structural preservation issues,achieving superior geometric integrity and rendering fidelity while reducing storage by up to 30.85x compared to the Scaffold-GS baseline on the Mip-NeRF360 dataset.
arXiv Detail & Related papers (2026-03-30T13:39:35Z) - SwiftNDC: Fast Neural Depth Correction for High-Fidelity 3D Reconstruction [36.282461368600806]
SwiftNDC is a fast and general framework built around a Neural Depth Correction field.<n>We generate a dense point cloud through back-projection and robust reprojection-error filtering.<n>This reliable dense geometry substantially accelerates 3D Gaussian Splatting (3DGS) for mesh reconstruction.<n>We conduct a comprehensive study across five datasets, including two for mesh reconstruction, as well as three for novel-view synthesis.
arXiv Detail & Related papers (2026-02-26T03:07:53Z) - MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenes [20.601722393809244]
We introduce MetroGS, a novel framework for efficient and robust reconstruction in complex urban environments.<n>Our method is built upon a distributed 2D Gaussian Splatting representation as the core foundation.<n>Experiments on large-scale urban datasets demonstrate that MetroGS achieves superior geometric accuracy, rendering quality.
arXiv Detail & Related papers (2025-11-24T14:34:19Z) - Wonder3D++: Cross-domain Diffusion for High-fidelity 3D Generation from a Single Image [68.55613894952177]
We introduce textbfWonder3D++, a novel method for efficiently generating high-fidelity textured meshes from single-view images.<n>We propose a cross-domain diffusion model that generates multi-view normal maps and the corresponding color images.<n> Lastly, we introduce a cascaded 3D mesh extraction algorithm that drives high-quality surfaces from the multi-view 2D representations in only about $3$ minute in a coarse-to-fine manner.
arXiv Detail & Related papers (2025-11-03T17:24:18Z) - Light-SQ: Structure-aware Shape Abstraction with Superquadrics for Generated Meshes [60.92139345612904]
We present Light-SQ, a novel superquadric-based optimization framework.<n>We propose a block-regrow-fill strategy guided by structure-aware volumetric decomposition.<n>Experiments demonstrate that Light-SQ enables efficient, high-fidelity, and editable shape abstraction with superquadrics.
arXiv Detail & Related papers (2025-09-29T16:18:32Z) - StreamGS: Online Generalizable Gaussian Splatting Reconstruction for Unposed Image Streams [32.91936079359693]
We propose StreamGS, an online generalizable 3DGS reconstruction method for unposed image streams.<n>StreamGS transforms image streams to 3D Gaussian streams by predicting and aggregating per-frame Gaussians.<n>Experiments on diverse datasets have demonstrated that StreamGS achieves quality on par with optimization-based approaches but does so 150 times faster.
arXiv Detail & Related papers (2025-03-08T14:35:39Z) - Evolving High-Quality Rendering and Reconstruction in a Unified Framework with Contribution-Adaptive Regularization [27.509109317973817]
3D Gaussian Splatting (3DGS) has garnered significant attention for its high-quality rendering and fast inference speed.<n>Previous methods primarily focus on geometry regularization, with common approaches including primitive-based and dual-model frameworks.<n>We propose CarGS, a unified model leveraging-adaptive regularization to achieve simultaneous, high-quality surface reconstruction.
arXiv Detail & Related papers (2025-03-02T12:51:38Z) - MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo [54.00987996368157]
We present MVSGaussian, a new generalizable 3D Gaussian representation approach derived from Multi-View Stereo (MVS)
MVSGaussian achieves real-time rendering with better synthesis quality for each scene.
arXiv Detail & Related papers (2024-05-20T17:59:30Z) - InstantSplat: Sparse-view Gaussian Splatting in Seconds [91.77050739918037]
We introduce InstantSplat, a novel approach for addressing sparse-view 3D scene reconstruction at lightning-fast speed.<n>InstantSplat employs a self-supervised framework that optimize 3D scene representation and camera poses.<n>It achieves an acceleration of over 30x in reconstruction and improves visual quality (SSIM) from 0.3755 to 0.7624 compared to traditional SfM with 3D-GS.
arXiv Detail & Related papers (2024-03-29T17:29:58Z) - VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction [59.40711222096875]
We present VastGaussian, the first method for high-quality reconstruction and real-time rendering on large scenes based on 3D Gaussian Splatting.
Our approach outperforms existing NeRF-based methods and achieves state-of-the-art results on multiple large scene datasets.
arXiv Detail & Related papers (2024-02-27T11:40:50Z) - RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks [93.18404922542702]
We present a novel video generative model designed to address long-term spatial and temporal dependencies.
Our approach incorporates a hybrid explicit-implicit tri-plane representation inspired by 3D-aware generative frameworks.
Our model synthesizes high-fidelity video clips at a resolution of $256times256$ pixels, with durations extending to more than $5$ seconds at a frame rate of 30 fps.
arXiv Detail & Related papers (2024-01-11T16:48:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.