TIBR4D: Tracing-Guided Iterative Boundary Refinement for Efficient 4D Gaussian Segmentation

• URL: http://arxiv.org/abs/2602.08540v1
• Date: Mon, 09 Feb 2026 11:41:06 GMT
• Title: TIBR4D: Tracing-Guided Iterative Boundary Refinement for Efficient 4D Gaussian Segmentation
• Abstract summary: We present an efficient learning-free 4D Gaussian segmentation framework that lifts video segmentation masks to 4D spaces.<n>The first stage is an Iterative Gaussian Instance Tracing (IGIT) at the temporal segment level.<n>The second stage is a frame-wise Gaussian Rendering Range Control (RCC) via suppressing highly uncertain Gaussians near object boundaries.<n>Experiments on HyperNeRF and Neu3D demonstrate that our method produces accurate object Gaussian point clouds with clearer boundaries.
• Score: 6.650237349474389
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object-level segmentation in dynamic 4D Gaussian scenes remains challenging due to complex motion, occlusions, and ambiguous boundaries. In this paper, we present an efficient learning-free 4D Gaussian segmentation framework that lifts video segmentation masks to 4D spaces, whose core is a two-stage iterative boundary refinement, TIBR4D. The first stage is an Iterative Gaussian Instance Tracing (IGIT) at the temporal segment level. It progressively refines Gaussian-to-instance probabilities through iterative tracing, and extracts corresponding Gaussian point clouds that better handle occlusions and preserve completeness of object structures compared to existing one-shot threshold-based methods. The second stage is a frame-wise Gaussian Rendering Range Control (RCC) via suppressing highly uncertain Gaussians near object boundaries while retaining their core contributions for more accurate boundaries. Furthermore, a temporal segmentation merging strategy is proposed for IGIT to balance identity consistency and dynamic awareness. Longer segments enforce stronger multi-frame constraints for stable identities, while shorter segments allow identity changes to be captured promptly. Experiments on HyperNeRF and Neu3D demonstrate that our method produces accurate object Gaussian point clouds with clearer boundaries and higher efficiency compared to SOTA methods.

Related papers

• PointGS: Semantic-Consistent Unsupervised 3D Point Cloud Segmentation with 3D Gaussian Splatting [15.208505879476418]
  Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving.<n>This paper proposes PointGS, a simple yet effective pipeline for unsupervised 3D point cloud segmentation.<n> Experiments demonstrate that PointGS outperforms state-of-the-art unsupervised methods.
  arXiv  Detail & Related papers  (2026-05-12T04:44:50Z)
• BEA-GS: BEyond RAdiance Supervision in 3DGS for Precise Object Extraction [16.14609317188182]
  We propose a novel solution that provides near perfect in object extraction.<n>We do so by introducing two new losses in the optimization that take care of: 1) a loss that modifies the geometry of visible Gaussians to respect semantic boundaries, and 2) a loss that adjusts geometry of non-visible Gaussians that appear once the object is extracted.
  arXiv  Detail & Related papers  (2026-05-10T17:22:33Z)
• NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation [65.34304674634713]
  We introduce NG-GS, a framework for high-quality object segmentation in 3DGS that explicitly addresses boundary discretization.<n>We show that our method achieves photorealistic state-of-the-art performance, with significant gains in boundary mIoU.
  arXiv  Detail & Related papers  (2026-04-16T07:14:07Z)
• GATS: Gaussian Aware Temporal Scaling Transformer for Invariant 4D Spatio-Temporal Point Cloud Representation [4.686110187936828]
  We propose a novel dual invariant framework, termed textbfGaussian Aware Temporal Scaling (GATS), which explicitly resolves both distributional inconsistencies and temporal.<n>Our experiments on mainstream benchmarks MSR-Action3D (textbf+6.62% accuracy), NTU RGBD (textbf+1.4% accuracy), and Synthia4D (textbf+1.8% mIoU) demonstrate significant performance gains.
  arXiv  Detail & Related papers  (2026-03-17T06:18:27Z)
• UniC-Lift: Unified 3D Instance Segmentation via Contrastive Learning [6.502142457981839]
  3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have advanced novel-view synthesis.<n>Recent methods extend multi-view 2D segmentation to 3D, enabling instance/semantic segmentation for better scene understanding.<n>Key challenge is the inconsistency of 2D instance labels across views, leading to poor 3D predictions.<n>We propose a unified framework that merges these steps, reducing training time and improving performance by introducing a learnable feature embedding for segmentation in Gaussian primitives.
  arXiv  Detail & Related papers  (2025-12-31T10:20:01Z)
• Contour Information Aware 2D Gaussian Splatting for Image Representation [0.0]
  We propose a Contour Information-Aware 2D Gaussian Splatting framework.<n>Our method achieves higher reconstruction quality around object edges compared to existing 2DGS methods.
  arXiv  Detail & Related papers  (2025-12-29T07:24:36Z)
• Binary-Gaussian: Compact and Progressive Representation for 3D Gaussian Segmentation [83.90109373769614]
  3D Gaussian Splatting (3D-GS) has emerged as an efficient 3D representation and a promising foundation for semantic tasks like segmentation.<n>We propose a coarse-to-fine binary encoding scheme for per-Gaussian category representation, which compresses each feature into a single integer via the binary-to-decimal mapping.<n>We further design a progressive training strategy that decomposes panoptic segmentation into a series of independent sub-tasks, reducing inter-class conflicts and thereby enhancing fine-grained segmentation capability.
  arXiv  Detail & Related papers  (2025-11-30T15:51:30Z)
• Optimized Minimal 4D Gaussian Splatting [50.29519144753797]
  4D Gaussian Splatting has emerged as a new paradigm for dynamic scene representation, enabling real-time rendering of scenes with complex motions.<n>It faces a major challenge of storage overhead, as millions of Gaussians are required for high-fidelity reconstruction.<n>We present OMG4, a framework that constructs a compact set of salient Gaussians capable of faithfully representing 4D Gaussian models.
  arXiv  Detail & Related papers  (2025-10-04T16:11:13Z)
• Trace3D: Consistent Segmentation Lifting via Gaussian Instance Tracing [27.24794829116753]
  We address the challenge of lifting 2D visual segmentation to 3D in Gaussian Splatting.<n>Existing methods often suffer from inconsistent 2D masks across viewpoints and produce noisy segmentation boundaries.<n>We introduce Gaussian Instance Tracing (GIT), which augments the standard Gaussian representation with an instance weight matrix across input views.
  arXiv  Detail & Related papers  (2025-08-05T08:54:17Z)
• COB-GS: Clear Object Boundaries in 3DGS Segmentation Based on Boundary-Adaptive Gaussian Splitting [67.03992455145325]
  3D segmentation based on 3D Gaussian Splatting (3DGS) struggles with accurately delineating object boundaries.<n>We introduce Clear Object Boundaries for 3DGS (COB-GS), which aims to improve segmentation accuracy.<n>For semantic guidance, we introduce a boundary-adaptive Gaussian splitting technique.<n>For the visual optimization, we rectify the degraded texture of the 3DGS scene.
  arXiv  Detail & Related papers  (2025-03-25T08:31:43Z)
• GradiSeg: Gradient-Guided Gaussian Segmentation with Enhanced 3D Boundary Precision [11.99904956714193]
  We propose a novel 3DGS-based framework named GradiSeg, incorporating Identity sification to construct a deeper semantic understanding of scenes.<n>Our approach introduces two key modules: Identity Gradient Guided Densification (IGD) and Local Adaptive K-Nearest Neighbors (LA-KNN)<n>Results show that GradiS effectively addresses boundary-related issues, significantly improving segmentation accuracy without compromising scene reconstruction quality.
  arXiv  Detail & Related papers  (2024-11-30T08:07:37Z)
• DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenes [71.61083731844282]
  We present DeSiRe-GS, a self-supervised gaussian splatting representation.<n>It enables effective static-dynamic decomposition and high-fidelity surface reconstruction in complex driving scenarios.
  arXiv  Detail & Related papers  (2024-11-18T05:49:16Z)
• MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenes [49.36091070642661]
  This paper introduces a memory-efficient framework for 4DGS.<n>It achieves a storage reduction by approximately 190$times$ and 125$times$ on the Technicolor and Neural 3D Video datasets.<n>It maintains comparable rendering speeds and scene representation quality, setting a new standard in the field.
  arXiv  Detail & Related papers  (2024-10-17T14:47:08Z)
• SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decomposition [66.56357905500512]
  3D Gaussian Splatting has emerged as an alternative 3D representation for novel view synthesis.<n>We propose SAGD, a conceptually simple yet effective boundary-enhanced segmentation pipeline for 3D-GS.<n>Our approach achieves high-quality 3D segmentation without rough boundary issues, which can be easily applied to other scene editing tasks.
  arXiv  Detail & Related papers  (2024-01-31T14:19:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.