Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation

• URL: http://arxiv.org/abs/2605.28587v1
• Date: Wed, 27 May 2026 15:09:55 GMT
• Title: Deformable Gaussian Occupancy: Decoupling Rigid and Nonrigid Motion with Factorized Distillation
• Abstract summary: DeGO is a deformable Gaussian occupancy framework that unifies decoupled Gaussian deformation with factorized 4D foundation-model distillation.<n> Experiments on the Occ3D-NuScenes benchmark demonstrate that our method achieves state-of-the-art performance under weak supervision.
• Score: 81.44955493339835
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding dynamic 3D environments is essential for safe autonomous driving, particularly when reasoning about human-centric, nonrigid agents. However, existing weakly supervised occupancy prediction frameworks predominantly assume rigid-body motion and rely on simple frame-to-frame offsets, limiting their ability to capture fine-grained deformations and maintain temporal coherence. To address this issue, we propose DeGO, a deformable Gaussian occupancy framework that unifies decoupled Gaussian deformation with factorized 4D foundation-model distillation. DeGO disentangles rigid and nonrigid motion, enabling each Gaussian primitive to evolve through both deformation and offset-based updates. In parallel, a factorized 4D distillation strategy transfers cross-camera and cross-frame knowledge from the VGGT foundation model, producing foundation-aligned features that enhance temporal consistency. Experiments on the Occ3D-NuScenes benchmark demonstrate that our method achieves state-of-the-art performance under weak supervision, delivering 13.5% gains on human-centric instances and 10.9% overall improvements. These results highlight the effectiveness of deformation-aware and foundation-guided occupancy modeling for dynamic scene understanding. The code is publicly available: https://github.com/vita-epfl/DeGO

Related papers

• GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis [94.20462261657525]
  GrainGS is a dynamic framework that combines a hierarchical anchor scaffold with per-Gaussian deformation.<n>It achieves high reconstruction quality, real-time novel view synthesis, and compact storage.
  arXiv  Detail & Related papers  (2026-07-23T15:52:35Z)
• DisPOSE: Projected Polystochastic Diffusion for Self-Supervised Multi-View 3D Human Pose Estimation [58.47973015036709]
  DisPOSE is a self-supervised framework that approximates the inherently discrete multi-view person-assignment problem.<n>By employing differentiable Sinkhorn projections during denoising, our model learns to guide solutions toward valid and feasible assignments.<n>The proposed approach outperforms current state-of-the-art self-supervised methods on standard datasets.
  arXiv  Detail & Related papers  (2026-06-05T16:14:39Z)
• Stabilizing Streaming Video Geometry via Dynamic Feature Normalization [45.91399406203578]
  Dynamic Feature Normalization (DyFN) is a causal recurrent module that modulates feature statistics to maintain stable geometry over time.<n>DyFN achieves state-of-the-art temporal stability, improving over prior streaming methods by up to 14% and even outperforming heavier non-causal video baselines.
  arXiv  Detail & Related papers  (2026-05-25T00:13:15Z)
• Robust 4D Visual Geometry Transformer with Uncertainty-Aware Priors [38.939519059502025]
  We present a framework designed to disentangle dynamic and static components by modeling uncertainty across different stages of the reconstruction process.<n>Our approach reduces Mean Accuracy error by 13.43% and improves segmentation F-measure by 10.49%.<n>Our framework maintains the efficiency of feed-forward inference and requires no task-specific fine-tuning or per-scene optimization.
  arXiv  Detail & Related papers  (2026-04-10T14:36:50Z)
• Robot-DIFT: Distilling Diffusion Features for Geometrically Consistent Visuomotor Control [31.523644271297616]
  A key bottleneck in generalizable robot manipulation is a structural mismatch between current visual backbones and the physical requirements of closed-loop control.<n>We propose Robot-DIFT, a framework that decouples the source of geometric information from the process of inference via Manifold Distillation.<n>By distilling a frozen diffusion teacher into a deterministic Spatial-Semantic Feature Pyramid Network (S2-FPN), we retain the rich geometric priors of the generative model while ensuring temporal stability, real-time execution, and robustness against drift.
  arXiv  Detail & Related papers  (2026-02-12T13:30:24Z)
• From Tokens to Nodes: Semantic-Guided Motion Control for Dynamic 3D Gaussian Splatting [26.57713792657793]
  We propose a motion-adaptive framework that aligns control density with motion complexity.<n>We show significant improvements in reconstruction quality and efficiency over existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-10-03T05:33:58Z)
• Articulated Kinematics Distillation from Video Diffusion Models [64.18346374534352]
  Articulated Kinematics Distillation (AKD) is a framework for generating high-fidelity character animations.<n>AKD uses a skeleton-based representation for rigged 3D assets, drastically reducing the Degrees of Freedom (DoFs)<n>AKD distills complex, articulated motions while maintaining structural integrity.
  arXiv  Detail & Related papers  (2025-04-01T21:37:57Z)
• HandSplat: Embedding-Driven Gaussian Splatting for High-Fidelity Hand Rendering [15.750852107797538]
  Existing 3D Gaussian Splatting methods for hand rendering rely on rigid skeletal motion with an oversimplified non-rigid motion model.<n>HandSplat is a novel framework that enhances both fidelity and stability for hand rendering.
  arXiv  Detail & Related papers  (2025-03-18T21:09:04Z)
• ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictions [91.55655961014027]
  3D semantic occupancy and flow prediction are fundamental to understanding scene scene.<n>This paper proposes a vision-based framework with three targeted improvements.<n>Our purely convolutional architecture establishes new SOTA performance on multiple benchmarks for both semantic occupancy and joint semantic-flow prediction.
  arXiv  Detail & Related papers  (2024-11-12T11:32:56Z)
• SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer [57.506654943449796]
  We propose an efficient, sparse-controlled video-to-4D framework named SC4D that decouples motion and appearance. Our method surpasses existing methods in both quality and efficiency. We devise a novel application that seamlessly transfers motion onto a diverse array of 4D entities.
  arXiv  Detail & Related papers  (2024-04-04T18:05:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.