D-Prism: Differentiable Primitives for Structured Dynamic Modeling

• URL: http://arxiv.org/abs/2604.17082v1
• Date: Sat, 18 Apr 2026 17:39:47 GMT
• Title: D-Prism: Differentiable Primitives for Structured Dynamic Modeling
• Abstract summary: D-Prism is the first framework to achieve high-fidelity structured dynamic modeling by extending differentiable primitives to the dynamic domain.<n>We introduce a deformation network to control primitive motion, ensuring it accurately matches the object's movement.<n>Experiments confirm that our method excels at structured dynamic modeling, providing both structured geometry and precise motion tracking.
• Score: 46.22518390136366
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Capturing both geometry and rigid motion for structured dynamic objects, like multi-part assemblies or jointed mechanisms, remains a key challenge. Existing dynamic methods, such as deformable meshes or 3DGS, rely on unstructured representations and fail to jointly model suitable geometry and articulated motion. Primitive-based methods excel at structured static scenes, but their dynamic potential is still unexplored. We propose D-Prism, the first framework to achieve high-fidelity structured dynamic modeling by extending differentiable primitives to the dynamic domain. Specifically, we bind 3DGS to primitive surfaces, leveraging their respective strengths in appearance and geometry. We introduce a deformation network to control primitive motion, ensuring it accurately matches the object's movement. Furthermore, we design a novel adaptive control strategy to dynamically adjust primitive counts, better matching objects' true spatial footprint. Experiments confirm that our method excels at structured dynamic modeling, providing both structured geometry and precise motion tracking.

Related papers

• 4DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation [38.64669047442234]
  We propose a training-free progressive decoupling framework that disentangles dynamics from statics in a principled, coarse-to-fine manner.<n>Our approach shows competitive performance in robust 4D scene reconstruction without requiring fine-tuning.
  arXiv  Detail & Related papers  (2026-05-12T12:13:36Z)
• JODA: Composable Joint Dynamics for Articulated Objects [17.60725863703415]
  JODA is a framework for generating joint-level dynamics as a structured three-channel field over the joint degree of freedom.<n>It defines a compact and expressive function space that is both interpretable and compatible with differentiable simulation.<n>We show that JODA enables plausible and controllable modeling of diverse joint behaviors, providing a unified interface for inference, editing, and optimization.
  arXiv  Detail & Related papers  (2026-05-11T04:02:15Z)
• DRoPS: Dynamic 3D Reconstruction of Pre-Scanned Objects [39.92394397834325]
  We present DRoPS, a novel approach that leverages a static pre-scan of the dynamic object as an explicit geometric and appearance prior.<n>Our method significantly outperforms the current state of the art in rendering quality and 3D tracking accuracy.
  arXiv  Detail & Related papers  (2026-03-25T19:41:50Z)
• Interaction-Aware 4D Gaussian Splatting for Dynamic Hand-Object Interaction Reconstruction [19.178735596766476]
  This paper focuses on a challenging setting of simultaneously modeling geometry and appearance of hand-object interaction scenes without any object priors.<n>We present interaction-aware hand-object Gaussians with newly introduced optimizable parameters aiming to adopt piecewise linear hypothesis for clearer structural representation.<n> Experiments show that our approach surpasses existing dynamic 3D-GS-based methods and achieves state-of-the-art performance in reconstructing dynamic hand-object interaction.
  arXiv  Detail & Related papers  (2025-11-18T14:44:04Z)
• 4D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos [52.89084603734664]
  We present 4D3R, a pose-free dynamic neural rendering framework that decouples static and dynamic components through a two-stage approach.<n>Our approach achieves up to 1.8dB PSNR improvement over state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-11-07T13:25:50Z)
• HEIR: Learning Graph-Based Motion Hierarchies [30.232977288956814]
  We propose a general hierarchical motion modeling method that learns structured, interpretable motion relationships directly from data.<n>Our method represents observed motions using graph-based hierarchies, explicitly decomposing global absolute motions into parent-inherited patterns and local motion residuals.<n> Experimental results show that our method reconstructs the intrinsic motion hierarchy in 1D and 2D cases, and produces more realistic and interpretable deformations compared to the baseline on dynamic 3D splatting scenes.
  arXiv  Detail & Related papers  (2025-10-30T17:57:40Z)
• Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy [88.8665000676562]
  Prior methods often simplify the problem to low-speed or 2D settings, limiting their applicability to real-world 3D tasks.<n>To mitigate data scarcity, we introduce a novel simulation framework and benchmark grounded in reduced-order dynamics.<n>We propose Dynamics Informed Diffusion Policy (DIDP), a framework that integrates imitation pretraining with physics-informed test-time adaptation.
  arXiv  Detail & Related papers  (2025-05-23T03:28:25Z)
• TFS-NeRF: Template-Free NeRF for Semantic 3D Reconstruction of Dynamic Scene [25.164085646259856]
  This paper introduces a template-free 3D semantic NeRF for dynamic scenes captured from sparse or singleview RGB videos.<n>By disentangling the motions of interacting entities and optimizing per-entity skinning weights, our method efficiently generates accurate, semantically separable geometries.
  arXiv  Detail & Related papers  (2024-09-26T01:34:42Z)
• Dynamic Scene Understanding through Object-Centric Voxelization and Neural Rendering [57.895846642868904]
  We present a 3D generative model named DynaVol-S for dynamic scenes that enables object-centric learning.<n>voxelization infers per-object occupancy probabilities at individual spatial locations.<n>Our approach integrates 2D semantic features to create 3D semantic grids, representing the scene through multiple disentangled voxel grids.
  arXiv  Detail & Related papers  (2024-07-30T15:33:58Z)
• ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation [135.10594078615952]
  We introduce ACID, an action-conditional visual dynamics model for volumetric deformable objects. A benchmark contains over 17,000 action trajectories with six types of plush toys and 78 variants. Our model achieves the best performance in geometry, correspondence, and dynamics predictions.
  arXiv  Detail & Related papers  (2022-03-14T04:56:55Z)
• Euclideanizing Flows: Diffeomorphic Reduction for Learning Stable Dynamical Systems [74.80320120264459]
  We present an approach to learn such motions from a limited number of human demonstrations. The complex motions are encoded as rollouts of a stable dynamical system. The efficacy of this approach is demonstrated through validation on an established benchmark as well demonstrations collected on a real-world robotic system.
  arXiv  Detail & Related papers  (2020-05-27T03:51:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.