Forecasting Continuous Non-Conservative Dynamical Systems in SO(3)

• URL: http://arxiv.org/abs/2508.07775v1
• Date: Mon, 11 Aug 2025 09:03:10 GMT
• Title: Forecasting Continuous Non-Conservative Dynamical Systems in SO(3)
• Authors: Lennart Bastian, Mohammad Rashed, Nassir Navab, Tolga Birdal,
• Abstract summary: We propose a novel approach to modeling the rotation of moving objects in computer vision.<n>Our approach is agnostic to energy and momentum conservation while being robust to input noise.<n>By learning to approximate object dynamics from noisy states during training, our model attains robust extrapolation capabilities in simulation and various real-world settings.
• Score: 51.510040541600176
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Modeling the rotation of moving objects is a fundamental task in computer vision, yet $SO(3)$ extrapolation still presents numerous challenges: (1) unknown quantities such as the moment of inertia complicate dynamics, (2) the presence of external forces and torques can lead to non-conservative kinematics, and (3) estimating evolving state trajectories under sparse, noisy observations requires robustness. We propose modeling trajectories of noisy pose estimates on the manifold of 3D rotations in a physically and geometrically meaningful way by leveraging Neural Controlled Differential Equations guided with $SO(3)$ Savitzky-Golay paths. Existing extrapolation methods often rely on energy conservation or constant velocity assumptions, limiting their applicability in real-world scenarios involving non-conservative forces. In contrast, our approach is agnostic to energy and momentum conservation while being robust to input noise, making it applicable to complex, non-inertial systems. Our approach is easily integrated as a module in existing pipelines and generalizes well to trajectories with unknown physical parameters. By learning to approximate object dynamics from noisy states during training, our model attains robust extrapolation capabilities in simulation and various real-world settings. Code is available at https://github.com/bastianlb/forecasting-rotational-dynamics

Related papers

• i-PhysGaussian: Implicit Physical Simulation for 3D Gaussian Splatting [60.46736489360263]
  i-PhysGaussian is a framework that couples 3D Gaussian Splatting (3DGS) with an implicit Material Point Method (MPM) integrator.<n>Unlike explicit methods, our solution obtains an end-of-step state by minimizing a momentum-balance residual.<n>Results demonstrate that i-PhysGaussian maintains stability at up to 20x larger time steps than explicit baselines.
  arXiv  Detail & Related papers  (2026-02-19T06:38:35Z)
• Sparse-to-Field Reconstruction via Stochastic Neural Dynamic Mode Decomposition [12.812771670043212]
  Many real-world systems, like wind fields and ocean currents, are dynamic and hard to model.<n> Dynamic Mode Decomposition (DMD) provides a simple, data-driven approximation, but practical use is limited by sparse/noisy observations.<n>We introduce NODE-DMD, a probabilistic extension of DMD that models continuous-time, nonlinear dynamics while remaining interpretable.
  arXiv  Detail & Related papers  (2025-11-25T18:39:50Z)
• Continuous-Time SO(3) Forecasting with Savitzky--Golay Neural Controlled Differential Equations [51.510040541600176]
  This work proposes modeling continuous-time rotational object dynamics on $SO(3)$.<n>Unlike existing methods that rely on simplified motion assumptions, our method learns a general latent dynamical system of the underlying object trajectory.<n> Experimental results on real-world data demonstrate compelling forecasting capabilities compared to existing approaches.
  arXiv  Detail & Related papers  (2025-06-07T12:41:50Z)
• Dynamic Manipulation of Deformable Objects in 3D: Simulation, Benchmark and Learning Strategy [88.8665000676562]
  Prior methods often simplify the problem to low-speed or 2D settings, limiting their applicability to real-world 3D tasks.<n>To mitigate data scarcity, we introduce a novel simulation framework and benchmark grounded in reduced-order dynamics.<n>We propose Dynamics Informed Diffusion Policy (DIDP), a framework that integrates imitation pretraining with physics-informed test-time adaptation.
  arXiv  Detail & Related papers  (2025-05-23T03:28:25Z)
• Generative System Dynamics in Recurrent Neural Networks [56.958984970518564]
  We investigate the continuous time dynamics of Recurrent Neural Networks (RNNs)<n>We show that skew-symmetric weight matrices are fundamental to enable stable limit cycles in both linear and nonlinear configurations.<n> Numerical simulations showcase how nonlinear activation functions not only maintain limit cycles, but also enhance the numerical stability of the system integration process.
  arXiv  Detail & Related papers  (2025-04-16T10:39:43Z)
• Tracking control of latent dynamic systems with application to spacecraft attitude control [0.0]
  When intelligent spacecraft or space robots perform tasks in a complex environment, the controllable variables are usually not directly available.<n>While the dynamics of these observations are highly complex, the mechanisms behind them may be simple.<n>For control of latent dynamic systems, methods based on reinforcement learning suffer from sample inefficiency and generalization problems.
  arXiv  Detail & Related papers  (2024-12-09T09:49:15Z)
• 3D Multi-Object Tracking with Semi-Supervised GRU-Kalman Filter [6.13623925528906]
  3D Multi-Object Tracking (MOT) is essential for intelligent systems like autonomous driving and robotic sensing. We propose a GRU-based MOT method, which introduces a learnable Kalman filter into the motion module. This approach is able to learn object motion characteristics through data-driven learning, thereby avoiding the need for manual model design and model error.
  arXiv  Detail & Related papers  (2024-11-13T08:34:07Z)
• Gaussian Splatting Lucas-Kanade [0.11249583407496218]
  We propose a novel analytical approach that adapts the classical Lucas-Kanade method to dynamic Gaussian splatting.<n>By leveraging the intrinsic properties of the forward warp field network, we derive an analytical velocity field that, through time integration, facilitates accurate scene flow computation.<n>Our method excels in reconstructing highly dynamic scenes with minimal camera movement, as demonstrated through experiments on both synthetic and real-world scenes.
  arXiv  Detail & Related papers  (2024-07-16T01:50:43Z)
• Equivariant Graph Neural Operator for Modeling 3D Dynamics [148.98826858078556]
  We propose Equivariant Graph Neural Operator (EGNO) to directly models dynamics as trajectories instead of just next-step prediction. EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods.
  arXiv  Detail & Related papers  (2024-01-19T21:50:32Z)
• Hamiltonian-based Neural ODE Networks on the SE(3) Manifold For Dynamics Learning and Control [15.26733033527393]
  We use machine learning techniques to approximate the robot dynamics over a training set of state-control trajectories. We develop energy shaping and damping injection control for the learned, potentially under-actuated SE(3) Hamiltonian dynamics.
  arXiv  Detail & Related papers  (2021-06-24T06:13:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.