Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting
- URL: http://arxiv.org/abs/2608.03116v1
- Date: Tue, 04 Aug 2026 04:38:34 GMT
- Title: Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting
- Abstract summary: We present a contact-implicit, direct simulation-based multiple shooting (DSMS) framework that transforms kinematically feasible references into dynamically feasible whole-body trajectories.<n>We demonstrate a zero-shot sim-to-real transfer on the Unitree G1 through command-conditioned contact-rich crawling and a highly dynamic 180-degree jump-turn.
- Score: 21.55901773307122
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Motion retargeting approaches often prioritize kinematic similarity over whole-body dynamics, contact consistency, and actuation limits, yielding references that are difficult for reinforcement learning (RL) policies to reproduce, particularly for contact-rich behaviors. We present a contact-implicit, direct simulation-based multiple shooting (DSMS) framework that transforms kinematically feasible references into dynamically feasible whole-body trajectories. By embedding a differentiable simulator within a nonlinear program, DSMS resolves contact, friction, impacts, self-collision, and joint limits internally while enforcing tracking, actuation, and task constraints without prescribing a contact schedule or introducing explicit contact constraints. Compared with existing retargeting methods, DSMS accelerates motion-imitation RL training and yields policies with high success rates and low tracking error. We further demonstrate zero-shot sim-to-real transfer on the Unitree G1 through command-conditioned contact-rich crawling and a highly dynamic 180-degree jump-turn.
Related papers
- ConCent: Contact-Centric Real-to-Sim-to-Real Learning from One Demonstration [17.067367964368486]
Sim-to-real policy transfer is a promising paradigm for scaling robot manipulation without large-scale real-world data.<n>We propose a contact-centric real-to-sim-to-real RL framework that uses task-relevant contact event sequences extracted from real demonstrations.<n>Experiments on contact-rich manipulation tasks demonstrate more stable and robust sim-to-real policy transfer compared to unconstrained RL baselines.
arXiv Detail & Related papers (2026-06-29T13:16:33Z) - CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarios [10.290787487255301]
CoCo-InEKF is a differentiable invariant extended Kalman filter that utilizes continuous contact velocity covariances instead of binary contact states.<n>We employ a lightweight neural network trained end-to-end using a state-error loss to predict contact candidate points.<n> Experiments on a bipedal robot demonstrate a superior accuracy-efficiency tradeoff for linear velocity estimation.
arXiv Detail & Related papers (2026-05-14T17:35:06Z) - ForceFlow: Learning to Feel and Act via Contact-Driven Flow Matching [53.30290192030814]
ForceFlow is a force-aware reactive framework built upon flow matching.<n>We show that ForceFlow achieves a 37% success rate improvement over the strong baseline ForceVLA.<n>It also exhibits accurate force signal prediction and superior performance in contact force self-regulation.
arXiv Detail & Related papers (2026-05-11T13:27:00Z) - Beyond Self-Play: Hierarchical Reasoning for Continuous Motion in Closed-Loop Traffic Simulation [8.157621070273736]
We propose a hierarchical architecture that goes beyond self-play by combining high-level multi-agent interaction reasoning with low-level continuous trajectory realization.<n>Experiments on a SUMO-based urban network demonstrate that the proposed framework achieves smoothness superior control and safety compared to self-play and passive imitation baselines.
arXiv Detail & Related papers (2026-05-09T20:31:34Z) - Learning Reactive Dexterous Grasping via Hierarchical Task-Space RL Planning and Joint-Space QP Control [50.28263951510334]
We propose a hybrid hierarchical control framework for reactive dexterous grasping.<n>The proposed framework explicitly decouples high-level spatial intent from low-level joint execution.<n>We extensively validate the proposed framework through a rigorous simulation-to-reality pipeline.
arXiv Detail & Related papers (2026-05-05T04:49:38Z) - Kinodynamic Motion Retargeting for Humanoid Locomotion via Multi-Contact Whole-Body Trajectory Optimization [6.47799404542057]
We present the KinoDynamic Motion Retargeting (KDMR) framework, a novel approach for humanoid locomotion.<n>Our method automatically detects heel-toe contact events to accurately replicate human-like contact patterns.<n> Experimental results demonstrate that KDMR significantly outperforms purely kinematic methods.
arXiv Detail & Related papers (2026-03-10T17:51:17Z) - ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
arXiv Detail & Related papers (2026-03-03T18:59:29Z) - Where to Touch, How to Contact: Hierarchical RL-MPC Framework for Geometry-Aware Long-Horizon Dexterous Manipulation [15.309183490293721]
A key challenge in contact-rich dexterous manipulation is the need to jointly reason over geometry, kinematic constraints, and intricate, nonsmooth contact dynamics.<n>We propose a hierarchical RL--MPC framework in which a high-level reinforcement learning (RL) policy predicts a contact intention.<n>We evaluate the framework on non-prehensile tasks, including geometry-generalized pushing and object 3D reorientation.
arXiv Detail & Related papers (2026-01-16T01:20:15Z) - Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation [58.95799126311524]
Humans can accomplish contact-rich tasks using vision and touch, with highly reactive capabilities such as fast response to external changes and adaptive control of contact forces.<n>Existing visual imitation learning approaches rely on action chunking to model complex behaviors.<n>We introduce TactAR, a low-cost teleoperation system that provides real-time tactile feedback through Augmented Reality.
arXiv Detail & Related papers (2025-03-04T18:58:21Z) - Contact-Aware Retargeting of Skinned Motion [49.71236739408685]
This paper introduces a motion estimation method that preserves self-contacts and prevents interpenetration.
The method identifies self-contacts and ground contacts in the input motion, and optimize the motion to apply to the output skeleton.
In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works.
arXiv Detail & Related papers (2021-09-15T17:05:02Z) - ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for
Mobile Manipulation [99.2543521972137]
ReLMoGen is a framework that combines a learned policy to predict subgoals and a motion generator to plan and execute the motion needed to reach these subgoals.
Our method is benchmarked on a diverse set of seven robotics tasks in photo-realistic simulation environments.
ReLMoGen shows outstanding transferability between different motion generators at test time, indicating a great potential to transfer to real robots.
arXiv Detail & Related papers (2020-08-18T08:05:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.