Hard Contacts with Soft Gradients: Refining Differentiable Simulators for Learning and Control

• URL: http://arxiv.org/abs/2506.14186v1
• Date: Tue, 17 Jun 2025 04:58:08 GMT
• Title: Hard Contacts with Soft Gradients: Refining Differentiable Simulators for Learning and Control
• Abstract summary: Contact forces pose a major challenge for gradient-based optimization of robot dynamics.<n>We analyze the contact computation of penalty-based simulators to identify the causes of gradient errors.<n>We propose DiffMJX, which combines adaptive integration with MuJoCo XLA, to notably improve gradient quality in the presence of hard contacts.
• Score: 23.097754383355156
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Contact forces pose a major challenge for gradient-based optimization of robot dynamics as they introduce jumps in the system's velocities. Penalty-based simulators, such as MuJoCo, simplify gradient computation by softening the contact forces. However, realistically simulating hard contacts requires very stiff contact settings, which leads to incorrect gradients when using automatic differentiation. On the other hand, using non-stiff settings strongly increases the sim-to-real gap. We analyze the contact computation of penalty-based simulators to identify the causes of gradient errors. Then, we propose DiffMJX, which combines adaptive integration with MuJoCo XLA, to notably improve gradient quality in the presence of hard contacts. Finally, we address a key limitation of contact gradients: they vanish when objects do not touch. To overcome this, we introduce Contacts From Distance (CFD), a mechanism that enables the simulator to generate informative contact gradients even before objects are in contact. To preserve physical realism, we apply CFD only in the backward pass using a straight-through trick, allowing us to compute useful gradients without modifying the forward simulation.

Related papers

• Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation [51.463992799813816]
  A primary bottleneck in contact-rich manipulation is the difficulty of collecting real-world data.<n>We introduce Center-of-Pressure, an effective tactile representation grounded in physical principles.<n>We evaluate CoP on two blind, challenging contact-rich manipulation tasks.
  arXiv  Detail & Related papers  (2026-05-27T17:59:02Z)
• FLASH: Fast Learning via GPU-Accelerated Simulation for High-Fidelity Deformable Manipulation in Minutes [15.151803709340404]
  FLASH is a GPU-native simulation framework for contact-rich deformable manipulation.<n>It is built on an accurate NCP-based solver that enforces strict contact and deformation constraints.
  arXiv  Detail & Related papers  (2026-04-19T16:07:43Z)
• ComFree-Sim: A GPU-Parallelized Analytical Contact Physics Engine for Scalable Contact-Rich Robotics Simulation and Control [7.095015036485825]
  We present a GPU-parallelized analytical contact physics engine built on complementarity-free contact modeling.<n>ComFree-Sim computes contact impulses in closed form via an impedance-style prediction--correction update in the dual cone of Coulomb friction.
  arXiv  Detail & Related papers  (2026-03-12T17:14:45Z)
• Semantic-Contact Fields for Category-Level Generalizable Tactile Tool Manipulation [82.63833405368159]
  Generalizing tool manipulation requires both semantic planning and precise physical control.<n>We propose Semantic-Contact Fields (SCFields), a unified 3D representation fusing visual semantics with dense contact estimates.<n> Experiments on scraping, crayon drawing, and peeling demonstrate robust category-level generalization.
  arXiv  Detail & Related papers  (2026-02-14T16:05:08Z)
• PICT -- A Differentiable, GPU-Accelerated Multi-Block PISO Solver for Simulation-Coupled Learning Tasks in Fluid Dynamics [59.38498811984876]
  We present our fluid simulator PICT, a differentiable pressure-implicit solver coded in PyTorch with Graphics-processing-unit (GPU) support.<n>We first verify the accuracy of both the forward simulation and our derived gradients in various established benchmarks.<n>We show that the gradients provided by our solver can be used to learn complicated turbulence models in 2D and 3D.
  arXiv  Detail & Related papers  (2025-05-22T17:55:10Z)
• DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction [21.80091691062415]
  We present DecoupledGaussian, a novel system that decouples static objects from their contacted surfaces captured in-the-wild videos.<n>We validate DecoupledGaussian through a comprehensive user study and quantitative benchmarks.<n>This system enhances digital interaction with objects and scenes in real-world environments, benefiting industries such as VR, robotics, and autonomous driving.
  arXiv  Detail & Related papers  (2025-03-07T14:54:54Z)
• DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation [81.11585774044848]
  We present DeepSimHO, a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network. Our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization.
  arXiv  Detail & Related papers  (2023-10-11T05:34:36Z)
• Jade: A Differentiable Physics Engine for Articulated Rigid Bodies with Intersection-Free Frictional Contact [5.70896453969985]
  Jade is a differentiable physics engine for articulated rigid bodies. It offers features including intersection-free collision simulation and stable LCP solutions for multiple frictional contacts.
  arXiv  Detail & Related papers  (2023-09-09T07:39:36Z)
• Improving Gradient Computation for Differentiable Physics Simulation with Contacts [10.450509067356148]
  We study differentiable rigid-body simulation with contacts. We propose to improve gradient computation by continuous collision detection and leverage the time-of-impact (TOI) We show that with TOI-Ve, we are able to learn an optimal control sequence that matches the analytical solution.
  arXiv  Detail & Related papers  (2023-04-28T21:10:16Z)
• Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics [99.86385468927638]
  We propose a contact point discovery approach (CPDeform) that guides the differentiable physics solver to deform soft-body plasticines. On single-stage tasks, our method can automatically find suitable initial contact points based on transport priorities. On complex multi-stage tasks, we can iteratively switch the contact points of end-effectors based on transport priorities.
  arXiv  Detail & Related papers  (2022-05-05T17:59:41Z)
• Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
  We propose Elastic Interaction of Particles (EIP) for tactile simulation. EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact. We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
  arXiv  Detail & Related papers  (2021-08-11T03:49:59Z)
• DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact [35.26239113931358]
  We present a differentiable cloth simulator whose additional gradient information facilitates cloth-related applications. Our simulator extends the state-of-the-art cloth simulator based on Projective Dynamics and with dry frictional contact governed by the Signorini-Coulomb law. We demonstrate the efficacy of our simulator in various applications, including system identification, manipulation, inverse design, and a real-to-sim task.
  arXiv  Detail & Related papers  (2021-06-09T18:02:10Z)
• Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact [13.502749968646519]
  We present a differentiable physics engine that supports Lagrangian dynamics and hard contact constraints for articulated rigid body simulation. Our differentiable physics engine offers a complete set of features that are typically only available in non-differentiable physics simulators.
  arXiv  Detail & Related papers  (2021-03-30T01:48:29Z)
• DiffPD: Differentiable Projective Dynamics with Contact [65.88720481593118]
  We present DiffPD, an efficient differentiable soft-body simulator with implicit time integration. We evaluate the performance of DiffPD and observe a speedup of 4-19 times compared to the standard Newton's method in various applications.
  arXiv  Detail & Related papers  (2021-01-15T00:13:33Z)
• Fast Gravitational Approach for Rigid Point Set Registration with Ordinary Differential Equations [79.71184760864507]
  This article introduces a new physics-based method for rigid point set alignment called Fast Gravitational Approach (FGA) In FGA, the source and target point sets are interpreted as rigid particle swarms with masses interacting in a globally multiply-linked manner while moving in a simulated gravitational force field. We show that the new method class has characteristics not found in previous alignment methods.
  arXiv  Detail & Related papers  (2020-09-28T15:05:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.