CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarios

• URL: http://arxiv.org/abs/2605.15122v1
• Date: Thu, 14 May 2026 17:35:06 GMT
• Title: CoCo-InEKF: State Estimation with Learned Contact Covariances in Dynamic, Contact-Rich Scenarios
• Abstract summary: CoCo-InEKF is a differentiable invariant extended Kalman filter that utilizes continuous contact velocity covariances instead of binary contact states.<n>We employ a lightweight neural network trained end-to-end using a state-error loss to predict contact candidate points.<n> Experiments on a bipedal robot demonstrate a superior accuracy-efficiency tradeoff for linear velocity estimation.
• Score: 10.290787487255301
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robust state estimation for highly dynamic motion of legged robots remains challenging, especially in dynamic, contact-rich scenarios. Traditional approaches often rely on binary contact states that fail to capture the nuances of partial contact or directional slippage. This paper presents CoCo-InEKF, a differentiable invariant extended Kalman filter that utilizes continuous contact velocity covariances instead of binary contact states. These learned covariances allow the method to dynamically modulate contact confidence, accounting for more nuanced conditions ranging from firm contact to directional slippage or no contact. To predict these covariances for a set of predefined contact candidate points, we employ a lightweight neural network trained end-to-end using a state-error loss. This approach eliminates the need for heuristic ground-truth contact labels. In addition, we propose an automated contact candidate selection procedure and demonstrate that our method is insensitive to their exact placement. Experiments on a bipedal robot demonstrate a superior accuracy-efficiency tradeoff for linear velocity estimation, as well as improved filter consistency compared to baseline methods. This enables the robust execution of challenging motions, including dancing and complex ground interactions -- both in simulation and in the real world.

Related papers

• TRACE: Learned Proprioceptive Odometry for Legged Robots under Unreliable Contact Conditions [4.317571381146645]
  We present TRACE (Tokenized Robust Attention for Contact-Aware Estimation), an end-to-end learned proprioceptive odometry estimator for legged robots.<n>The proposed estimator directly predicts relative displacement, relative rotation, and body-frame velocity from a recent history of onboard inertial and joint measurements.<n>To improve robustness under unreliable contact conditions, we introduce a foot-aware cross-attention module that adaptively weights IMU and leg-wise kinematic tokens.
  arXiv  Detail & Related papers  (2026-08-06T12:53:33Z)
• Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting [21.55901773307122]
  We present a contact-implicit, direct simulation-based multiple shooting (DSMS) framework that transforms kinematically feasible references into dynamically feasible whole-body trajectories.<n>We demonstrate a zero-shot sim-to-real transfer on the Unitree G1 through command-conditioned contact-rich crawling and a highly dynamic 180-degree jump-turn.
  arXiv  Detail & Related papers  (2026-08-04T04:38:34Z)
• Beyond Binary: Sim-to-Real Dexterous Manipulation with Physics-Grounded Contact Representation [51.463992799813816]
  A primary bottleneck in contact-rich manipulation is the difficulty of collecting real-world data.<n>We introduce Center-of-Pressure, an effective tactile representation grounded in physical principles.<n>We evaluate CoP on two blind, challenging contact-rich manipulation tasks.
  arXiv  Detail & Related papers  (2026-05-27T17:59:02Z)
• Simultaneous Contact Selection and Planning for Contact-Rich Manipulation with Cascaded Optimization [13.62351324931659]
  We propose an optimization-based framework for robust contact-rich manipulation.<n>Active contact location selection is challenging due to complementarity in contact dynamics and the sparse gradients.<n>We show that Simultaneous Contact Selection and Planning produces diverse manipulation behaviors and robust control under inaccurate dynamics and perceptual noise.
  arXiv  Detail & Related papers  (2026-05-27T05:07:19Z)
• Unified Complementarity-Based Contact Modeling and Planning for Soft Robots [13.597188299981312]
  This letter presents a unified complementarity-based framework for soft-robot contact modeling and planning.<n>We develop a robust Linear Complementarity Problem (LCP) model tailored to discretized soft robots.<n>We also introduce a kinematically guided warm-start strategy that enables dynamic trajectory optimization through contact.
  arXiv  Detail & Related papers  (2026-02-24T19:37:36Z)
• A Unified Complementarity-based Approach for Rigid-Body Manipulation and Motion Prediction [12.241353619398899]
  This paper presents a mathematical model for robotic manipulation that consistently captures both free motion and frictional contact within a single formalism (Unicomp)<n> Experimental results show that the proposed approach enables physically consistent behavior at interactive speeds across tasks, from pushing to contact-rich whole-body maneuvers.
  arXiv  Detail & Related papers  (2026-02-04T13:10:57Z)
• Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrations [63.80827184637476]
  We introduce D-STAR, a hierarchical policy that disentangles when to act from where to act.<n>We validate our framework through extensive and rigorous simulations.
  arXiv  Detail & Related papers  (2026-01-14T14:37:06Z)
• Semantic Communication for Cooperative Perception using HARQ [51.148203799109304]
  We leverage an importance map to distill critical semantic information, introducing a cooperative perception semantic communication framework. To counter the challenges posed by time-varying multipath fading, our approach incorporates the use of frequency-division multiplexing (OFDM) along with channel estimation and equalization strategies. We introduce a novel semantic error detection method that is integrated with our semantic communication framework in the spirit of hybrid automatic repeated request (HARQ)
  arXiv  Detail & Related papers  (2024-08-29T08:53:26Z)
• Contact-aware Human Motion Generation from Textual Descriptions [57.871692507044344]
  This paper addresses the problem of generating 3D interactive human motion from text. We create a novel dataset named RICH-CAT, representing "Contact-Aware Texts" We propose a novel approach named CATMO for text-driven interactive human motion synthesis.
  arXiv  Detail & Related papers  (2024-03-23T04:08:39Z)
• Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation [50.01551945190676]
  Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. We propose a systematic relational reasoning approach with explicit inference of the underlying dynamically evolving relational structures. We demonstrate its effectiveness for multi-agent trajectory prediction and social robot navigation.
  arXiv  Detail & Related papers  (2024-01-22T18:58:22Z)
• Contact-Aware Retargeting of Skinned Motion [49.71236739408685]
  This paper introduces a motion estimation method that preserves self-contacts and prevents interpenetration. The method identifies self-contacts and ground contacts in the input motion, and optimize the motion to apply to the output skeleton. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works.
  arXiv  Detail & Related papers  (2021-09-15T17:05:02Z)
• Learning Reactive and Predictive Differentiable Controllers for Switching Linear Dynamical Models [7.653542219337937]
  We present a framework for learning composite dynamical behaviors from expert demonstrations. We learn a switching linear dynamical model with contacts encoded in switching conditions as a close approximation of our system dynamics. We then use discrete-time LQR as the differentiable policy class for data-efficient learning of control to develop a control strategy.
  arXiv  Detail & Related papers  (2021-03-26T04:40:24Z)
• COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing [87.7257446869134]
  General contact-rich manipulation problems are long-standing challenges in robotics. Deep reinforcement learning has shown great potential in solving robot manipulation tasks. We propose COCOI, a deep RL method that encodes a context embedding of dynamics properties online.
  arXiv  Detail & Related papers  (2020-11-23T08:20:21Z)
• ContactNets: Learning Discontinuous Contact Dynamics with Smooth, Implicit Representations [4.8986598953553555]
  Our method learns parameterizations of inter-body signed distance and contact-frame Jacobians. Our method can predict realistic impact, non-penetration, and stiction when trained on 60 seconds of real-world data.
  arXiv  Detail & Related papers  (2020-09-23T14:51:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.