ContactMimic: Humanoid Object Interaction via Contact Control

• URL: http://arxiv.org/abs/2607.08742v1
• Date: Thu, 09 Jul 2026 17:42:15 GMT
• Title: ContactMimic: Humanoid Object Interaction via Contact Control
• Abstract summary: We present CONTACTMIMIC, a learning framework that tracks explicit partlevel binary contact commands alongside keypoint trajectories.<n> CONTACTMIMIC is made possible through the use of contact-following rewards and a trajectory augmentation scheme.<n> Simulation experiments confirm that CONTACTMIMIC exhibits contact controllability that enables it to complete manipulation tasks without task-specific rewards.
• Score: 14.393971688434528
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Keypoint tracking alone is insufficient for object interaction tasks such as sitting on a chair, wiping a board, or pushing furniture, where the robot can reach the correct pose without making meaningful physical contact with the object. We present CONTACTMIMIC, a learning framework that tracks explicit partlevel binary contact commands alongside keypoint trajectories. CONTACTMIMIC is made possible through the use of contact-following rewards and a trajectory augmentation scheme aimed at breaking the correlations between keypoint trajectories and contact labels. The resulting policy successfully decouples contact behavior from keypoint geometry, and achieves precise physical contact as well as contact-controllability (produce or suppress contact during deployment as desired). Simulation experiments across 10 diverse human-object interaction motions confirm that CONTACTMIMIC exhibits contact controllability that enables it to complete manipulation tasks without task-specific rewards, while also outperforming keypoint-only trackers on contact-relevant tasks. Ablations confirm the necessity of the proposed trajectory augmentation scheme and sim2real deployment validates contact controllability in the real world across 5 different motions. Video results are available on https://lixinyao11.github.io/contactmimic-page/.

Related papers

• One Demonstration, Many Objects: Generalizing Manipulation via Local Contact Geometry [49.066054862620014]
  Learning from human demonstrations has emerged as a scalable alternative to robot teleoperation.<n>Recent sim-to-real RL methods incorporate such priors, but often omit rewards that explicitly incentivize precise contact.<n>We propose DemoMimic, a policy that manipulates objects by focusing on their geometry local to the contact points.
  arXiv  Detail & Related papers  (2026-09-01T23:04:35Z)
• TACTIC: Tactile and Vision Conditioned Contact-Centric Control for Whole-Arm Manipulation [3.8628620899766553]
  Whole-arm manipulation involves direct contact with the environment while the robot completes a task.<n>We propose TACTIC (Tactile and Vision Conditioned Contact-Centric Control), a receding-horizon controller for whole-arm manipulation.
  arXiv  Detail & Related papers  (2026-07-10T09:08:55Z)
• ConCent: Contact-Centric Real-to-Sim-to-Real Learning from One Demonstration [17.067367964368486]
  Sim-to-real policy transfer is a promising paradigm for scaling robot manipulation without large-scale real-world data.<n>We propose a contact-centric real-to-sim-to-real RL framework that uses task-relevant contact event sequences extracted from real demonstrations.<n>Experiments on contact-rich manipulation tasks demonstrate more stable and robust sim-to-real policy transfer compared to unconstrained RL baselines.
  arXiv  Detail & Related papers  (2026-06-29T13:16:33Z)
• Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation [74.87716678195099]
  Visuo-Tactile policies leveraging optical tactile sensors have shown great promise in contact-rich manipulation.<n>Despite their advantages, extracting fine-grained contact states necessary for contact-rich manipulation remains an open challenge.<n>We propose a motion-aware tactile representation to facilitate contact-rich manipulation.
  arXiv  Detail & Related papers  (2026-06-29T08:20:18Z)
• NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation [0.7378853859331618]
  NoContactNoWorries is a framework that fuses RGB-D vision with the robot's proprioception to infer binary contact states.<n>We show that the inferred contact signal supports downstream reinforcement learning agents for in-hand object reorientation.
  arXiv  Detail & Related papers  (2026-06-23T11:36:46Z)
• DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects [12.35353010124029]
  Dexterous interaction with articulated objects is important for household, assistive, and humanoid manipulation.<n>We present DragMesh-2, a contact-driven framework for dexterous interaction with articulated objects.<n>We also propose PICA, a physically informed contact-aware training mechanism.
  arXiv  Detail & Related papers  (2026-06-13T05:47:14Z)
• HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning [24.64460457808404]
  HapTile is a contact-grounded visuotactile manipulation dataset that advances beyond vision-only trajectory datasets.<n>The data collection platform integrates haptic feedback directly into the teleoperation controller, enabling the operator to perceive contact interactions in real time.<n>The dataset comprises everyday manipulation tasks spanning a broad range of contact-rich skills, including pick-and-place, folding, pressing, stacking, and other routine activities.
  arXiv  Detail & Related papers  (2026-06-03T12:48:17Z)
• OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation [57.133721026727706]
  We present textbfOmniViTac, a large-scale visuo-tactile-action dataset comprising $21,000+$ trajectories across $86$ tasks and $100+$ objects.<n>We propose textbf OmniVTA, a world-model-based visuo-tactile manipulation framework that integrates four tightly coupled modules.
  arXiv  Detail & Related papers  (2026-03-19T17:52:42Z)
• TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
  TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
  arXiv  Detail & Related papers  (2026-01-28T04:22:47Z)
• Tactile Estimation of Extrinsic Contact Patch for Stable Placement [64.06243248525823]
  We present the design of feedback skills for robots that must learn to stack complex-shaped objects on top of each other. We estimate the contact patch between a grasped object and its environment using force and tactile observations.
  arXiv  Detail & Related papers  (2023-09-25T21:51:48Z)
• Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics [99.86385468927638]
  We propose a contact point discovery approach (CPDeform) that guides the differentiable physics solver to deform soft-body plasticines. On single-stage tasks, our method can automatically find suitable initial contact points based on transport priorities. On complex multi-stage tasks, we can iteratively switch the contact points of end-effectors based on transport priorities.
  arXiv  Detail & Related papers  (2022-05-05T17:59:41Z)
• COUCH: Towards Controllable Human-Chair Interactions [44.66450508317131]
  We study the problem of synthesizing scene interactions conditioned on different contact positions on the object. We propose a novel synthesis framework COUCH that plans ahead the motion by predicting contact-aware control signals of the hands. Our method shows significant quantitative and qualitative improvements over existing methods for human-object interactions.
  arXiv  Detail & Related papers  (2022-05-01T19:14:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.