HOPE: Hand-Object Pressure Estimation from Monocular Videos

• URL: http://arxiv.org/abs/2608.06192v1
• Date: Thu, 06 Aug 2026 15:51:46 GMT
• Title: HOPE: Hand-Object Pressure Estimation from Monocular Videos
• Abstract summary: Pressure estimation is difficult to apply to dynamic hand-object interaction with diverse objects.<n>We formulate pressure estimation as a hand-centric video prediction problem with monocular video as input.<n>We propose textbfHOPE, a framework with two key components.
• Score: 25.44410964778365
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Estimating physical pressure from vision is essential for understanding contact-rich hand-object interaction. However, prior vision-based pressure estimation methods are largely limited to planar surfaces and single image input, making them difficult to apply to dynamic hand-object interaction with diverse objects. We instead formulate pressure estimation as a hand-centric video prediction problem with monocular video as input. This formulation predicts temporally evolving per-vertex normal pressure and contact directly on the hand mesh, yielding a unified output space independent of object shape and sensor layout. Building on this formulation, we propose \textbf{HOPE}, a framework with two key components. First, we lift tactile-glove pressure, planar-sensor pressure, and distance-based hand-object contact annotations into a shared hand vertex space, allowing bare-hand contact data to regularize pressure learning where metric labels are unavailable. Second, we introduce a vertex-anchored video transformer that treats each vertex as a persistent token, aggregates visual features and hand pose over time, and uses a contact-gated pressure head to enforce that pressure vanishes without contact. Experiments on OpenTouch, PressureVisionDB, and hand-object contact benchmarks validate HOPE across object-pressure, surface-pressure, and contact-supervised HOI settings. Despite using metric pressure supervision primarily from gloved-hand videos, HOPE generalizes to bare-hand egocentric and in-the-wild videos, producing joint contact and pressure predictions beyond the scope of contact-only or planar-pressure baselines.

Related papers

• PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation [35.417454041027774]
  PressMimic is a framework that integrates pressure into the full pipeline from motion capture to humanoid control.<n>In the perception stage, we introduce FRAPPE++, a multimodal model that fuses RGB and pressure to jointly estimate 3D pose and global motion.<n>In the control stage, we propose a pressure-supervised policy (PSP) that incorporates pressure-derived signals into reinforcement learning.
  arXiv  Detail & Related papers  (2026-06-25T08:24:35Z)
• Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention [53.84395207661823]
  We propose Tactile-WAM, a touch-aware WAM with a Tactile Asymmetric Attention Mechanism (TAAM)<n>On ManiFeel, Tactile-WAM improves the mean success rate by 38.9% overall and by 86% on contact-rich tasks.
  arXiv  Detail & Related papers  (2026-06-25T06:54:56Z)
• EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video [82.13376072770363]
  Estimating full-hand grasp pressure from egocentric video is critical for immersive VR and robotic manipulation.<n>We introduce EgoTactile, a benchmark pairing egocentric video with full-hand pressure supervision for diverse everyday objects.<n>We also propose EgoPressureDiff, a conditional diffusion framework that adapts a large-scale pre-trained video diffusion backbone.
  arXiv  Detail & Related papers  (2026-06-08T09:20:03Z)
• EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation [68.71388815638576]
  We present emphEgoPressDiff, a conditional video diffusion framework that generates UV-pressure maps from visual input.<n>EgoPressDiff achieves state-of-the-art results, improving Volumetric IoU by over 34% relative to prior baseline.
  arXiv  Detail & Related papers  (2026-06-05T03:40:10Z)
• OPENTOUCH: Bringing Full-Hand Touch to Real-World Interaction [93.88239833545623]
  We present OpenTouch, the first in-the-wild egocentric full-hand tactile dataset.<n>We show that tactile signals provide a compact yet powerful cue for grasp understanding.<n>We aim to advance multimodal egocentric perception, embodied learning, and contact-rich robotic manipulation.
  arXiv  Detail & Related papers  (2025-12-18T18:18:17Z)
• EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision [69.1005706608681]
  EgoPressure is a novel egocentric dataset that captures detailed touch contact and pressure interactions.<n>Our dataset comprises 5 hours of recorded interactions from 21 participants captured simultaneously by one head-mounted and seven stationary Kinect cameras.
  arXiv  Detail & Related papers  (2024-09-03T18:53:32Z)
• PressureVision++: Estimating Fingertip Pressure from Diverse RGB Images [23.877554759345607]
  Deep models can estimate hand pressure based on a single RGB image. We present a novel approach that enables diverse data to be captured with only an RGB camera and a cooperative participant. We also demonstrate an application of PressureVision++ to mixed reality where pressure estimation allows everyday surfaces to be used as arbitrary touch-sensitive interfaces.
  arXiv  Detail & Related papers  (2023-01-05T21:48:33Z)
• PressureVision: Estimating Hand Pressure from a Single RGB Image [27.449311565446443]
  We explore the possibility of using a conventional RGB camera to infer hand pressure. We collected videos of 36 participants with diverse skin tone applying pressure to an instrumented planar surface. We trained a deep model (PressureVisionNet) to infer a pressure image from a single RGB image.
  arXiv  Detail & Related papers  (2022-03-19T19:54:56Z)
• Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning [52.37106940303246]
  We learn a model that maps noisy input hand poses to target virtual poses. The agent is trained in a residual setting by using a model-free hybrid RL+IL approach. We test our framework in two applications that use hand pose estimates for dexterous manipulations: hand-object interactions in VR and hand-object motion reconstruction in-the-wild.
  arXiv  Detail & Related papers  (2020-08-07T17:34:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.