Beyond Gestures: Estimating Full Hand Pose and Contact Forces from Wrist-Worn Pressure Sensor Array

• URL: http://arxiv.org/abs/2609.16518v1
• Date: Tue, 15 Sep 2026 02:08:21 GMT
• Title: Beyond Gestures: Estimating Full Hand Pose and Contact Forces from Wrist-Worn Pressure Sensor Array
• Abstract summary: Capturing hand motion and interaction forces is critical for interactive computing, VR, and high-fidelity tactile demonstrations for robot learning.<n>We introduce a wrist-worn pressure-sensing wristband that recovers continuous full-hand pose and distributed contact force on a single wearable.
• Score: 4.346598091476058
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Capturing hand motion and interaction forces is critical for interactive computing, VR, and high-fidelity tactile demonstrations for robot learning. We introduce a wrist-worn pressure-sensing wristband that recovers continuous full-hand pose and distributed contact force on a single wearable. The system consists of flexible capacitive sensor arrays around the wrist, which require no electrical skin contact, and a recurrent network that maps the resulting pressure signal to hand state. Our key insight is that muscle contraction and tendon displacement produce pressure patterns, which correlate strongly with hand pose and interaction force. To validate this, we collect synchronized recordings of wrist pressure, optical motion-capture hand pose, and tactile-glove interaction force, covering isolated finger motion, fingertip-force stress tests, and natural hand-object manipulation. On isolated single-user motion the wristband attains $4.6^\circ$ mean finger-joint MAE, and across four users manipulating everyday objects it estimates per-finger contact force at $R^2=0.57$, which an external pose signal brings up to $0.75$. We see the wristband as one node in a constellation of everyday wearables -- e.g. paired with an egocentric camera -- adding the contact force that vision cannot observe and taking over when the hand is occluded.

Related papers

• TacClip: a clip-on sensor measures dynamic contact forces without covering the fingerpads [6.816222543744948]
  TacClip is a wearable device for recording fingertip deformation caused by contact forces and vibrations.<n>It can be combined with vision- or glove-based hand tracking systems that leave the fingertips uncovered.<n>The signal is produced by a Fiber Bragg Grating embedded on a small plastic clip mounted over the fingernail.
  arXiv  Detail & Related papers  (2026-09-08T03:55:55Z)
• A Tendon-Driven Five-Fingered Hand with Distributed Tactile Perception for Dexterous Manipulation [0.0]
  We propose a novel design of tendon-driven five-fingered hand with dis-tributed tactile perception.<n>With a soft-rigid-hybrid structure employed, both compliance and operational force are endowed to the hand.
  arXiv  Detail & Related papers  (2026-08-26T09:01:36Z)
• WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation [45.818624493082545]
  Retargeting human object interaction demonstrations to physics based simulation requires reproducing body motion and contacts that make manipulation succeed.<n>We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation.
  arXiv  Detail & Related papers  (2026-07-07T16:06:43Z)
• The N2D Haptic Glove: A Multi-Finger Glove for 2D Directional Force Feedback for Contact Rich Manipulation [11.79647885994712]
  Humans rely on directional fingertip forces to probe and regulate contact during manipulation.<n>Most wearable haptic gloves render only vibration or single-axis force, leaving force direction ambiguous.<n>We present the N2D Haptic Glove, a multi-finger wearable device that renders planar flexion-extension fingertip forces using capstan-drive transmissions for high-transparency force feedback.
  arXiv  Detail & Related papers  (2026-06-12T03:59:33Z)
• SoftHand Model-W: A 3D-Printed, Anthropomorphic, Underactuated Robot Hand with Integrated Wrist and Carpal Tunnel [8.885251638603307]
  The SoftHand Model-W is a 3D-printed, under-actuated robot hand based on the Pisa/IIT SoftHand.<n>A carpal tunnel-inspired tendon routing allows remote motor placement in the forearm, reducing distal inertia.<n>The wrist enables pick-and-place operations that would be impossible otherwise.
  arXiv  Detail & Related papers  (2026-04-01T11:05:39Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• OPENTOUCH: Bringing Full-Hand Touch to Real-World Interaction [93.88239833545623]
  We present OpenTouch, the first in-the-wild egocentric full-hand tactile dataset.<n>We show that tactile signals provide a compact yet powerful cue for grasp understanding.<n>We aim to advance multimodal egocentric perception, embodied learning, and contact-rich robotic manipulation.
  arXiv  Detail & Related papers  (2025-12-18T18:18:17Z)
• Feel the Force: Contact-Driven Learning from Humans [52.36160086934298]
  Controlling fine-grained forces during manipulation remains a core challenge in robotics.<n>We present FeelTheForce, a robot learning system that models human tactile behavior to learn force-sensitive manipulation.<n>Our approach grounds robust low-level force control in scalable human supervision, achieving a 77% success rate across 5 force-sensitive manipulation tasks.
  arXiv  Detail & Related papers  (2025-06-02T17:57:52Z)
• EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision [69.1005706608681]
  EgoPressure is a novel egocentric dataset that captures detailed touch contact and pressure interactions.<n>Our dataset comprises 5 hours of recorded interactions from 21 participants captured simultaneously by one head-mounted and seven stationary Kinect cameras.
  arXiv  Detail & Related papers  (2024-09-03T18:53:32Z)
• Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning [52.37106940303246]
  We learn a model that maps noisy input hand poses to target virtual poses. The agent is trained in a residual setting by using a model-free hybrid RL+IL approach. We test our framework in two applications that use hand pose estimates for dexterous manipulations: hand-object interactions in VR and hand-object motion reconstruction in-the-wild.
  arXiv  Detail & Related papers  (2020-08-07T17:34:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.