WHED: A Wearable Hand Exoskeleton for Natural, High-Quality Demonstration Collection
- URL: http://arxiv.org/abs/2602.17908v2
- Date: Thu, 12 Mar 2026 19:35:31 GMT
- Title: WHED: A Wearable Hand Exoskeleton for Natural, High-Quality Demonstration Collection
- Abstract summary: We present WHED, a wearable hand-exoskeleton system designed for in-the-wild demonstration capture.<n>We show feasibility on representative grasping and manipulation sequences spanning precision pinch and full-hand enclosure grasps.
- Score: 7.615440875928701
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Scalable learning of dexterous manipulation remains bottlenecked by the difficulty of collecting natural, high-fidelity human demonstrations of multi-finger hands due to occlusion, complex hand kinematics, and contact-rich interactions. We present WHED, a wearable hand-exoskeleton system designed for in-the-wild demonstration capture, guided by two principles: wearability-first operation for extended use and a pose-tolerant, free-to-move thumb coupling that preserves natural thumb behaviors while maintaining a consistent mapping to the target robot thumb degrees of freedom. WHED integrates a linkage-driven finger interface with passive fit accommodation, a modified passive hand with robust proprioceptive sensing, and an onboard sensing/power module. We also provide an end-to-end data pipeline that synchronizes joint encoders, AR-based end-effector pose, and wrist-mounted visual observations, and supports post-processing for time alignment and replay. We demonstrate feasibility on representative grasping and manipulation sequences spanning precision pinch and full-hand enclosure grasps, and show qualitative consistency between collected demonstrations and replayed executions.
Related papers
- A Tendon-Driven Five-Fingered Hand with Distributed Tactile Perception for Dexterous Manipulation [0.0]
We propose a novel design of tendon-driven five-fingered hand with dis-tributed tactile perception.<n>With a soft-rigid-hybrid structure employed, both compliance and operational force are endowed to the hand.
arXiv Detail & Related papers (2026-08-26T09:01:36Z) - AdaDexGrasp: Adaptive Dexterous Grasping via 3D Visuo-Tactile Representation Fusion [60.79507611737292]
Humans achieve stable and adaptive grasps by seamlessly integrating visual perception and tactile feedback.<n>Existing robotic grasping approaches rely on visual inputs and lack mechanisms for tactile-guided adaptation after contact.<n>We propose a unified visuo-tactile-fusion grasping framework that integrates grasp generation, feasibility prediction, and adaptive refinement.
arXiv Detail & Related papers (2026-08-06T16:29:11Z) - VTAP Gripper: Synergizing Fingertip Sensing and a Visuo-Tactile Active Palm for Dexterous In-Hand Manipulation [22.38178317703772]
This paper presents a tactile-reactive gripper that integrates a Visuo-Tactile Active Palm (VTAP) and compliant, reconfigurable fingers equipped with array sensors.<n>The design exploits structured finger-palm synergy and multi-modal tactile perception to achieve both robust grasping and fine manipulation.
arXiv Detail & Related papers (2026-07-16T20:41:00Z) - Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation [74.87716678195099]
Visuo-Tactile policies leveraging optical tactile sensors have shown great promise in contact-rich manipulation.<n>Despite their advantages, extracting fine-grained contact states necessary for contact-rich manipulation remains an open challenge.<n>We propose a motion-aware tactile representation to facilitate contact-rich manipulation.
arXiv Detail & Related papers (2026-06-29T08:20:18Z) - A Human-Inspired Thumb-Index Robotic Hand with Strain Gauges Embedded in Soft Joints [1.9808221015667646]
The Safe Thumb-Index Robotic Hand was developed as a minimal, lightweight, and low-cost two-digit prototype.<n>By pairing an underactuated, tendon-driven mechanical design with flexible strain gauges embedded into silicone-encapsulated soft joints, the system achieves passive grasp adaptation.
arXiv Detail & Related papers (2026-06-19T09:13:10Z) - Transferring Contact, Not Just Motion: Compliant Grasping Across Dexterous Hands [0.01268579273097071]
Dexterous grasping depends on contact regulation, not motion alone.<n>Existing cross-embodiment dexterous policies unify motion through retargeted hand poses or latent actions, but force feedback remains tied to each hand's sensing and actuation.<n>This work introduces a cross-embodiment force-position interface for contact-aware manipulation across heterogeneous dexterous hands.
arXiv Detail & Related papers (2026-06-14T00:01:36Z) - HandX: Scaling Bimanual Motion and Interaction Generation [55.486397101415]
HandX is a unified foundation spanning data, annotation, and evaluation.<n>We consolidate and filter existing datasets for quality, and collect a new motion-capture dataset.<n>Experiments demonstrate high-quality dexterous motion generation, supported by our newly proposed hand-focused metrics.
arXiv Detail & Related papers (2026-03-30T17:59:49Z) - UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling [45.29560152294065]
UniHand is a unified diffusion-based framework that formulates both estimation and generation as conditional motion synthesis.<n>Visual observations are encoded with a frozen backbone, while a dedicated hand perceptron extracts hand-specific cues directly from image features.<n>A latent diffusion model then synthesizes consistent motion sequences from diverse conditions.
arXiv Detail & Related papers (2026-02-25T06:53:15Z) - PLATO Hand: Shaping Contact Behavior with Fingernails for Precise Manipulation [3.5374164303989204]
The PLATO Hand is a dexterous robotic hand with a hybrid fingertip that embeds a rigid fingernail within a compliant pulp.<n>We develop a strain-energy-based bending-indentation model to guide the fingertip design.<n> Experimental results show improved pinching stability, enhanced force observability, and successful execution of edge-sensitive manipulation tasks.
arXiv Detail & Related papers (2026-02-05T00:17:08Z) - TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
arXiv Detail & Related papers (2026-01-28T04:22:47Z) - OPENTOUCH: Bringing Full-Hand Touch to Real-World Interaction [93.88239833545623]
We present OpenTouch, the first in-the-wild egocentric full-hand tactile dataset.<n>We show that tactile signals provide a compact yet powerful cue for grasp understanding.<n>We aim to advance multimodal egocentric perception, embodied learning, and contact-rich robotic manipulation.
arXiv Detail & Related papers (2025-12-18T18:18:17Z) - MILE: A Mechanically Isomorphic Exoskeleton Data Collection System with Fingertip Visuotactile Sensing for Dexterous Manipulation [17.138615434309575]
Existing data-collection pipelines suffer from inaccurate motion manipulation, low data-collection efficiency, and missing high-resolution tactile sensing.<n>We address this gap with MILE, a mechanically tele-operation and data-collection system co-designed from human hand to robotic hand.
arXiv Detail & Related papers (2025-11-29T05:34:39Z) - Grasp Like Humans: Learning Generalizable Multi-Fingered Grasping from Human Proprioceptive Sensorimotor Integration [26.351720551267846]
Tactile and kinesthetic perceptions are crucial for human dexterous manipulation, enabling reliable grasping of objects via sensorimotor integration.<n>We propose a novel glove-mediated tactile-kinematic perception-prediction framework for grasp skill transfer from human intuitive and natural operation to robotic execution based on imitation learning.
arXiv Detail & Related papers (2025-09-10T07:44:12Z) - Reactive In-Air Clothing Manipulation with Confidence-Aware Dense Correspondence and Visuotactile Affordance [2.9070495263473375]
Prior systems often flatten garments or assume visibility of key features.<n>We present a dual-arm visuotactile framework that combines confidence-aware dense visual correspondence and tactile-supervised grasp affordance.<n>We demonstrate our task-agnostic grasp selection module in folding and hanging tasks.
arXiv Detail & Related papers (2025-09-04T05:16:56Z) - Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper [7.618517580705364]
We present a portable, lightweight gripper with integrated tactile sensors.<n>We propose a cross-modal representation learning framework that integrates visual and tactile signals.<n>We validate our approach on fine-grained tasks such as test tube insertion and pipette-based fluid transfer.
arXiv Detail & Related papers (2025-07-20T17:53:59Z) - Learning Visuotactile Skills with Two Multifingered Hands [80.99370364907278]
We explore learning from human demonstrations using a bimanual system with multifingered hands and visuotactile data.
Our results mark a promising step forward in bimanual multifingered manipulation from visuotactile data.
arXiv Detail & Related papers (2024-04-25T17:59:41Z) - Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation [59.3035531612715]
Existing methods often struggle to generate plausible hand poses when the hand is heavily occluded or blurred.
In videos, the movements of the hand allow us to observe various parts of the hand that may be occluded or blurred in a single frame.
We propose the Deformer: a framework that implicitly reasons about the relationship between hand parts within the same image.
arXiv Detail & Related papers (2023-03-09T02:24:30Z) - Reconfigurable Data Glove for Reconstructing Physical and Virtual Grasps [100.72245315180433]
We present a reconfigurable data glove design to capture different modes of human hand-object interactions.
The glove operates in three modes for various downstream tasks with distinct features.
We evaluate the system's three modes by (i) recording hand gestures and associated forces, (ii) improving manipulation fluency in VR, and (iii) producing realistic simulation effects of various tool uses.
arXiv Detail & Related papers (2023-01-14T05:35:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.