TacDexGrasp: Compliant and Robust Dexterous Grasping with Tactile Feedback
- URL: http://arxiv.org/abs/2603.07040v1
- Date: Sat, 07 Mar 2026 05:15:27 GMT
- Title: TacDexGrasp: Compliant and Robust Dexterous Grasping with Tactile Feedback
- Abstract summary: This work addresses two key problems: distributing forces across multiple contacts to counteract an object's weight, and preventing rotational slip caused by gravitational torque when a grasp is distant from the object's center of mass.<n>We address these challenges via tactile feedback and a Second-Order Cone Programming (SOCP)-based controller, without explicit torque modeling or slip detection.
- Score: 14.132084492788122
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Multi-fingered hands offer great potential for compliant and robust grasping of unknown objects, yet their high-dimensional force control presents a significant challenge. This work addresses two key problems: (1) distributing forces across multiple contacts to counteract an object's weight, and (2) preventing rotational slip caused by gravitational torque when a grasp is distant from the object's center of mass. We address these challenges via tactile feedback and a Second-Order Cone Programming (SOCP)-based controller, without explicit torque modeling or slip detection. Our key insights are (1) rotational slip inevitably induces translational slip at some contact points for a multi-fingered grasp, and (2) the ratio of tangential to normal force at each contact is an effective early stability indicator. By actively constraining this ratio for each finger below the estimated friction coefficient, our controller maintains grasp stability against both translational and rotational slip. Real-world experiments on 12 diverse objects demonstrate the robustness and compliance of our approach.
Related papers
- Force-Aware Reinforcement Learning with Hybrid Sensorless Force Estimation for Wheeled-Legged Loco-Manipulation [14.501012360823886]
Force-controlled loco-manipulation requires a whole-body policy to coordinate locomotion and arm motion.<n>This paper presents a force-aware reinforcement learning approach with hybrid sensorless force estimation for wheeled-legged loco-manipulation.
arXiv Detail & Related papers (2026-09-12T07:46:53Z) - Control Architecture for Safe Grasping of Fragile Objects Using a Coarse Position-Controlled Gripper [0.26999000177990923]
We present a force/torque-based contact estimation method for a coarse position-controlled gripper.<n>The desired contact forces are estimated online to keep stable contact with objects of unknown properties.<n> Experiments show that the proposed algorithm not only prevents slippage but also applies minimal force to safely grasp an object.
arXiv Detail & Related papers (2026-09-11T11:37:40Z) - Industrial Dual-Arm Box Handling via Online Inertial Estimation and Convex Wrench Optimization [5.026843146697991]
Industrial robotic object handling often involves boxes and packages whose mass and center of mass are not known in advance.<n>This paper presents a friction-aware dual-arm box-handling framework for objects with unknown inertial properties.
arXiv Detail & Related papers (2026-05-21T05:40:59Z) - Probe-to-Grasp Manipulation Using Self-Sensing Pneumatic Variable-Stiffness Joints [9.920023397258435]
This paper presents a probe-to-grasp manipulation framework for estimating the relative stiffness of objects.<n>We use a passive soft-rigid two-finger hybrid gripper equipped with self-sensing pneumatic variable-stiffness joints.<n>We validate the self-sensing model through stiffness characterization experiments and demonstrate stiffness-aware probing-and-grasping in real-life applications.
arXiv Detail & Related papers (2026-03-29T18:43:19Z) - ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulation [75.39847750457626]
ForceVLA2, an end-to-end vision-language-action framework, equips robots with hybrid force-position control and explicit force awareness.<n>To support learning and evaluation, we construct ForceVLA2-Dataset, containing 1,000 trajectories over 5 contact-rich tasks.<n>Experiments show that ForceVLA2 substantially improves success rates and reliability in contact-rich manipulation.
arXiv Detail & Related papers (2026-03-16T12:03:58Z) - TEGA: A Tactile-Enhanced Grasping Assistant for Assistive Robotics via Sensor Fusion and Closed-Loop Haptic Feedback [1.3861223044153617]
We present the tactile enhanced grasping assistant (TEGA)<n>A closed loop assistive teleoperation framework fuses EMG based intent2force inference with visuotactile sensing mapped into real time vibrotactile feedback.<n>A wearable haptic vest delivers real time tactile feedback, allowing users to dynamically refine grasp force during manipulation.
arXiv Detail & Related papers (2026-03-05T04:12:55Z) - Rigidity-Based Multi-Finger Coordination for Precise In-Hand Manipulation of Force-Sensitive Objects [5.313029497667778]
Multi-fingered hands rely solely on fingertip point contacts and are not able to apply pull forces.<n>We propose a dual-layer framework for multi-finger coordination, enabling high-precision manipulation of force-sensitive objects.<n>We validate the framework on a custom dexterous hand, demonstrating the capability to manipulate fragile objects.
arXiv Detail & Related papers (2026-02-15T11:40:39Z) - Symmetry-Aware Fusion of Vision and Tactile Sensing via Bilateral Force Priors for Robotic Manipulation [7.104060092661104]
We propose a Cross-Modal Transformer (CMT) for visuo-tactile fusion.<n>CMT integrates wrist-camera observations with tactile signals through structured self- and cross-attention.<n>Experiments on the TacSL benchmark show that CMT with symmetry regularization achieves a 96.59% insertion success rate.
arXiv Detail & Related papers (2026-02-14T09:19:48Z) - UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
arXiv Detail & Related papers (2026-02-01T11:03:01Z) - Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation [12.509181374985936]
Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities.<n>But training control policies that can directly deploy on real hardware remains difficult due to contact-rich physics.<n>We present a practical framework that utilizes dense tactile feedback combined with joint torque sensing to regulate physical interactions.
arXiv Detail & Related papers (2026-01-06T07:26:39Z) - AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch [9.606323817785114]
We present AnyRotate, a system for gravity-invariant multi-axis in-hand object rotation using dense featured sim-to-real touch.
Our formulation allows the training of a unified policy to rotate unseen objects about arbitrary rotation axes in any hand direction.
Rich multi-fingered tactile sensing can detect unstable grasps and provide a reactive behavior that improves the robustness of the policy.
arXiv Detail & Related papers (2024-05-12T22:51:35Z) - Twisting Lids Off with Two Hands [82.21668778600414]
We show how policies trained in simulation can be effectively and efficiently transferred to the real world.
Specifically, we consider the problem of twisting lids of various bottle-like objects with two hands.
This is the first sim-to-real RL system that enables such capabilities on bimanual multi-fingered hands.
arXiv Detail & Related papers (2024-03-04T18:59:30Z) - Tactile Estimation of Extrinsic Contact Patch for Stable Placement [64.06243248525823]
We present the design of feedback skills for robots that must learn to stack complex-shaped objects on top of each other.
We estimate the contact patch between a grasped object and its environment using force and tactile observations.
arXiv Detail & Related papers (2023-09-25T21:51:48Z) - Contact Points Discovery for Soft-Body Manipulations with Differentiable
Physics [99.86385468927638]
We propose a contact point discovery approach (CPDeform) that guides the differentiable physics solver to deform soft-body plasticines.
On single-stage tasks, our method can automatically find suitable initial contact points based on transport priorities.
On complex multi-stage tasks, we can iteratively switch the contact points of end-effectors based on transport priorities.
arXiv Detail & Related papers (2022-05-05T17:59:41Z) - Fast Simultaneous Gravitational Alignment of Multiple Point Sets [82.32416743939004]
This paper proposes a new resilient technique for simultaneous registration of multiple point sets by interpreting the latter as particle swarms rigidly moving in the mutually induced force fields.
Thanks to the improved simulation with altered physical laws and acceleration of globally multiply-linked point interactions, our Multi-Body Gravitational Approach (MBGA) is robust to noise and missing data.
In various experimental settings, MBGA is shown to outperform several baseline point set alignment approaches in terms of accuracy and runtime.
arXiv Detail & Related papers (2021-06-21T17:59:40Z) - The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? [57.366931129764815]
We collect more than 9,000 grasping trials using a two-finger gripper equipped with GelSight high-resolution tactile sensors on each finger.<n>Our experimental results indicate that incorporating tactile readings substantially improve grasping performance.
arXiv Detail & Related papers (2017-10-16T05:32:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.