BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes
- URL: http://arxiv.org/abs/2604.06589v1
- Date: Wed, 08 Apr 2026 02:17:11 GMT
- Title: BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes
- Abstract summary: BiDexGrasp consists of a large-scale bimanual dexterous grasp dataset and a novel generation model.<n>We construct a large-scale bimanual dexterous grasp dataset, comprising 6351 diverse objects with sizes ranging from 30 to 80 cm.<n>We introduce a bimanual-adaptive and geometry-size-adaptive dexterous grasping generation framework.
- Score: 64.2030401965582
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Bimanual dexterous grasping is a fundamental and promising area in robotics, yet its progress is constrained by the lack of comprehensive datasets and powerful generation models. In this work, we propose BiDexGrasp, consists of a large-scale bimanual dexterous grasp dataset and a novel generation model. For dataset, we propose a novel bimanual grasp synthesis pipeline to efficiently annotate physically feasible data for dataset construction. This pipeline addresses the challenges of high-dimensional bimanual grasping through a two-stage synthesis strategy of efficient region-based grasp initialization and decoupled force-closure grasp optimization. Powered by this pipeline, we construct a large-scale bimanual dexterous grasp dataset, comprising 6351 diverse objects with sizes ranging from 30 to 80 cm, along with 9.7 million annotated grasp data. Based on this dataset, we further introduce a bimanual-coordinated and geometry-size-adaptive dexterous grasping generation framework. The framework lies in two key designs: a bimanual coordination module and a geometry-size-adaptive grasp generation strategy to generate coordinated and high-quality grasps on unseen objects. Extensive experiments conducted in both simulation and real world demonstrate the superior performance of our proposed data synthesis pipeline and learned generative framework.
Related papers
- UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data [70.96218513410454]
We introduce UltraDexGrasp, a framework for universal dexterous grasping with bimanual robots.<n>The proposed data-generation pipeline integrates optimization-based grasp synthesis with planning-based demonstration generation.<n>Based on UltraDexGrasp-20M, we develop a simple yet effective grasp policy that takes point clouds as input, aggregates scene features via unidirectional attention, and predicts control commands.
arXiv Detail & Related papers (2026-03-05T15:54:21Z) - Structural Action Transformer for 3D Dexterous Manipulation [80.07649565189035]
Cross-embodiment skill transfer is a challenge for high-DoF robotic hands.<n>Existing methods, often relying on 2D observations and temporal-centric action representation, struggle to capture 3D spatial relations.<n>This paper proposes a new 3D dexterous manipulation policy that challenges this paradigm by introducing a structural-centric perspective.
arXiv Detail & Related papers (2026-03-04T11:38:12Z) - Generate, Transfer, Adapt: Learning Functional Dexterous Grasping from a Single Human Demonstration [23.251258563998253]
We present CorDex, a framework that robustly learns dexterous functional grasps of novel objects from synthetic data.<n>At the core of our approach is a correspondence-based data engine that generates diverse, high-quality training data in simulation.<n>Building on the generated data, we introduce a multimodal prediction network that integrates visual and geometric information.
arXiv Detail & Related papers (2026-01-08T18:59:30Z) - RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation [52.2244588424002]
We present RoboTwin 2.0, a scalable framework for automated, large-scale generation of diverse and realistic data.<n>At its core is RoboTwin-OD, an object library of 731 instances across 147 categories with semantic and manipulation-relevant annotations.<n>To improve sim-to-real transfer, RoboTwin 2.0 applies structured domain randomization along five axes.
arXiv Detail & Related papers (2025-06-22T16:26:53Z) - Generating Realistic Tabular Data with Large Language Models [49.03536886067729]
Large language models (LLM) have been used for diverse tasks, but do not capture the correct correlation between the features and the target variable.
We propose a LLM-based method with three important improvements to correctly capture the ground-truth feature-class correlation in the real data.
Our experiments show that our method significantly outperforms 10 SOTA baselines on 20 datasets in downstream tasks.
arXiv Detail & Related papers (2024-10-29T04:14:32Z) - Modified CycleGAN for the synthesization of samples for wheat head
segmentation [0.09999629695552192]
In the absence of an annotated dataset, synthetic data can be used for model development.
We develop a realistic annotated synthetic dataset for wheat head segmentation.
The resulting model achieved a Dice score of 83.4% on an internal dataset and 83.6% on two external Global Wheat Head Detection datasets.
arXiv Detail & Related papers (2024-02-23T06:42:58Z) - Paved2Paradise: Cost-Effective and Scalable LiDAR Simulation by Factoring the Real World [0.2630859234884723]
We describe Paved2Paradise, a simple, cost-effective approach for generating lidar datasets from scratch.
We show that a model trained exclusively on Paved2Paradise synthetic data is highly effective at detecting humans in orchards.
arXiv Detail & Related papers (2023-12-02T12:23:07Z) - DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General
Objects Based on Simulation [10.783992625475081]
We present a large-scale simulated dataset, DexGraspNet, for robotic dexterous grasping.
We use ShadowHand, a dexterous gripper commonly seen in robotics, to generate 1.32 million grasps for 5355 objects.
Compared to the previous dataset generated by GraspIt!, our dataset has not only more objects and grasps, but also higher diversity and quality.
arXiv Detail & Related papers (2022-10-06T06:09:16Z) - DA$^2$ Dataset: Toward Dexterity-Aware Dual-Arm Grasping [58.48762955493929]
DA$2$ is the first large-scale dual-arm dexterity-aware dataset for the generation of optimal bimanual grasping pairs for arbitrary large objects.
The dataset contains about 9M pairs of parallel-jaw grasps, generated from more than 6000 objects.
arXiv Detail & Related papers (2022-07-31T10:02:27Z) - THE Benchmark: Transferable Representation Learning for Monocular Height
Estimation [25.872962101146115]
We propose a new benchmark dataset to study the transferability of height estimation models in a cross-dataset setting.
This benchmark dataset includes a newly proposed large-scale synthetic dataset, a newly collected real-world dataset, and four existing datasets from different cities.
In this paper, we propose a scale-deformable convolution module to enhance the window-based Transformer for handling the scale-variation problem in the height estimation task.
arXiv Detail & Related papers (2021-12-30T09:40:26Z) - ACRONYM: A Large-Scale Grasp Dataset Based on Simulation [64.37675024289857]
ACRONYM is a dataset for robot grasp planning based on physics simulation.
The dataset contains 17.7M parallel-jaw grasps, spanning 8872 objects from 262 different categories.
We show the value of this large and diverse dataset by using it to train two state-of-the-art learning-based grasp planning algorithms.
arXiv Detail & Related papers (2020-11-18T23:24:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.