DexJoCo: A Benchmark and Toolkit for Task-Oriented Dexterous Manipulation on MuJoCo

• URL: http://arxiv.org/abs/2605.16257v1
• Date: Fri, 15 May 2026 17:59:51 GMT
• Title: DexJoCo: A Benchmark and Toolkit for Task-Oriented Dexterous Manipulation on MuJoCo
• Abstract summary: DexJoCo is a benchmark and toolkit for task-oriented dexterous manipulation.<n>We present 11 functionally grounded tasks that evaluate tool-use, bimanual coordination, long-horizon execution, and reasoning.<n>We benchmark modern models under diverse settings, including visual and dynamics randomization, multi-task training, and action-head adaptation.
• Score: 82.73355932907565
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Achieving human-level manipulation requires dexterous robotic hands capable of complex object interactions. Advancing such capabilities further demands standardized benchmarks for systematic evaluation. However, existing dexterous benchmarks lack tasks that reflect the unique manipulation capabilities of dexterous hands over parallel grippers, as well as comprehensive evaluation pipelines. In this paper, we present DexJoCo, a benchmark and toolkit for task-oriented dexterous manipulation, comprising 11 functionally grounded tasks that evaluate tool-use, bimanual coordination, long-horizon execution, and reasoning. We develop a low-cost data collection system and collect 1.1K trajectories across these tasks, with support for domain randomization to assess robustness. We benchmark modern models under diverse settings, including visual and dynamics randomization, multi-task training, and action-head adaptation. Through extensive empirical analysis, we identify several important insights and common limitations of current policies in dexterous manipulation, highlighting key challenges for future research in dexterous hand robot learning. Project page available at: https://dexjoco.github.io

Related papers

• DexVerse: A Modular Benchmark for Multi-Task, Multi-Embodiment Dexterous Manipulation [66.68529423691461]
  We present DexVerse, a large-scale and modular benchmark for dexterous manipulation.<n>We benchmark representative methods, including Diffusion Policy, DP3, OpenVLA, and $_0.5$, across 19 tasks.<n>Results reveal substantial challenges in task generalization and visuomotor robustness.
  arXiv  Detail & Related papers  (2026-07-09T17:50:47Z)
• A Benchmark of Dexterity for Anthropomorphic Robotic Hands [6.846001511743122]
  Dexterity is a central yet ambiguously defined concept in the design and evaluation of anthropomorphic robotic hands.<n>We introduce POMDAR, a comprehensive benchmark that formalizes dexterity as task performance across a structured set of manipulation and grasping motions.
  arXiv  Detail & Related papers  (2026-04-10T13:04:28Z)
• BiCoord: A Bimanual Manipulation Benchmark towards Long-Horizon Spatial-Temporal Coordination [20.953323366922266]
  BiCoord is a benchmark for long-horizon and tightly coordinated bimanual manipulation.<n>Specifically, BiCoord comprises diverse tasks that require continuous inter-arm dependency and dynamic role exchange.<n>Results show that representative manipulation policies struggle with long-duration and highly coupled tasks.
  arXiv  Detail & Related papers  (2026-04-07T13:02:17Z)
• Concurrent Prehensile and Nonprehensile Manipulation: A Practical Approach to Multi-Stage Dexterous Tasks [23.52755440099898]
  We present DexMulti, a sample-efficient approach for real-world dexterous multi-task manipulation.<n>Rather than learning monolithic policies, our method retrieves demonstrated skills based on current object geometry.<n>Our approach achieves an average success rate of 66% on training objects with only 3-4 demonstrations per object, outperforming diffusion policy baselines by 2-3x.
  arXiv  Detail & Related papers  (2026-03-12T08:25:21Z)
• SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending [79.83865372778273]
  We introduce SkillBlender, a novel hierarchical reinforcement learning framework for versatile humanoid loco-manipulation.<n>SkillBlender first pretrains goal-conditioned task-agnostic primitive skills, and then dynamically blends these skills to accomplish complex loco-manipulation tasks.<n>We also introduce SkillBench, a parallel, cross-embodiment, and diverse simulated benchmark containing three embodiments, four primitive skills, and eight challenging loco-manipulation tasks.
  arXiv  Detail & Related papers  (2025-06-11T03:24:26Z)
• What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent Capabilities [56.646832992178105]
  We introduce OmniBench, a cross-platform, graph-based benchmark with an automated pipeline for synthesizing tasks of controllable complexity.<n>We present OmniEval, a multidimensional evaluation framework that includes subtask-level evaluation, graph-based metrics, and comprehensive tests across 10 capabilities.<n>Our dataset contains 36k graph-structured tasks across 20 scenarios, achieving a 91% human acceptance rate.
  arXiv  Detail & Related papers  (2025-06-10T15:59:38Z)
• DexMachina: Functional Retargeting for Bimanual Dexterous Manipulation [48.68321200585559]
  We study the problem of functional discoterous manipulation policies to track object states from human hand-object demonstrations.<n>We propose a novel curriculum-based algorithm: the key idea is to use virtual object controllers with strength.<n>We release a simulation benchmark with a diverse set of tasks and dexterous hands, and show that DexMachina significantly outperforms baseline methods.
  arXiv  Detail & Related papers  (2025-05-30T17:50:23Z)
• DexterityGen: Foundation Controller for Unprecedented Dexterity [67.15251368211361]
  Teaching robots dexterous manipulation skills, such as tool use, presents a significant challenge.<n>Current approaches can be broadly categorized into two strategies: human teleoperation (for imitation learning) and sim-to-real reinforcement learning.<n>We introduce DexterityGen, which uses RL to pretrain large-scale dexterous motion primitives, such as in-hand rotation or translation.<n>In the real world, we use human teleoperation as a prompt to the controller to produce highly dexterous behavior.
  arXiv  Detail & Related papers  (2025-02-06T18:49:35Z)
• Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulation [28.37417344133933]
  We present Sequential Dexterity, a general system that chains multiple dexterous policies for achieving long-horizon task goals. The core of the system is a transition feasibility function that progressively finetunes the sub-policies for enhancing chaining success rate. Our system demonstrates generalization capability to novel object shapes and is able to zero-shot transfer to a real-world robot equipped with a dexterous hand.
  arXiv  Detail & Related papers  (2023-09-02T16:55:48Z)
• Task Compass: Scaling Multi-task Pre-training with Task Prefix [122.49242976184617]
  Existing studies show that multi-task learning with large-scale supervised tasks suffers from negative effects across tasks. We propose a task prefix guided multi-task pre-training framework to explore the relationships among tasks. Our model can not only serve as the strong foundation backbone for a wide range of tasks but also be feasible as a probing tool for analyzing task relationships.
  arXiv  Detail & Related papers  (2022-10-12T15:02:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.