DCGrasp: Distance-aware Controllable Grasp Generation

• URL: http://arxiv.org/abs/2606.29924v1
• Date: Mon, 29 Jun 2026 08:02:02 GMT
• Title: DCGrasp: Distance-aware Controllable Grasp Generation
• Abstract summary: We present DCGrasp, a controllable grasp generation system built on a novel grasp energy term.<n>This term computes Distance Profile, a signed distance from each hand to the nearest object point.<n>Our experiments show that DCGrasp produces high-quality, physically plausible grasps with flexible user control.
• Score: 64.30284326160826
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Generating 3D hand-object interactions is essential for applications in robotics, XR, and synthetic data generation, where flexible controllability and strong generalization to diverse object geometries are required. However, existing methods rarely satisfy these requirements, limiting their practical applicability. We present DCGrasp, a distance-aware controllable grasp generation system built on a novel grasp energy term. This term computes Distance Profile, a signed distance from each hand vertex to the nearest object point, coupled with distance-aware weighting, effectively capturing the semantically similar hand-object interaction in near-contact regions while remaining invariant to object and hand identity. Given various controllable signals, DCGrasp first generates a Distance Profile based on a Diffusion Transformer, together with a corresponding candidate hand pose. We then refine the candidate pose through optimization, enforcing consistency between the optimized hand pose and the generated Distance Profile in near-contact regions. Our experiments show that DCGrasp produces high-quality, physically plausible grasps with flexible user control, generalizing to diverse object and hand shapes and scales. Our work establishes a robust and versatile pipeline for the synthesis of controllable 3D hand-object interactions.

Related papers

• GeoHAT: Geometry-Adaptive Hybrid Action Transformer for Mobile Manipulation [6.488530751190965]
  Whole-body mobile manipulation requires coordinating mobile base and manipulator under shifting viewpoints.<n>We present GeoHAT, an end-to-end diffusion-based framework built on a simple principle.<n>Experiments on the ManiSkill-HAB simulation benchmark demonstrate that GeoHAT achieves a 79.3% mean success rate.
  arXiv  Detail & Related papers  (2026-06-11T14:25:09Z)
• GMT: Goal-Conditioned Multimodal Transformer for 6-DOF Object Trajectory Synthesis in 3D Scenes [47.88691731631585]
  GMT is a multimodal transformer framework that generates realistic and goal-directed object trajectories.<n>Experiments on synthetic and real-world benchmarks demonstrate that GMT outperforms state-of-the-art human motion and human-object interaction baselines.
  arXiv  Detail & Related papers  (2026-03-18T17:54:35Z)
• AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis [50.793806818677716]
  AffordGrasp produces physically stable and semantically faithful human grasps with high precision.<n>AffordGrasp integrates an affordance-aware latent representation of hand poses with a dual-conditioning diffusion process.<n>We evaluate AffordGrasp across four instruction-augmented benchmarks derived from HO-3D, OakInk, GRAB, and AffordPose.
  arXiv  Detail & Related papers  (2026-03-09T06:56:35Z)
• FSAG: Enhancing Human-to-Dexterous-Hand Finger-Specific Affordance Grounding via Diffusion Models [11.581489292735418]
  Dexterous grasp synthesis must satisfy functional intent and physical feasibility, yet existing pipelines often decouple semantic grounding from refinement.<n>We propose a data-efficient framework that bypasses robot grasp data collection by exploiting object-centric semantic priors in pretrained generative diffusion models.<n>Our results highlight a path toward scalable, hardware-agnostic dexterous manipulation driven by human demonstrations and pretrained generative models.
  arXiv  Detail & Related papers  (2026-01-13T06:08:56Z)
• Learning Generalizable Hand-Object Tracking from Synthetic Demonstrations [71.15185260689928]
  We present a system for learning generalizable hand-object tracking controllers purely from synthetic data, without requiring any human demonstrations.<n>Our approach makes two key contributions: (1) HOP, a Hand-Object Planner, which can synthesize diverse hand-object trajectories; and (2) HOT, a Hand-Object Tracker, that bridges synthetic-to-physical transfer through reinforcement learning and interaction imitation learning.
  arXiv  Detail & Related papers  (2025-12-22T17:08:54Z)
• TOUCH: Text-guided Controllable Generation of Free-Form Hand-Object Interactions [66.08264566003048]
  Free-Form HOI Generation aims to generate controllable, diverse, and physically plausible HOI conditioned on fine-grained intent.<n>We construct WildO2, an in-the-wild diverse 3D HOI dataset, which includes diverse HOI derived from internet videos.<n>Building on this dataset, we propose TOUCH, a three-stage framework that facilitates fine-grained semantic control to generate versatile hand poses.
  arXiv  Detail & Related papers  (2025-10-16T16:52:58Z)
• CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects [14.230098033626744]
  Whole-body manipulation of articulated objects is a critical yet challenging task with broad applications in virtual humans and robotics.<n>We propose a novel coordinated diffusion noise optimization framework to achieve realistic whole-body motion.<n>We conduct extensive experiments demonstrating that our method outperforms existing approaches in motion quality and physical plausibility.
  arXiv  Detail & Related papers  (2025-05-27T17:11:50Z)
• SIGHT: Synthesizing Image-Text Conditioned and Geometry-Guided 3D Hand-Object Trajectories [124.24041272390954]
  Modeling hand-object interaction priors holds significant potential to advance robotic and embodied AI systems.<n>We introduce SIGHT, a novel task focused on generating realistic and physically plausible 3D hand-object interaction trajectories from a single image.<n>We propose SIGHT-Fusion, a novel diffusion-based image-text conditioned generative model that tackles this task by retrieving the most similar 3D object mesh from a database.
  arXiv  Detail & Related papers  (2025-03-28T20:53:20Z)
• Decomposed Vector-Quantized Variational Autoencoder for Human Grasp Generation [27.206656215734295]
  We propose a novel Decomposed Vector-Quantized Variational Autoencoder (DVQ-VAE) to generate realistic human grasps. Part-aware decomposed architecture facilitates more precise management of the interaction between each component of hand and object. Our model achieved about 14.1% relative improvement in the quality index compared to the state-of-the-art methods in four widely-adopted benchmarks.
  arXiv  Detail & Related papers  (2024-07-19T06:41:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.