Humanoid-DART: Humanoid Loco-Manipulation using Diffusion-guided Augmentation through Relabeling and Tracking
- URL: http://arxiv.org/abs/2606.26855v1
- Date: Thu, 25 Jun 2026 10:40:33 GMT
- Title: Humanoid-DART: Humanoid Loco-Manipulation using Diffusion-guided Augmentation through Relabeling and Tracking
- Abstract summary: Imitating human demonstrations has emerged as a dominant paradigm for learning humanoid loco-manipulation policies.<n>We present a self-supervised framework that bootstraps from sparse demonstrations and progressively expands its behavioral repertoire.<n>We demonstrate the effectiveness of our framework on multiple humanoid loco-manipulation skills.
- Score: 1.7956387908402205
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Imitating human demonstrations has emerged as a dominant paradigm for learning humanoid loco-manipulation policies. However, scaling these approaches remains challenging due to the high cost of collecting diverse demonstrations and the need for continual human intervention to correct policy failures. In this paper, we present a self-supervised framework that bootstraps from sparse demonstrations and progressively expands its behavioral repertoire, enabling the learning of a goal-conditioned policy that automatically explores the goal space with minimal expert supervision. Our approach combines diffusion-based trajectory generation with reinforcement learning, where the latter is used to track goal-conditioned trajectories produced by the diffusion model for a range of loco-manipulation skills. Through extensive ablation studies and comparisons with state-of-the-art methods, we demonstrate the effectiveness of our framework on multiple humanoid loco-manipulation skills.
Related papers
- Guided Discovery of New Behaviors using Diffusion Policies [10.086845726616694]
We propose a framework that guides diffusion policy samples towards promising yet underrepresented samples.<n>Our method effectively mines and repairs novel trajectories, enabling the systematic discovery of diverse and executable behaviors.
arXiv Detail & Related papers (2026-06-07T17:24:44Z) - HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning [52.022681285103126]
We present HumanoidMimicGen, a method for generating humanoid legged loco-manipulation data.<n>Our method adapts contact-rich whole-body skills from a handful of source demonstrations to new states.<n>We show that whole-body visuomotor policies co-trained with data generated by HumanoidMimicGen outperform those trained only on real-world data by 20%.
arXiv Detail & Related papers (2026-05-26T21:57:11Z) - Human-Robot Copilot for Data-Efficient Imitation Learning [38.76308745375941]
We propose a framework for teaching robots task-specific skills by collecting human demonstrations via teleoperation.<n>The Human-Robot Copilot framework can leverage a scaling factor for dexterous teleoperation while maintaining compatibility with a wide range of industrial and research manipulators.
arXiv Detail & Related papers (2026-04-04T07:00:32Z) - GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion [44.168491831527355]
This paper focuses on enhancing the grasping precision and generalization of manipulation policies learned via imitation learning.<n>Existing imitation learning techniques for grasping often suffer from imprecise grasp executions, limited spatial generalization, and poor object generalization.
arXiv Detail & Related papers (2026-02-26T10:56:01Z) - SAGE: Saliency-Guided Contrastive Embeddings [4.33144664431421]
Existing approaches to integrate saliency into model training often rely on internal model mechanisms.<n>We propose SAGE (Saliency-Guided Contrastive Embeddings): a loss function that integrates human saliency into network training using contrastive embeddings.<n>We demonstrate a boost in classification performance across both open- and closed-set scenarios against SOTA saliency-based methods.
arXiv Detail & Related papers (2025-11-16T19:19:59Z) - Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration [58.4036440289082]
Hand-object motion-capture (MoCap) offer large-scale, contact-rich demonstrations and hold promise for dexterous robotic scopes.<n>We introduce Dexplore, a unified single-loop optimization that performs repositories and tracking to learn robot control policies directly from MoCap at scale.
arXiv Detail & Related papers (2025-09-11T17:59:07Z) - Inverse-RLignment: Large Language Model Alignment from Demonstrations through Inverse Reinforcement Learning [62.05713042908654]
We introduce Alignment from Demonstrations (AfD), a novel approach leveraging high-quality demonstration data to overcome these challenges.<n>We formalize AfD within a sequential decision-making framework, highlighting its unique challenge of missing reward signals.<n> Practically, we propose a computationally efficient algorithm that extrapolates over a tailored reward model for AfD.
arXiv Detail & Related papers (2024-05-24T15:13:53Z) - Mimicking Better by Matching the Approximate Action Distribution [48.95048003354255]
We introduce MAAD, a novel, sample-efficient on-policy algorithm for Imitation Learning from Observations.
We show that it requires considerable fewer interactions to achieve expert performance, outperforming current state-of-the-art on-policy methods.
arXiv Detail & Related papers (2023-06-16T12:43:47Z) - Sample-Efficient Reinforcement Learning with Symmetry-Guided Demonstrations for Robotic Manipulation [7.099237102357281]
Reinforcement learning (RL) suffers from low sample efficiency, particularly in high-dimensional continuous state-action spaces.<n>We introduce Demo-EASE, a novel training framework using a dual-buffer architecture that stores both demonstrations and RL-generated experiences.<n>Our results show that Demo-EASE significantly accelerates convergence and improves final performance compared to standard RL baselines.
arXiv Detail & Related papers (2023-04-12T11:38:01Z) - Safe Multi-agent Learning via Trapping Regions [89.24858306636816]
We apply the concept of trapping regions, known from qualitative theory of dynamical systems, to create safety sets in the joint strategy space for decentralized learning.
We propose a binary partitioning algorithm for verification that candidate sets form trapping regions in systems with known learning dynamics, and a sampling algorithm for scenarios where learning dynamics are not known.
arXiv Detail & Related papers (2023-02-27T14:47:52Z) - Human-in-the-Loop Imitation Learning using Remote Teleoperation [72.2847988686463]
We build a data collection system tailored to 6-DoF manipulation settings.
We develop an algorithm to train the policy iteratively on new data collected by the system.
We demonstrate that agents trained on data collected by our intervention-based system and algorithm outperform agents trained on an equivalent number of samples collected by non-interventional demonstrators.
arXiv Detail & Related papers (2020-12-12T05:30:35Z) - AvE: Assistance via Empowerment [77.08882807208461]
We propose a new paradigm for assistance by instead increasing the human's ability to control their environment.
This task-agnostic objective preserves the person's autonomy and ability to achieve any eventual state.
arXiv Detail & Related papers (2020-06-26T04:40:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.