Robots that Collaborate: Sequential Asymmetric Imitation for Learning Coupled Robot Policies
- URL: http://arxiv.org/abs/2606.16490v1
- Date: Mon, 15 Jun 2026 09:55:58 GMT
- Title: Robots that Collaborate: Sequential Asymmetric Imitation for Learning Coupled Robot Policies
- Abstract summary: Collaborative mobile manipulation requires robots to coordinate with a partially observed partner.<n>This is difficult because failures often arise from mistimed waiting, yielding, pulling, releasing, or repositioning.<n>We propose Sequential Asymmetric Imitation (SAI), a single-teleoperator curriculum for learning coupled multi-robot behaviors.
- Score: 8.640835924450553
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Collaborative mobile manipulation requires robots to coordinate with a partially observed partner while physically interacting through shared objects. This is difficult because failures often arise not from poor local skills, but from mistimed waiting, yielding, pulling, releasing, or repositioning. We study this problem with two bimanual mobile manipulators coupled through rigid and deformable objects. We propose Sequential Asymmetric Imitation (SAI), a single-teleoperator curriculum for learning coupled multi-robot behaviors without synchronized dual-operator demonstrations or explicit inter-robot communication. SAI trains Robot A from unilateral demonstrations with a compliant human partner, trains Robot B against the deployed Robot A policy, and then refines Robot A using sparse interventions near coordination failures. This staged process exposes the policies to increasingly realistic partner behaviors, including delay, phase mismatch,insufficient yielding, and interaction conflict. Across real-world dual-robot manipulation tasks, SAI improves task success, phase synchronization, and partner-contingent yielding over independent imitation and curriculum-ablation baselines. These results suggest that physically coupled collaboration can be learned through the structure of the imitation curriculum, rather than through synchronized multi-operator demonstrations or explicit coordination mechanisms.Project page:http://cyc0429.github.io/sai-project-page/
Related papers
- CHORUS: Decentralized Multi-Embodiment Collaboration with One VLA Policy [67.76658561040625]
CHORUS is a framework that adapts a single vision-language-action (VLA) backbone to control diverse, multi-robot teams.<n>In experiments, CHORUS achieves a 64% point improvement over decentralized, from-scratch models.<n>Results show that a shared VLA backbone is capable of achieving decentralized multi-robot collaboration.
arXiv Detail & Related papers (2026-06-10T17:26:08Z) - Modular Reinforcement Learning For Cooperative Swarms [0.0]
A cooperative robot swarm is a collective of computationally-limited robots that share a common goal.<n>Recent advances in distributed multi-agent reinforcement learning have demonstrated that it is possible for robots to learn how to interact effectively with others.<n>This paper proposes an alternative approach for representing spatial interaction states for reinforcement learning in swarms.
arXiv Detail & Related papers (2026-05-06T14:05:36Z) - Morphology-Consistent Humanoid Interaction through Robot-Centric Video Synthesis [25.249184346335557]
Dream2Act is a robot-centric framework enabling zero-shot interaction through generative video.<n> operating strictly within the robot-native space, Dream2Act avoids errors and eliminates task-specific policy training.
arXiv Detail & Related papers (2026-03-20T07:27:09Z) - Adaptive Vision-Based Control of Redundant Robots with Null-Space Interaction for Human-Robot Collaboration [7.779638839381672]
Human-robot collaboration aims to extend human ability through cooperation with robots.<n>Being able to enhance the performance of both sides, such that human-robot collaboration outperforms a single robot/human, remains an open issue.<n>New control scheme has been proposed for redundant robots, consisting of an adaptive vision-based control term in task space and an interactive control term in null space.
arXiv Detail & Related papers (2026-03-09T08:30:14Z) - Fault-Tolerant Multi-Robot Coordination with Limited Sensing within Confined Environments [0.6144680854063939]
We propose a novel fault-tolerance technique leveraging physical contact interactions in multi-robot systems.<n>We introduce the "Active Contact Response" (ACR) method, where each robot modulates its behavior based on the likelihood of encountering an inoperative (faulty) robot.
arXiv Detail & Related papers (2025-05-21T02:43:36Z) - HACTS: a Human-As-Copilot Teleoperation System for Robot Learning [47.9126187195398]
We introduce HACTS (Human-As-Copilot Teleoperation System), a novel system that establishes bilateral, real-time joint synchronization between a robot arm and teleoperation hardware.<n>This simple yet effective feedback mechanism, akin to a steering wheel in autonomous vehicles, enables the human copilot to intervene seamlessly while collecting action-correction data for future learning.
arXiv Detail & Related papers (2025-03-31T13:28:13Z) - Rethinking Bimanual Robotic Manipulation: Learning with Decoupled Interaction Framework [51.39847596489193]
Bimanual robotic manipulation is an emerging and critical topic in the robotics community.<n>We propose a novel decoupled interaction framework that considers the characteristics of different tasks in bimanual manipulation.<n>Our framework achieves outstanding performance, with a 23.5% boost over the SOTA method.
arXiv Detail & Related papers (2025-03-12T09:28:41Z) - Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models [81.55156507635286]
Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions.
Current learning methods often struggle with generalization to the long tail of unexpected situations without heavy human supervision.
We propose a system, VLM-Predictive Control (VLM-PC), combining two key components that we find to be crucial for eliciting on-the-fly, adaptive behavior selection.
arXiv Detail & Related papers (2024-07-02T21:00:30Z) - LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control [72.81786007015471]
We propose a learnable Perception-Action-Communication (LPAC) architecture for the problem.<n>CNN processes localized perception; a graph neural network (GNN) facilitates robot communications.<n> Evaluations show that the LPAC models outperform standard decentralized and centralized coverage control algorithms.
arXiv Detail & Related papers (2024-01-10T00:08:00Z) - Show Me What You Can Do: Capability Calibration on Reachable Workspace
for Human-Robot Collaboration [83.4081612443128]
We show that a short calibration using REMP can effectively bridge the gap between what a non-expert user thinks a robot can reach and the ground-truth.
We show that this calibration procedure not only results in better user perception, but also promotes more efficient human-robot collaborations.
arXiv Detail & Related papers (2021-03-06T09:14:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.