PAINT: Partner-Agnostic Intent-Aware Cooperative Transport with Legged Robots
- URL: http://arxiv.org/abs/2604.12852v1
- Date: Tue, 14 Apr 2026 15:06:38 GMT
- Title: PAINT: Partner-Agnostic Intent-Aware Cooperative Transport with Legged Robots
- Abstract summary: Collaborative transport requires robots to infer partner intent through physical interaction while maintaining stable loco-manipulation.<n>We present a lightweight yet efficient hierarchical learning framework for partner-agonistic intent-aware collaborative legged transport that infers partner intent directly from proprioceptive feedback.<n>Our results suggest that proprioceptive signals in payload-coupled interaction provide a scalable interface for partner-agnostic intent-aware collaborative transport.
- Score: 29.217220708128025
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Collaborative transport requires robots to infer partner intent through physical interaction while maintaining stable loco-manipulation. This becomes particularly challenging in complex environments, where interaction signals are difficult to capture and model. We present PAINT, a lightweight yet efficient hierarchical learning framework for partner-agonistic intent-aware collaborative legged transport that infers partner intent directly from proprioceptive feedback. PAINT decouples intent understanding from terrain-robust locomotion: A high-level policy infers the partner interaction wrench using an intent estimator and a teacher-student training scheme, while a low-level locomotion backbone ensures robust execution. This enables lightweight deployment without external force-torque sensing or payload tracking. Extensive simulation and real-world experiments demonstrate compliant cooperative transport across diverse terrains, payloads, and partners. Furthermore, we show that PAINT naturally scales to decentralized multi-robot transport and transfers across robot embodiments by swapping the underlying locomotion backbone. Our results suggest that proprioceptive signals in payload-coupled interaction provide a scalable interface for partner-agnostic intent-aware collaborative transport.
Related papers
- VAIC: Vision-Guided Humanoid Agile Object Interaction Control via Decoupled Commands [56.029505206531155]
Vision Guided Agile Interaction Control (VAIC) is a unified framework that bridges the gap between current controllers and humanoid robots.<n>First, a privileged teacher policy masters diverse interaction skills using precise object kinematics and exact environmental states.<n>Second, a deployable student policy distills these capabilities by replacing full body tracking with velocity targets across multiple axes.
arXiv Detail & Related papers (2026-06-08T09:52:55Z) - SynAgent: Generalizable Cooperative Humanoid Manipulation via Solo-to-Cooperative Agent Synergy [59.86199649493784]
Controllable cooperative humanoid manipulation is a fundamental yet challenging problem for embodied intelligence.<n>We present SynAgent, a framework that enables scalable and physically plausible cooperative manipulation.<n>In experiments, SynAgent significantly outperforms existing baselines in both cooperative imitation and trajectory-conditioned control.
arXiv Detail & Related papers (2026-04-20T17:46:20Z) - ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration [51.69384671495837]
ActiveGlasses is a system for learning robot manipulation from ego-centric human demonstrations with active vision.<n>A stereo camera mounted on smart glasses serves as the sole perception device for both data collection and policy inference.<n>To enable zero-transfer, we extract object trajectories from demonstrations and use an object-centric point-cloud policy to jointly predict manipulation and head movement.
arXiv Detail & Related papers (2026-04-09T17:59:08Z) - CoEnv: Driving Embodied Multi-Agent Collaboration via Compositional Environment [54.84167973913561]
CoEnv is a framework that leverages simulation for safe strategy exploration while ensuring reliable real-world deployment.<n>CoEnv operates through three stages: real-to-sim scene reconstruction that digitizes physical workspaces, VLM-driven action synthesis supporting both real-time planning with code-based trajectory generation, and validated sim-to-real transfer with collision detection for safe deployment.
arXiv Detail & Related papers (2026-04-07T06:24:41Z) - Learning Whole-Body Control for a Salamander Robot [1.321203201549798]
Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments.<n>Most salamander robots relied on central-pattern-generator (CPG)-based and model-based coordination strategies for locomotion control.<n>We employ Reinforcement Learning to map proprioceptive observations and commanded velocities to joint-level actions, allowing coordinated locomotor behaviors to emerge.
arXiv Detail & Related papers (2026-03-17T15:43:15Z) - Load-Aware Locomotion Control for Humanoid Robots in Industrial Transportation Tasks [19.55626538861657]
This paper presents a load-aware locomotion framework for industrial humanoids based on a decoupled yet coordinated loco-manipulation architecture.<n>Lower-body locomotion is controlled via a reinforcement learning policy producing residual joint actions on kinematically derived nominal configurations.<n>The framework is trained entirely in simulation and deployed on a full-size humanoid robot without fine-tuning.
arXiv Detail & Related papers (2026-03-15T09:57:32Z) - Interaction-Aware Whole-Body Control for Compliant Object Transport [33.233203393813376]
This paper proposes an interaction-oriented whole-body control (IO-WBC) that functions as an artificial cerebellum.<n>IO-WBC translates upstream (skill-level) commands into stable, physically consistent whole-body behavior under contact.
arXiv Detail & Related papers (2026-03-04T05:50:40Z) - PILOT: A Perceptive Integrated Low-level Controller for Loco-manipulation over Unstructured Scenes [18.916978556216097]
PILOT is a single-stage reinforcement learning framework tailored for perceptive loco-manipulation.<n>It synergizes perceptive locomotion and expansive whole-body control within a single policy.<n> PILOT demonstrates superior stability, command tracking precision, and terrain traversability compared to existing baselines.
arXiv Detail & Related papers (2026-01-24T12:25:20Z) - Efficient and Compliant Control Framework for Versatile Human-Humanoid Collaborative Transportation [2.4087148947930634]
We present a control framework that enables humanoid robots to perform collaborative transportation tasks with a human partner.<n>The framework supports both translational and rotational motions, which are fundamental to co-transport scenarios.<n>It comprises three components: a high-level planner, a low-level controller, and a stiffness modulation mechanism.
arXiv Detail & Related papers (2025-12-08T18:52:10Z) - HOSIG: Full-Body Human-Object-Scene Interaction Generation with Hierarchical Scene Perception [57.37135310143126]
HO SIG is a novel framework for synthesizing full-body interactions through hierarchical scene perception.<n>Our framework supports unlimited motion length through autoregressive generation and requires minimal manual intervention.<n>This work bridges the critical gap between scene-aware navigation and dexterous object manipulation.
arXiv Detail & Related papers (2025-06-02T12:08:08Z) - InterControl: Zero-shot Human Interaction Generation by Controlling Every Joint [67.6297384588837]
We introduce a novel controllable motion generation method, InterControl, to encourage the synthesized motions maintaining the desired distance between joint pairs.
We demonstrate that the distance between joint pairs for human-wise interactions can be generated using an off-the-shelf Large Language Model.
arXiv Detail & Related papers (2023-11-27T14:32:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.