One Body, Two Minds: Variable Autonomy Approach for a Co-embodied Robotic Hand

• URL: http://arxiv.org/abs/2606.25575v1
• Date: Wed, 24 Jun 2026 08:46:49 GMT
• Title: One Body, Two Minds: Variable Autonomy Approach for a Co-embodied Robotic Hand
• Abstract summary: We introduce co-embodiment with variable autonomy, where human and robot share a single physical body.<n>We present a co-embodied, wearable robotic hand that has its own mind'' and operates with variable autonomy levels.
• Score: 12.945187282872022
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Assistive robotic systems face a fundamental trade-off: fully autonomous systems lack user agency, while fully user-controlled systems demand continuous cognitive effort. Existing shared autonomy approaches blend human and robot commands but are mostly deployed in separate physical bodies. We introduce co-embodiment with variable autonomy, where human and robot share a single physical body and operate at different autonomy levels across task phases, from mutual autonomy during object search and grasping to human-dominant control during actuation. We present a co-embodied, wearable robotic hand that has its own ``mind'' and operates with variable autonomy levels. A learning-from-demonstration visuomotor diffusion policy enables autonomous grasping when the user positions the hand near known objects. Once grasped, the system signals completion and the human can actuate the grasped tool (drill, spray bottle, infrared thermometer, lighter, and ice-cream scoop) via hands-free head gestures. The human retains veto authority at all times through a release gesture that returns the system to the initial phase. Unlike blended autonomy, where control is continuously negotiated, our co-embodied approach consists of variable autonomy from full human control to full independent actions while maintaining physical coupling, realizing a one body, two minds paradigm. In a user study with 44 participants performing five bimanual tasks, users rapidly adapted to this ``two minds'' paradigm: completion times improved by 23.3% across trials ($p < 0.001$, Cohen's $d = 0.94$), the best-performing policy variant reached a 93.6% task success rate, and acceptance ratings were high (5.70/7 overall impression, 5.52/7 daily use willingness). This work establishes co-embodiment with variable autonomy as a viable approach for assistive robotics, enabling human-robot collaboration through co-embodiment.

Related papers

• Ludi${}_{\scriptscriptstyle 0.1}$: An Agentic System for Socially Intelligent Robots [22.26258894927344]
  Ludi$_scriptscriptstyle 0.1$ is an agentic system for socially intelligent robots.<n>It integrates interactive speech, multimodal reasoning, memory, navigation, and learned manipulation.<n>Ludi$_scriptstyle 0.1$ demonstrates a practical path toward fluid human-robot collaboration.
  arXiv  Detail & Related papers  (2026-08-22T16:38:59Z)
• Legible Shared Autonomy: Implicit Communication of Robot Belief through Motion [10.259015383410395]
  Traditional shared autonomy systems provide assistance along efficient shortest paths toward inferred goals.<n>When the robot correctly infers the goal, users continue controlling because they cannot perceive understanding from ambiguous assistive motion.<n>We address this by introducing legible motion into shared autonomy, where robot actions must both advance toward the goal and clearly reveal which goal has been inferred.
  arXiv  Detail & Related papers  (2026-06-29T06:35:21Z)
• Proprioceptive-visual correspondence enables self-other distinction in humanoid robots [45.31013373337145]
  Distinguishing self from others is a prerequisite for social intelligence, yet humanoid robots that increasingly share workspaces with humans still lack this ability.<n>We show that a humanoid robot can learn self-other distinction from proprioceptive-visual correspondence, without any identity labels or kinematic models.
  arXiv  Detail & Related papers  (2026-06-11T11:38:34Z)
• CHORUS: Decentralized Multi-Embodiment Collaboration with One VLA Policy [67.76658561040625]
  CHORUS is a framework that adapts a single vision-language-action (VLA) backbone to control diverse, multi-robot teams.<n>In experiments, CHORUS achieves a 64% point improvement over decentralized, from-scratch models.<n>Results show that a shared VLA backbone is capable of achieving decentralized multi-robot collaboration.
  arXiv  Detail & Related papers  (2026-06-10T17:26:08Z)
• HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos [58.9564236347451]
  HumanEgo is a framework that bridges the embodiment gap between human and robot.<n>It lifts each human demonstration to an entity-level representation of hand-object interaction.<n>HumanEgo is robot-data-free, hardware-agnostic, data-efficient, and zero-shot human-to-robot transferable.
  arXiv  Detail & Related papers  (2026-05-24T08:26:41Z)
• ZeroWBC: Learning Natural Visuomotor Humanoid Control Directly from Human Egocentric Video [52.78703020909145]
  We introduce ZeroWBC, a novel framework that learns a natural humanoid visuomotor control policy directly from human egocentric videos.<n>Our approach first fine-tunes a Vision-Language Model (VLM) to predict future whole-body human motions based on text instructions and egocentric visual context.<n>Experiments on the Unitree G1 humanoid robot demonstrate that our method outperforms baseline approaches in motion naturalness and versatility.
  arXiv  Detail & Related papers  (2026-03-10T04:19:43Z)
• ULTRA: Unified Multimodal Control for Autonomous Humanoid Whole-Body Loco-Manipulation [55.467742403416175]
  We introduce a physics-driven neural algorithm that translates large-scale motion capture to humanoid embodiments.<n>We learn a unified multimodal controller that supports both dense references and sparse task specifications.<n>Results show that ULTRA generalizes to autonomous, goal-conditioned whole-body loco-manipulation from egocentric perception.
  arXiv  Detail & Related papers  (2026-03-03T18:59:29Z)
• Evaluation of Impression Difference of a Domestic Mobile Manipulator with Autonomous and/or Remote Control in Fetch-and-Carry Tasks [0.5833117322405447]
  A single service robot can present two distinct agencies: its onboard autonomy and an operator-mediated agency.<n>We formalize this dual-agency structure as a User-Robot-Operator triad in an autonomous remote-control setting.
  arXiv  Detail & Related papers  (2025-12-30T07:00:30Z)
• TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection System [79.48781507497769]
  Existing humanoid teleoperation systems either use decoupled control or depend on expensive motion capture setups.<n>We introduce TWIST2, a portable, mocap-free humanoid teleoperation and data collection system.<n>We demonstrate long-horizon dexterous and mobile humanoid skills and we can collect 100 demonstrations in 15 minutes with an almost 100% success rate.
  arXiv  Detail & Related papers  (2025-11-04T18:58:35Z)
• TWIST: Teleoperated Whole-Body Imitation System [28.597388162969057]
  We present the Teleoperated Whole-Body Imitation System (TWIST), a system for humanoid teleoperation through whole-body motion imitation.<n>We develop a robust, adaptive, and responsive whole-body controller using a combination of reinforcement learning and behavior cloning.<n>TWIST enables real-world humanoid robots to achieve unprecedented, versatile, and coordinated whole-body motor skills.
  arXiv  Detail & Related papers  (2025-05-05T17:59:03Z)
• Hierarchical generative modelling for autonomous robots [8.023920215148486]
  We show how a humanoid robot can autonomously complete a complex task that requires a holistic use of locomotion, manipulation, and grasping. Specifically, we demonstrate the ability of a humanoid robot that can retrieve and transport a box, open and walk through a door to reach the destination, approach and kick a football, while showing robust performance in presence of body damage and ground irregularities.
  arXiv  Detail & Related papers  (2023-08-15T13:51:03Z)
• Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning [54.636562516974884]
  In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on. In this work, we propose MEDAL++, a novel design for self-improving robotic systems. The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
  arXiv  Detail & Related papers  (2023-03-02T18:51:38Z)
• Non-invasive Cognitive-level Human Interfacing for the Robotic Restoration of Reaching & Grasping [5.985098076571228]
  We present a robotic system for human augmentation, capable of actuating the user's arm and fingers for them. We combine wearable eye tracking, the visual context of the environment and the structural grammar of human actions to create a cognitive-level assistive robotic setup.
  arXiv  Detail & Related papers  (2021-02-25T16:32:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.