Evaluation of Impression Difference of a Domestic Mobile Manipulator with Autonomous and/or Remote Control in Fetch-and-Carry Tasks
- URL: http://arxiv.org/abs/2512.24029v2
- Date: Sun, 04 Jan 2026 08:57:10 GMT
- Title: Evaluation of Impression Difference of a Domestic Mobile Manipulator with Autonomous and/or Remote Control in Fetch-and-Carry Tasks
- Abstract summary: A single service robot can present two distinct agencies: its onboard autonomy and an operator-mediated agency.<n>We formalize this dual-agency structure as a User-Robot-Operator triad in an autonomous remote-control setting.
- Score: 0.5833117322405447
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A single service robot can present two distinct agencies: its onboard autonomy and an operator-mediated agency, yet users experience them through one physical body. We formalize this dual-agency structure as a User-Robot-Operator triad in an autonomous remote-control setting that integrates teleoperation with autonomous execution and human-in-the-loop remote assistance. Prior to the recent surge of language-based and multimodal interfaces, we developed and evaluated an early-stage prototype in 2020 that combined natural-language text chat with a sketch-based interface enabling freehand on-image annotation over the robot's live camera view to support remote intervention. We evaluated three modes - remote control via teleoperation, autonomous control, and autonomous remote control (a hybrid mode representing different levels of autonomy) - in controlled fetch-and-carry mobile manipulation tasks using a domestic mobile manipulator, the Human Support Robot (HSR), on a World Robot Summit 2020 rule-compliant test field. The results show systematic mode-dependent differences in user-rated affinity and perceived security, indicating that switching or blending agency within one robot measurably shapes human impressions in Human-Robot Interaction (HRI). These findings provide empirical guidance for designing human-in-the-loop mobile manipulation in domestic physical tasks.
Related papers
- One Body, Two Minds: Variable Autonomy Approach for a Co-embodied Robotic Hand [12.945187282872022]
We introduce co-embodiment with variable autonomy, where human and robot share a single physical body.<n>We present a co-embodied, wearable robotic hand that has its own mind'' and operates with variable autonomy levels.
arXiv Detail & Related papers (2026-06-24T08:46:49Z) - ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration [51.69384671495837]
ActiveGlasses is a system for learning robot manipulation from ego-centric human demonstrations with active vision.<n>A stereo camera mounted on smart glasses serves as the sole perception device for both data collection and policy inference.<n>To enable zero-transfer, we extract object trajectories from demonstrations and use an object-centric point-cloud policy to jointly predict manipulation and head movement.
arXiv Detail & Related papers (2026-04-09T17:59:08Z) - AURA: Multimodal Shared Autonomy for Real-World Urban Navigation [49.419374037785815]
Long-horizon navigation in complex urban environments relies heavily on continuous human operation.<n>We present Assistive Urban Robot Autonomy (AURA), a new multi-modal framework that decomposes urban navigation into high-level human instruction and low-level AI control.<n>AURA effectively follows human instructions, reduces manual operation effort, and improves navigation stability, while enabling online adaptation.
arXiv Detail & Related papers (2026-04-02T05:59:31Z) - ZeroWBC: Learning Natural Visuomotor Humanoid Control Directly from Human Egocentric Video [52.78703020909145]
We introduce ZeroWBC, a novel framework that learns a natural humanoid visuomotor control policy directly from human egocentric videos.<n>Our approach first fine-tunes a Vision-Language Model (VLM) to predict future whole-body human motions based on text instructions and egocentric visual context.<n>Experiments on the Unitree G1 humanoid robot demonstrate that our method outperforms baseline approaches in motion naturalness and versatility.
arXiv Detail & Related papers (2026-03-10T04:19:43Z) - Teleoperated Omni-directional Dual Arm Mobile Manipulation Robotic System with Shared Control for Retail Store [0.0]
We introduce an omni-directional dual-arm mobile robot specifically tailored for use in retail environments.<n>We propose a tele-operation method that enables shared control between the robot and a human operator.<n>We validate the efficacy of the proposed system through testing in a mockup of retail environment.
arXiv Detail & Related papers (2026-02-27T11:18:35Z) - Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models [50.19518681574399]
A central challenge in real-world assistive teleoperation is for the robot to infer a wide range of human intentions from user control inputs.<n>We introduce Casper, an assistive teleoperation system that leverages commonsense knowledge embedded in pre-trained visual language models.<n>We show that Casper improves task performance, reduces human cognitive load, and achieves higher user satisfaction than direct teleoperation and assistive teleoperation baselines.
arXiv Detail & Related papers (2025-06-17T17:06:43Z) - Autonomous Human-Robot Interaction via Operator Imitation [3.650193138379926]
We propose to create autonomous interactive robots, by training a model to imitate operator data.<n>Our model is trained on a dataset of human-robot interactions.<n>We show that our method enables simple autonomous human-robot interactions comparable to the expert-operator baseline.
arXiv Detail & Related papers (2025-04-03T16:06:44Z) - Robi Butler: Multimodal Remote Interaction with a Household Robot Assistant [19.28028454264679]
Robi Butler is a new household robot assistant that enables seamless multimodal remote interaction.<n>It allows the human user to monitor its environment from a first-person view, issue voice or text commands, and specify target objects through hand-pointing gestures.
arXiv Detail & Related papers (2024-09-30T17:49:09Z) - Controlling diverse robots by inferring Jacobian fields with deep networks [48.279199537720714]
Mirroring the complex structures and diverse functions of natural organisms is a long-standing challenge in robotics.<n>We introduce a method that uses deep neural networks to map a video stream of a robot to its visuomotor Jacobian field.<n>Our approach achieves accurate closed-loop control and recovers the causal dynamic structure of each robot.
arXiv Detail & Related papers (2024-07-11T17:55:49Z) - Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of
Demonstrations for Social Navigation [92.66286342108934]
Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a'socially compliant' manner in the presence of other intelligent agents such as humans.
Our dataset contains 8.7 hours, 138 trajectories, 25 miles of socially compliant, human teleoperated driving demonstrations.
arXiv Detail & Related papers (2022-03-28T19:09:11Z) - Tethered Aerial Visual Assistance [5.237054164442403]
An autonomous tethered Unmanned Aerial Vehicle (UAV) is developed into a visual assistant in a marsupial co-robots team.
Using a fundamental viewpoint quality theory, a formal risk reasoning framework, and a newly developed tethered motion suite, our visual assistant is able to autonomously navigate to good-quality viewpoints.
The developed marsupial co-robots team could improve tele-operation efficiency in nuclear operations, bomb squad, disaster robots, and other domains.
arXiv Detail & Related papers (2020-01-15T06:41:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.