Towards Senior-Robot Interaction: Reactive Robot Dog Gestures

• URL: http://arxiv.org/abs/2512.17136v2
• Date: Mon, 22 Dec 2025 15:50:31 GMT
• Title: Towards Senior-Robot Interaction: Reactive Robot Dog Gestures
• Abstract summary: We introduce a senior-oriented system for quadruped robots that allows for more intuitive user input and provides more socially expressive output.<n>For user input, we implemented a MediaPipe-based module for hand gesture and head movement recognition, enabling control without a remote.<n>For output, we designed and trained robotic dog gestures using curriculum-based reinforcement learning in Isaac Gym.
• Score: 0.9458819778148636
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As the global population ages, many seniors face the problem of loneliness. Companion robots offer a potential solution. However, current companion robots often lack advanced functionality, while task-oriented robots are not designed for social interaction, limiting their suitability and acceptance by seniors. Our work introduces a senior-oriented system for quadruped robots that allows for more intuitive user input and provides more socially expressive output. For user input, we implemented a MediaPipe-based module for hand gesture and head movement recognition, enabling control without a remote. For output, we designed and trained robotic dog gestures using curriculum-based reinforcement learning in Isaac Gym, progressing from simple standing to three-legged balancing and leg extensions, and more. The final tests achieved over 95\% success on average in simulation, and we validated a key social gesture (the paw-lift) on a Unitree robot. Real-world tests demonstrated the feasibility and social expressiveness of this framework, while also revealing sim-to-real challenges in joint compliance, load distribution, and balance control. These contributions advance the development of practical quadruped robots as social companions for the senior and outline pathways for sim-to-real adaptation and inform future user studies.

Related papers

• A Glimpse into Long-term Physical Coexistence with Intelligent Robots [12.275897522668858]
  PHILIA is a multi-robot agent built around a robot gateway abstraction.<n>It decouples low-frequency, high-semantic agent reasoning from high-frequency, low-level robot execution.<n>We present representative use cases in which agent memory and scene understanding are grounded in robot actions.
  arXiv  Detail & Related papers  (2026-07-13T10:40:32Z)
• HumanX: Toward Agile and Generalizable Humanoid Interaction Skills from Human Videos [74.43500240121476]
  We present HumanX, a full-stack framework that compiles human video into generalizable, real-world interaction skills for humanoids.<n>HumanX achieves over 8 times higher generalization success than prior methods.
  arXiv  Detail & Related papers  (2026-02-02T18:53:01Z)
• Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations [52.29884993824894]
  Learning multi-fingered robot policies from humans performing daily tasks in natural environments has long been a grand goal in the robotics community.<n>AINA enables learning multi-fingered policies from data collected by anyone, anywhere, and in any environment using Aria Gen 2 glasses.
  arXiv  Detail & Related papers  (2025-11-20T18:59:02Z)
• Towards Human-level Intelligence via Human-like Whole-Body Manipulation [10.199110135230674]
  We present Astribot Suite, a robot learning suite for whole-body manipulation aimed at general daily tasks across diverse environments.<n>Our results show that Astribot's cohesive integration of embodiment, teleoperation interface, and learning pipeline marks a significant step towards real-world, general-purpose whole-body robotic manipulation.
  arXiv  Detail & Related papers  (2025-07-23T02:23:41Z)
• HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation [50.616995671367704]
  We present a high-dimensional, simulated robot learning benchmark, HumanoidBench, featuring a humanoid robot equipped with dexterous hands. Our findings reveal that state-of-the-art reinforcement learning algorithms struggle with most tasks, whereas a hierarchical learning approach achieves superior performance when supported by robust low-level policies.
  arXiv  Detail & Related papers  (2024-03-15T17:45:44Z)
• Robot Interaction Behavior Generation based on Social Motion Forecasting for Human-Robot Interaction [9.806227900768926]
  We propose to model social motion forecasting in a shared human-robot representation space. ECHO operates in the aforementioned shared space to predict the future motions of the agents encountered in social scenarios. We evaluate our model in multi-person and human-robot motion forecasting tasks and obtain state-of-the-art performance by a large margin.
  arXiv  Detail & Related papers  (2024-02-07T11:37:14Z)
• Exploring AI-enhanced Shared Control for an Assistive Robotic Arm [4.999814847776098]
  In particular, we explore how Artifical Intelligence (AI) can be integrated into a shared control paradigm. In particular, we focus on the consequential requirements for the interface between human and robot.
  arXiv  Detail & Related papers  (2023-06-23T14:19:56Z)
• Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning [54.636562516974884]
  In imitation and reinforcement learning, the cost of human supervision limits the amount of data that robots can be trained on. In this work, we propose MEDAL++, a novel design for self-improving robotic systems. The robot autonomously practices the task by learning to both do and undo the task, simultaneously inferring the reward function from the demonstrations.
  arXiv  Detail & Related papers  (2023-03-02T18:51:38Z)
• Model Predictive Control for Fluid Human-to-Robot Handovers [50.72520769938633]
  Planning motions that take human comfort into account is not a part of the human-robot handover process. We propose to generate smooth motions via an efficient model-predictive control framework. We conduct human-to-robot handover experiments on a diverse set of objects with several users.
  arXiv  Detail & Related papers  (2022-03-31T23:08:20Z)
• Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation [92.66286342108934]
  Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a'socially compliant' manner in the presence of other intelligent agents such as humans. Our dataset contains 8.7 hours, 138 trajectories, 25 miles of socially compliant, human teleoperated driving demonstrations.
  arXiv  Detail & Related papers  (2022-03-28T19:09:11Z)
• A General, Evolution-Inspired Reward Function for Social Robotics [0.0]
  We present the Social Reward Function as a mechanism to provide a real-time, dense reward function necessary for the deployment of reinforcement learning agents in social robotics. The Social Reward Function is designed to closely mimic those genetically endowed social perception capabilities of humans in an effort to provide a simple, stable and culture-agnostic reward function.
  arXiv  Detail & Related papers  (2022-02-01T18:05:31Z)
• Social Navigation with Human Empowerment driven Deep Reinforcement Learning [20.815007485176615]
  The next generation of mobile robots needs to be socially-compliant to be accepted by their human collaborators. In this paper, we go beyond the approach of classical acfRL and provide our agent with intrinsic motivation using empowerment. Our approach has a positive influence on humans, as it minimizes its distance to humans and thus decreases human travel time while moving efficiently towards its own goal.
  arXiv  Detail & Related papers  (2020-03-18T11:16:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.