StARS: Socially Appropriate Robot Actions via a Recommender System-Driven Approach
- URL: http://arxiv.org/abs/2607.21802v1
- Date: Thu, 23 Jul 2026 20:38:07 GMT
- Title: StARS: Socially Appropriate Robot Actions via a Recommender System-Driven Approach
- Abstract summary: We reformulate socially appropriate action generation as a preference modelling problem inspired by recommender systems.<n>We propose StARS, a novel model-agnostic framework that integrates collaborative filtering with learnable scene representations.<n>We evaluate StARS on two socially aware robotics datasets, MannersDB+ and SocNav1, and analyse robustness under sparse preference feedback.
- Score: 9.290474217180407
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Social appropriateness in human-robot interaction (HRI) is not universal: different people can judge the same robot action differently in the same situation. To capture this inter-subject variability, we reformulate socially appropriate action generation as a preference modelling problem inspired by recommender systems, treating annotators as users, contexts/scenes as items, and appropriateness scores over a set of candidate robot actions as targets. We propose StARS, a novel model-agnostic framework that integrates collaborative filtering with learnable scene representations to generate user-specific appropriateness scores over candidate robot actions. StARS is model-agnostic: it can be integrated with various scene encoders and backbones, enabling personalisation without redesigning the underlying model. We evaluate StARS on two socially aware robotics datasets, MannersDB+ and SocNav1, and analyse robustness under sparse preference feedback. Across datasets and backbones, StARS consistently improves performance and agreement with annotators, supporting personalised action selection aligned with user norms. Our code is publicly available at https://github.com/Cambridge-AFAR/StARS.git.
Related papers
- AnyWorld: Factorized Egocentric World Models for Cross-Embodiment Generalization [88.25615187835321]
We propose AnyWorld, a cross-embodiment world modeling framework.<n>Our model factorizes an interaction into action, camera, and embodiment.<n>We train the model with large-scale human interaction pretraining.
arXiv Detail & Related papers (2026-08-29T12:55:15Z) - The Embodiment Gap in Robot Foundation Models [7.90590547085857]
In robotics, a model can generalize while work still remains before it can run on a robot with a particular body.<n>We call the gap between reusable models, representations, or data and their use in execution on the target robot the embodiment gap.<n>This survey examines what can be reused across robot embodiments and what must still be implemented on a new robot.
arXiv Detail & Related papers (2026-08-19T01:55:04Z) - How Should I Pick a Foundation Model for My Robot? In Favor of a Community Evaluation Framework for Social Robots [8.113321376993298]
We identify five evaluation dimensions for foundation models in social robots.<n>We propose a three-tiered evaluation funnel paradigm that first filters with general metrics, then extends to simulated interactions, and terminates in more expensive, robot-specific evaluation.
arXiv Detail & Related papers (2026-08-07T07:33:25Z) - Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data [60.94418315274988]
Ego2Robot supports both curated and in-the-wild videos, producing 18,561 hours of robot training data spanning 15 robot morphologies.<n>Joint pretraining on Ego2Robot-synthesized and robot data consistently improves out-of-distribution generalization across multiple types.
arXiv Detail & Related papers (2026-08-03T17:52:26Z) - The Robot's Inner Critic: Self-Refinement of Social Behaviors through VLM-based Replanning [2.38295275136047]
CRISP (Critique-and-Replan for Interactive Social Presence) is an autonomous framework where a robot critiques and replans its own actions.<n>CRISP integrates (1) extraction of movable joints and constraints by analyzing the robot's description file.<n>It can generate subtly different, human-like motions on various platforms using only the robot's structure file.
arXiv Detail & Related papers (2026-03-20T17:40:21Z) - Reimagining Social Robots as Recommender Systems: Foundations, Framework, and Applications [10.149175659152474]
Personalization in social robots refers to the ability of the robot to meet the needs and/or preferences of an individual user.<n>Existing approaches fall short of comprehensively capturing user preferences.<n>We propose drawing on recommender systems (RSs), which specialize in modeling user preferences and providing personalized recommendations.
arXiv Detail & Related papers (2026-01-27T16:25:56Z) - Real-Time Human-Robot Interaction Intent Detection Using RGB-based Pose and Emotion Cues with Cross-Camera Model Generalization [0.8839687029212673]
Service robots in public spaces require real-time understanding of human behavioral intentions for natural interaction.<n>We present a framework for frame-accurate human-robot interaction intent detection that fuses camera-invariant 2D skeletal pose and facial emotion features extracted from monocular RGB video.
arXiv Detail & Related papers (2025-12-18T08:44:22Z) - Action Flow Matching for Continual Robot Learning [54.10050120844738]
Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks.<n>We introduce a generative framework leveraging flow matching for online robot dynamics model alignment.<n>We find that by transforming the actions themselves rather than exploring with a misaligned model, the robot collects informative data more efficiently.
arXiv Detail & Related papers (2025-04-25T16:26:15Z) - Promptable Behaviors: Personalizing Multi-Objective Rewards from Human
Preferences [53.353022588751585]
We present Promptable Behaviors, a novel framework that facilitates efficient personalization of robotic agents to diverse human preferences.
We introduce three distinct methods to infer human preferences by leveraging different types of interactions.
We evaluate the proposed method in personalized object-goal navigation and flee navigation tasks in ProcTHOR and RoboTHOR.
arXiv Detail & Related papers (2023-12-14T21:00:56Z) - CARPE-ID: Continuously Adaptable Re-identification for Personalized
Robot Assistance [16.948256303861022]
In today's Human-Robot Interaction (HRI) scenarios, a prevailing tendency exists to assume that the robot shall cooperate with the closest individual.
We propose a person re-identification module based on continual visual adaptation techniques.
We test the framework singularly using recorded videos in a laboratory environment and an HRI scenario by a mobile robot.
arXiv Detail & Related papers (2023-10-30T10:24:21Z) - What Matters to You? Towards Visual Representation Alignment for Robot
Learning [81.30964736676103]
When operating in service of people, robots need to optimize rewards aligned with end-user preferences.
We propose Representation-Aligned Preference-based Learning (RAPL), a method for solving the visual representation alignment problem.
arXiv Detail & Related papers (2023-10-11T23:04:07Z) - Proceeding of the 1st Workshop on Social Robots Personalisation At the
crossroads between engineering and humanities (CONCATENATE) [37.838596863193565]
This workshop aims to raise an interdisciplinary discussion on personalisation in robotics.
It aims at bringing researchers from different fields together to propose guidelines for personalisation.
arXiv Detail & Related papers (2023-07-10T11:11:24Z) - Continuous ErrP detections during multimodal human-robot interaction [2.5199066832791535]
We implement a multimodal human-robot interaction (HRI) scenario, in which a simulated robot communicates with its human partner through speech and gestures.
The human partner, in turn, evaluates whether the robot's verbal announcement (intention) matches the action (pointing gesture) chosen by the robot.
In intrinsic evaluations of robot actions by humans, evident in the EEG, were recorded in real time, continuously segmented online and classified asynchronously.
arXiv Detail & Related papers (2022-07-25T15:39:32Z) - Model Predictive Control for Fluid Human-to-Robot Handovers [50.72520769938633]
Planning motions that take human comfort into account is not a part of the human-robot handover process.
We propose to generate smooth motions via an efficient model-predictive control framework.
We conduct human-to-robot handover experiments on a diverse set of objects with several users.
arXiv Detail & Related papers (2022-03-31T23:08:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.