Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI

• URL: http://arxiv.org/abs/2608.26182v1
• Date: Fri, 21 Aug 2026 07:14:56 GMT
• Title: Why did My Robot Just Change Personality? Prompting Guidelines for a Grounded Robot Persona in LLM-Based HRI
• Abstract summary: Large language models (LLMs) are increasingly used for verbal interaction in social robots.<n>Yet prompt design in human-robot interaction (HRI) remains underspecified.<n>This paper develops a framework for prompt design in LLM-based robots.
• Score: 11.36847822681712
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language models (LLMs) are increasingly used for verbal interaction in social robots, yet prompt design in human-robot interaction (HRI) remains underspecified. As a result, robots may present hallucinated capabilities, unclear behavioural boundaries, and misleading personas. This paper develops a framework for prompt design in LLM-based robots and introduces a structured prompt template comprising eight functional components through which robot behaviour can be specified, bounded, and adapted. The framework is grounded in a review of prior LLM-based HRI work and complemented by survey and discussion data from HRI experts gathered at the Robo-Identity workshop at IEEE RO-MAN 2025 (N=27). The qualitative findings highlight limited legibility of robot personality, the need for user adaptation, and strong ethical concerns about safety, deception, and governance. Based on these findings, we present prompting guidelines accompanied by proof-of-concept template as a structured design and reporting aid for HRI research. We argue that prompt design should be treated as a socio-technical problem rather than a minor implementation detail, requiring explicit capability boundaries, transparent behavioural assumptions, and context-sensitive safeguards to support reliable and interpretable HRI.

Related papers

• Explainable OOHRI: Communicating Robot Capabilities and Limitations as Augmented Reality Affordances [5.363623643280699]
  We present X-OOHRI, an augmented reality (AR) interface that conveys robot action possibilities and constraints.<n>Our system encodes object properties and robot limits into object-oriented structures using a vision-language model.<n>We integrate the end-to-end pipeline with a physical robot and showcase diverse use cases ranging from low-level pick-and-place to high-level instructions.
  arXiv  Detail & Related papers  (2026-01-21T01:53:47Z)
• Theory of Mind for Explainable Human-Robot Interaction [11.35521581811494]
  Theory of Mind (ToM) is intended to serve as a user-friendly backend to the interface of robotic systems.<n>XAI aims to make AI systems transparent and interpretable, allowing humans to understand and interact with them effectively.
  arXiv  Detail & Related papers  (2025-12-29T14:09:05Z)
• RobotSeg: A Model and Dataset for Segmenting Robots in Image and Video [56.9581053843815]
  We introduce RobotSeg, a foundation model for robot segmentation in image and video.<n>It addresses the lack of adaptation to articulated robots, reliance on manual prompts, and the need for per-frame training mask annotations.<n>It achieves state-of-the-art performance on both images and videos.
  arXiv  Detail & Related papers  (2025-11-28T07:51:02Z)
• Heterogeneous Robot Collaboration in Unstructured Environments with Grounded Generative Intelligence [54.91177026001217]
  Large language model (LLM)-enabled teaming methods typically assume well-structured and known environments.<n>We present SPINE-HT, a framework that addresses these limitations by grounding the reasoning abilities of LLMs in the context of a heterogeneous robot team.<n>Our framework achieves nearly twice the success rate compared to prior LLM-enabled heterogeneous teaming approaches.
  arXiv  Detail & Related papers  (2025-10-30T18:24:38Z)
• HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario [63.77482302352545]
  HHI-Assist is a dataset comprising motion capture clips of human-human interactions in assistive tasks.<n>Our work has the potential to significantly enhance robotic assistance policies.
  arXiv  Detail & Related papers  (2025-09-12T09:38:17Z)
• Whom to Respond To? A Transformer-Based Model for Multi-Party Social Robot Interaction [4.276453870301421]
  We propose a Transformer-based multi-task learning framework to improve the decision-making process of social robots.<n>We construct a novel multi-party HRI dataset that captures real-world complexities, such as gaze misalignment.<n>Our findings contribute to the development of socially intelligent social robots capable of engaging in natural and context-aware multi-party interactions.
  arXiv  Detail & Related papers  (2025-07-15T03:42:14Z)
• Personalised Explanations in Long-term Human-Robot Interactions [13.471816696693553]
  Human-Robot Interaction (XHRI) investigates methods to generate explanations and evaluate their impact on human-robot interactions.<n>Previous works have highlighted the need to personalise the level of detail of these explanations to enhance usability and comprehension.<n>Our paper presents a framework designed to update and retrieve user knowledge-memory models, allowing for adapting the explanations' level of detail while referencing previously acquired concepts.
  arXiv  Detail & Related papers  (2025-07-03T10:40:39Z)
• HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams [2.6627293764668902]
  This paper describes a cognitive-robotic architecture that integrates the OntoAgent cognitive framework with general-purpose robot control systems applied to human-robot teaming (HRT)<n>HarMONIC incorporates metacognition, meaningful natural language communication, and explainability capabilities required for developing mutual trust in HRT.
  arXiv  Detail & Related papers  (2024-09-26T16:48:21Z)
• Socially Pertinent Robots in Gerontological Healthcare [81.67026771075037]
  This paper is an attempt to partially answer the question, via two waves of experiments with patients and companions in a day-care gerontological facility in Paris with a full-sized humanoid robot endowed with social and conversational interaction capabilities.<n>Overall, the users are receptive to this technology, especially when the robot perception and action skills are robust to environmental clutter and flexible to handle a plethora of different interactions.
  arXiv  Detail & Related papers  (2024-04-11T08:43:37Z)
• Common (good) practices measuring trust in HRI [55.2480439325792]
  Trust in robots is widely believed to be imperative for the adoption of robots into people's daily lives. Researchers have been exploring how people trust robot in different ways. Most roboticists agree that insufficient levels of trust lead to a risk of disengagement.
  arXiv  Detail & Related papers  (2023-11-20T20:52:10Z)
• Proceeding of the 1st Workshop on Social Robots Personalisation At the crossroads between engineering and humanities (CONCATENATE) [37.838596863193565]
  This workshop aims to raise an interdisciplinary discussion on personalisation in robotics. It aims at bringing researchers from different fields together to propose guidelines for personalisation.
  arXiv  Detail & Related papers  (2023-07-10T11:11:24Z)
• The Road to a Successful HRI: AI, Trust and ethicS-TRAITS [65.60507052509406]
  The aim of this workshop is to give researchers from academia and industry the possibility to discuss the inter-and multi-disciplinary nature of the relationships between people and robots.
  arXiv  Detail & Related papers  (2021-03-23T16:52:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.