A Service Robot's Guide to Interacting with Busy Customers

• URL: http://arxiv.org/abs/2512.17241v1
• Date: Fri, 19 Dec 2025 05:05:14 GMT
• Title: A Service Robot's Guide to Interacting with Busy Customers
• Abstract summary: This study investigates the efficacy of communication modalities by service robots in capturing attention and communicating intention.<n>We conducted a two-part user study using a Temi robot to simulate delivery tasks.<n>Participants rated visual as the most effective modality for intention clarity, followed by speech, with micromotion being the lowest ranked.
• Score: 1.9065922743901067
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The growing use of service robots in hospitality highlights the need to understand how to effectively communicate with pre-occupied customers. This study investigates the efficacy of commonly used communication modalities by service robots, namely, acoustic/speech, visual display, and micromotion gestures in capturing attention and communicating intention with a user in a simulated restaurant scenario. We conducted a two-part user study (N=24) using a Temi robot to simulate delivery tasks, with participants engaged in a typing game (MonkeyType) to emulate a state of busyness. The participants' engagement in the typing game is measured by words per minute (WPM) and typing accuracy. In Part 1, we compared non-verbal acoustic cue versus baseline conditions to assess attention capture during a single-cup delivery task. In Part 2, we evaluated the effectiveness of speech, visual display, micromotion and their multimodal combination in conveying specific intentions (correct cup selection) during a two-cup delivery task. The results indicate that, while speech is highly effective in capturing attention, it is less successful in clearly communicating intention. Participants rated visual as the most effective modality for intention clarity, followed by speech, with micromotion being the lowest ranked.These findings provide insights into optimizing communication strategies for service robots, highlighting the distinct roles of attention capture and intention communication in enhancing user experience in dynamic hospitality settings.

Related papers

• ExpressMM: Expressive Mobile Manipulation Behaviors in Human-Robot Interactions [3.7698603952231777]
  We develop the novel ExpressMM framework to generate expressive robot behaviors during human-robot interactions.<n>We demonstrate ExpressMM on a mobile manipulator assisting a human in a collaborative assembly scenario.<n>Results show that the ExpressMM-enabled expressive behaviors helped observers clearly interpret the robot's actions and intentions.
  arXiv  Detail & Related papers  (2026-04-07T01:46:55Z)
• Do Robots Need Body Language? Comparing Communication Modalities for Legible Motion Intent in Human-Shared Spaces [22.039354879428497]
  High-DoF robots exhibit motion that people read as expressive, intentionally or not, making it important to understand how such cues are perceived.<n>We present an online video study evaluating how different signaling modalities, expressive motion, lights, text, and audio, shape people's ability to understand a quadruped robot's upcoming navigation actions.
  arXiv  Detail & Related papers  (2026-04-03T20:53:05Z)
• Mind the Style: Impact of Communication Style on Human-Chatbot Interaction [8.656732143142756]
  We describe the results of a between-subject user study where participants interact with NAVI.<n>One version is friendly and supportive, while the other is direct and task-focused.<n>Our results show that the friendly style increases subjective satisfaction and significantly improves task completion rates among female participants only.
  arXiv  Detail & Related papers  (2026-02-19T21:32:41Z)
• Bidirectional Human-Robot Communication for Physical Human-Robot Interaction [13.222878560524896]
  BRIDGE is a system for bidirectional human-robot communication in physical assistance.<n>Our method allows users to modify a robot's planned trajectory in real time using natural language.<n>Our system provides verbal feedback in response to the user, either assuring any resulting changes or posing a clarifying question.
  arXiv  Detail & Related papers  (2026-01-15T19:01:02Z)
• Using Vision-Language Models as Proxies for Social Intelligence in Human-Robot Interaction [16.018759023223502]
  We analyze how people signal interaction readiness through nonverbal behaviors and how expert wizards use these cues to guide engagement.<n>We propose a two-stage pipeline in which lightweight perceptual detectors are used to selectively trigger heavier video-based vision-language model (VLM) queries.<n>Our findings suggest that selectively using VLMs as proxies for social reasoning enables socially responsive robot behavior.
  arXiv  Detail & Related papers  (2025-12-08T05:17:58Z)
• RoboOmni: Proactive Robot Manipulation in Omni-modal Context [165.09049429566238]
  We introduce cross-modal contextual instructions, a new setting where intent is derived from spoken dialogue, environmental sounds, and visual cues rather than explicit commands.<n>We present RoboOmni, a framework based on end-to-end omni-modal LLMs that unifies intention recognition, interaction confirmation, and action execution.<n>Experiments in simulation and real-world settings show that Robo Omni surpasses text- and ASR-based baselines in success rate, inference speed, intention recognition, and proactive assistance.
  arXiv  Detail & Related papers  (2025-10-27T18:49:03Z)
• Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration [3.5408317027307055]
  Collaborative robots must effectively communicate their internal state to humans to enable a smooth interaction. We propose a reinforcement learning algorithm based on noisy human feedback to produce accurately interpreted nonverbal auditory expressions.
  arXiv  Detail & Related papers  (2024-04-30T04:18:21Z)
• Self-Explainable Affordance Learning with Embodied Caption [63.88435741872204]
  We introduce Self-Explainable Affordance learning (SEA) with embodied caption. SEA enables robots to articulate their intentions and bridge the gap between explainable vision-language caption and visual affordance learning. We propose a novel model to effectively combine affordance grounding with self-explanation in a simple but efficient manner.
  arXiv  Detail & Related papers  (2024-04-08T15:22:38Z)
• GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment [72.96949760114575]
  We propose a novel cooperative communication framework, Goal-Oriented Mental Alignment (GOMA)<n>GOMA formulates verbal communication as a planning problem that minimizes the misalignment between parts of agents' mental states that are relevant to the goals.<n>We evaluate our approach against strong baselines in two challenging environments, Overcooked (a multiplayer game) and VirtualHome (a household simulator)
  arXiv  Detail & Related papers  (2024-03-17T03:52:52Z)
• Attention-based Interactive Disentangling Network for Instance-level Emotional Voice Conversion [81.1492897350032]
  Emotional Voice Conversion aims to manipulate a speech according to a given emotion while preserving non-emotion components. We propose an Attention-based Interactive diseNtangling Network (AINN) that leverages instance-wise emotional knowledge for voice conversion.
  arXiv  Detail & Related papers  (2023-12-29T08:06:45Z)
• Real-time Addressee Estimation: Deployment of a Deep-Learning Model on the iCub Robot [52.277579221741746]
  Addressee Estimation is a skill essential for social robots to interact smoothly with humans. Inspired by human perceptual skills, a deep-learning model for Addressee Estimation is designed, trained, and deployed on an iCub robot. The study presents the procedure of such implementation and the performance of the model deployed in real-time human-robot interaction.
  arXiv  Detail & Related papers  (2023-11-09T13:01:21Z)
• Play it by Ear: Learning Skills amidst Occlusion through Audio-Visual Imitation Learning [62.83590925557013]
  We learn a set of challenging partially-observed manipulation tasks from visual and audio inputs. Our proposed system learns these tasks by combining offline imitation learning from tele-operated demonstrations and online finetuning. In a set of simulated tasks, we find that our system benefits from using audio, and that by using online interventions we are able to improve the success rate of offline imitation learning by 20%.
  arXiv  Detail & Related papers  (2022-05-30T04:52:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.