Robots Ask the Way: Communication-Enabled Social Navigation

• URL: http://arxiv.org/abs/2607.01044v1
• Date: Wed, 01 Jul 2026 15:07:40 GMT
• Title: Robots Ask the Way: Communication-Enabled Social Navigation
• Abstract summary: We introduce Communication-enabled Social Navigation (CommNav)<n>In this novel task, robotic agents actively seek assistance from residents to locate target individuals.<n>We show that explicit human-robot communication substantially enhances multi-person navigation performance.
• Score: 12.914876079465431
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Assistive autonomous robots operating in multi-agent environments require efficient strategies to locate specific individuals among multiple residents. Current social navigation methods focus on reactive collision avoidance and trajectory adaptation, but lack mechanisms to proactively gather information through human-robot communication. We introduce Communication-enabled Social Navigation (CommNav). In this novel task, robotic agents actively seek assistance from residents to locate target individuals by requesting information about recent sightings, locations, and movements. To evaluate CommNav, we extend Habitat 3.0 to create Habitat 3.0c, a communication-enabled variant supporting multi-human environments with information exchange protocols. Adding our communication module (COMM) to a state-of-the-art social navigation model yields a 10 percentage-point improvement in Episode Success. We further investigate the transition from structured data to natural language by evaluating models trained on LLM-generated instructions and on colloquial instructions collected from a human study. Our experiments reveal that: (i) explicit human-robot communication substantially enhances multi-person navigation performance; (ii) pre-training COMM on a communication pretext task effectively addresses the challenge of occasional interaction signals; and (iii) the navigation policy is highly robust to natural, colloquial human language, achieving an episode success statistically similar to the model using perfect structured data.

Related papers

• Communication-Constrained Multi-Robot Exploration With Adaptive Communication Windows [16.619647268424412]
  This paper introduces MACE, a decentralized exploration framework that actively evaluates whether establishing communication is worthwhile.<n>We demonstrate that MACE reduces the total exploration time by up to 23% compared to existing communication-constrained exploration strategies.
  arXiv  Detail & Related papers  (2026-09-11T07:05:42Z)
• ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset [51.60529216343344]
  ACME: A Cross-cultural, Multi-Embodiment dataset for social navigation.<n>ACME is a large-scale data collection effort across 8 sites in 5 countries, using 7 robot embodiments.<n>Unlike prior datasets, it focuses on capturing goal-driven social navigation behavior in complex social scenarios with explicit robot-crowd interaction through robot speech.
  arXiv  Detail & Related papers  (2026-07-24T04:23:21Z)
• Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech [19.38205427861322]
  We aim to enable legged robots to learn how to interpret human social cues and produce appropriate behaviors through physical human guidance.<n>We propose a human-in-the-loop framework that enables robots to acquire navigational behaviors in a data-efficient manner.<n>We evaluate our framework across six real-world agile navigation scenarios, including jumping over or avoiding obstacles.
  arXiv  Detail & Related papers  (2026-01-13T10:47:12Z)
• Air-Ground Collaboration for Language-Specified Missions in Unknown Environments [62.56917065429864]
  We present a first-of-its-kind system where an unmanned aerial vehicle (UAV) and an unmanned ground vehicle (UGV) are able to collaboratively accomplish missions specified in natural language.<n>We leverage a Large Language Model (LLM)-enabled planner to reason over semantic-metric maps that are built online and opportunistically shared between an aerial and a ground robot.
  arXiv  Detail & Related papers  (2025-05-14T03:33:46Z)
• IG-MCTS: Human-in-the-Loop Cooperative Navigation under Incomplete Information [22.47189812250736]
  CoNav-Maze is a simulated environment where a robot navigates with local perception while a human operator provides guidance based on an inaccurate map.<n>We propose Information Gain Monte Carlo Tree Search (IG-MCTS) to jointly optimize autonomous movement and informative communication.<n>IG-MCTS significantly reduces communication demands and yields eye-tracking metrics indicative of lower cognitive load.
  arXiv  Detail & Related papers  (2025-02-03T22:08:04Z)
• CoNav: A Benchmark for Human-Centered Collaborative Navigation [66.6268966718022]
  We propose a collaborative navigation (CoNav) benchmark. Our CoNav tackles the critical challenge of constructing a 3D navigation environment with realistic and diverse human activities. We propose an intention-aware agent for reasoning both long-term and short-term human intention.
  arXiv  Detail & Related papers  (2024-06-04T15:44:25Z)
• Unifying Large Language Model and Deep Reinforcement Learning for Human-in-Loop Interactive Socially-aware Navigation [16.789333617628138]
  Social robot navigation planners face two major challenges: managing real-time user inputs and ensuring socially compliant behaviors.<n>We introduce SALM, an interactive, human-in-loop Socially-Aware navigation Large Language Model framework.<n>A memory mechanism archives temporal data for continuous refinement, while a multi-step graph-of-thoughts inference-based large language feedback model adaptively fuses the strengths of both planning approaches.
  arXiv  Detail & Related papers  (2024-03-22T23:12:28Z)
• SACSoN: Scalable Autonomous Control for Social Navigation [62.59274275261392]
  We develop methods for training policies for socially unobtrusive navigation. By minimizing this counterfactual perturbation, we can induce robots to behave in ways that do not alter the natural behavior of humans in the shared space. We collect a large dataset where an indoor mobile robot interacts with human bystanders.
  arXiv  Detail & Related papers  (2023-06-02T19:07:52Z)
• Gesture2Path: Imitation Learning for Gesture-aware Navigation [54.570943577423094]
  We present Gesture2Path, a novel social navigation approach that combines image-based imitation learning with model-predictive control. We deploy our method on real robots and showcase the effectiveness of our approach for the four gestures-navigation scenarios.
  arXiv  Detail & Related papers  (2022-09-19T23:05:36Z)
• Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation [92.66286342108934]
  Social navigation is the capability of an autonomous agent, such as a robot, to navigate in a'socially compliant' manner in the presence of other intelligent agents such as humans. Our dataset contains 8.7 hours, 138 trajectories, 25 miles of socially compliant, human teleoperated driving demonstrations.
  arXiv  Detail & Related papers  (2022-03-28T19:09:11Z)
• Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents [83.52684405389445]
  We introduce the collaborative multi-object navigation task CoMON. In this task, an oracle agent has detailed environment information in the form of a map. It communicates with a navigator agent that perceives the environment visually and is tasked to find a sequence of goals. We show that the emergent communication can be grounded to the agent observations and the spatial structure of the 3D environment.
  arXiv  Detail & Related papers  (2021-10-12T06:56:11Z)
• Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene [34.1812210095966]
  We develop a VR-based 3D simulation environment, named Ges-THOR, based on AI2-THOR platform. In this virtual environment, a human player is placed in the same virtual scene and shepherds the artificial agent using only gestures. We argue that learning the semantics of natural gestures is mutually beneficial to learning the navigation task--learn to communicate and communicate to learn.
  arXiv  Detail & Related papers  (2021-08-05T20:56:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.