Learning Social Robot Navigation By Sensing Human Legs

• URL: http://arxiv.org/abs/2607.27922v1
• Date: Thu, 30 Jul 2026 09:35:03 GMT
• Title: Learning Social Robot Navigation By Sensing Human Legs
• Abstract summary: CALF is an end-to-end neural architecture that interprets leg motion directly from LiDAR scans and produce safe navigation commands.<n>Policy is trained using deep reinforcement learning algorithms within LegNav, a custom lightweight 2D simulator.<n>LegNav simulator enables the training of a deployment-ready CALF policy in under an hour on a single consumer GPU.
• Score: 0.29360071145551064
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robots navigating among pedestrians typically sense their surroundings with a 2D LiDAR mounted close to the ground. At that height, the sensor mostly sees moving legs rather than whole people, yet most learning-based navigation methods still treat pedestrians as simple shapes like circles. This paper addresses that gap with CALF (Convolutional Attention for Leg Features), an end-to-end neural architecture that combines convolutional layers, attention, and MLP to interpret leg motion directly from LiDAR scans and produce safe navigation commands. The CALF policy is trained using deep reinforcement learning algorithms within LegNav, a custom lightweight 2D simulator that combines 2D LiDAR ray tracing with a novel pedestrian gait model. The resulting policy is compared against classical and learning-based baselines in terms of navigation performance and social compliance. The approach is validated through real-world experiments via zero-shot deployment on a TurtleBot 4, yielding smooth and socially compliant trajectories. Written in JAX, the LegNav simulator enables the training of a deployment-ready CALF policy in under an hour on a single consumer GPU.

Related papers

• LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation [52.91080323083409]
  Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments.<n>Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads.
  arXiv  Detail & Related papers  (2026-08-31T15:08:53Z)
• Towards End to End Motion Planning and Execution for Autonomous Underwater Vehicles Using Reinforcement Learning [2.1942030377331245]
  This paper explores the feasibility of an end-to-end Deep Reinforcement Learning (DRL) approach that maps raw sensor data directly to thruster commands.<n>A High-Level (HL) policy operating at 2Hz processes raw $84 times 84$ pixel monocular camera frames, stacked $100 times 100$ pixel forward-looking imaging sonar, and proprioceptive data to generate spatial subgoals.<n>A Low-Level (LL) policy operating at 10Hz converts these subgoals into thruster commands.
  arXiv  Detail & Related papers  (2026-06-07T08:34:29Z)
• ZTRS: Zero-Imitation End-to-end Autonomous Driving with Trajectory Scoring [52.195295396336526]
  ZTRS (Zero-Imitation End-to-End Autonomous Driving with Trajectory Scoring) is a framework that combines the strengths of both worlds: sensor inputs without losing information and RL training for robust planning.<n>ZTRS demonstrates strong performance across three benchmarks: Navtest, Navhard, and HUGSIM.
  arXiv  Detail & Related papers  (2025-10-28T06:26:36Z)
• EmoBipedNav: Emotion-aware Social Navigation for Bipedal Robots with Deep Reinforcement Learning [11.622119393400341]
  This study presents an emotion-aware navigation framework --BipedNav -- for bipedal robots walking in socially interactive environments.<n>The proposed framework incorporates full-order dynamics and locomotion constraints during training, effectively accounting for tracking errors and restrictions of the locomotion controller.
  arXiv  Detail & Related papers  (2025-03-16T15:11:57Z)
• Helpful DoggyBot: Open-World Object Fetching using Legged Robots and Vision-Language Models [63.89598561397856]
  We present a system for quadrupedal mobile manipulation in indoor environments. It uses a front-mounted gripper for object manipulation, a low-level controller trained in simulation using egocentric depth for agile skills. We evaluate our system in two unseen environments without any real-world data collection or training.
  arXiv  Detail & Related papers  (2024-09-30T20:58:38Z)
• Hyp2Nav: Hyperbolic Planning and Curiosity for Crowd Navigation [58.574464340559466]
  We advocate for hyperbolic learning to enable crowd navigation and we introduce Hyp2Nav. Hyp2Nav leverages the intrinsic properties of hyperbolic geometry to better encode the hierarchical nature of decision-making processes in navigation tasks. We propose a hyperbolic policy model and a hyperbolic curiosity module that results in effective social navigation, best success rates, and returns across multiple simulation settings.
  arXiv  Detail & Related papers  (2024-07-18T14:40:33Z)
• Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks [93.38375271826202]
  We present a method to improve generalization and robustness to distribution shifts in sim-to-real visual quadrotor navigation tasks. We first build a simulator by integrating Gaussian splatting with quadrotor flight dynamics, and then, train robust navigation policies using Liquid neural networks. In this way, we obtain a full-stack imitation learning protocol that combines advances in 3D Gaussian splatting radiance field rendering, programming of expert demonstration training data, and the task understanding capabilities of Liquid networks.
  arXiv  Detail & Related papers  (2024-06-21T13:48:37Z)
• ViNL: Visual Navigation and Locomotion Over Obstacles [36.46953494419389]
  We present Visual Navigation and Locomotion over obstacles (ViNL) It enables a quadrupedal robot to navigate unseen apartments while stepping over small obstacles that lie in its path. ViNL consists of: (1) a visual navigation policy that outputs linear and angular velocity commands that guides the robot to a goal coordinate in unfamiliar indoor environments; and (2) a visual locomotion policy that controls the robot's joints to avoid stepping on obstacles while following provided velocity commands.
  arXiv  Detail & Related papers  (2022-10-26T15:38:28Z)
• Coupling Vision and Proprioception for Navigation of Legged Robots [65.59559699815512]
  We exploit the complementary strengths of vision and proprioception to achieve point goal navigation in a legged robot. We show superior performance compared to wheeled robot (LoCoBot) baselines. We also show the real-world deployment of our system on a quadruped robot with onboard sensors and compute.
  arXiv  Detail & Related papers  (2021-12-03T18:59:59Z)
• Robust Navigation for Racing Drones based on Imitation Learning and Modularization [3.616948583169635]
  This paper presents a vision-based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module. We leverage a state-of-the-art planner and controller to generate low-level control commands, thus exploiting the advantages of both data-based and model-based approaches.
  arXiv  Detail & Related papers  (2021-05-27T03:26:40Z)
• Learning Stable Manoeuvres in Quadruped Robots from Expert Demonstrations [3.893720742556156]
  Key problem is to generate leg trajectories for continuously varying target linear and angular velocities. We propose a two pronged approach to address this problem. We develop a neural network-based filter that takes in target velocity, radius and transforms them into new commands.
  arXiv  Detail & Related papers  (2020-07-28T15:02:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.