Learning Personalized Human-Aware Robot Navigation Using Virtual Reality Demonstrations from a User Study

• URL: http://arxiv.org/abs/2203.14741v1
• Date: Mon, 28 Mar 2022 13:31:12 GMT
• Title: Learning Personalized Human-Aware Robot Navigation Using Virtual Reality Demonstrations from a User Study
• Abstract summary: This paper presents a novel reinforcement learning framework to train a personalized navigation controller. The conducted user study provides evidence that our personalized approach significantly outperforms classical approaches. We transfer the navigation controller without loss in performance to a real robot.
• Score: 9.118706387430883
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: For the most comfortable, human-aware robot navigation, subjective user preferences need to be taken into account. This paper presents a novel reinforcement learning framework to train a personalized navigation controller along with an intuitive virtual reality demonstration interface. The conducted user study provides evidence that our personalized approach significantly outperforms classical approaches with more comfortable human-robot experiences. We achieve these results using only a few demonstration trajectories from non-expert users, who predominantly appreciate the intuitive demonstration setup. As we show in the experiments, the learned controller generalizes well to states not covered in the demonstration data, while still reflecting user preferences during navigation. Finally, we transfer the navigation controller without loss in performance to a real robot.

Related papers

• NavIsaacLab: Generating Realistic Crowd via Parallel Robot Learning for Benchmarking Human-aware Navigation [40.511983590273445]
  This paper presents NavIsaacLab, a comprehensive framework for benchmarking and training human-aware navigation policies.<n>Based on Isaac Lab, the proposed framework employs photo-realistic scene rendering capabilities and supports parallel simulation on GPU.<n>To enhance the realism of human behavior, a data-driven approach is employed that incorporates a trajectory diffusion model and an adversarial motion learning controller.
  arXiv  Detail & Related papers  (2026-06-24T18:08:19Z)
• Follow-Me in Micro-Mobility with End-to-End Imitation Learning [0.0]
  We show how imitation learning delivers smoother and overall better controllers, versus previously used manually-tuned controllers.<n>This paper analyzes different neural network architectures for end-to-end control and demonstrates their usability in real-world production-level deployments.
  arXiv  Detail & Related papers  (2025-11-07T11:24:20Z)
• How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learning [25.798669976935283]
  Imitation learning is a promising approach for learning robot policies with user-provided data. We compare low-cost demonstration modalities including kinesthetic teaching, teleoperation with a VR controller, and teleoperation with a spacemouse controller. Our results show that kinesthetic teaching is rated the most intuitive for controlling the robot and provides cleanest data for best downstream learning performance.
  arXiv  Detail & Related papers  (2025-03-10T07:57:26Z)
• CANVAS: Commonsense-Aware Navigation System for Intuitive Human-Robot Interaction [19.997935470257794]
  We present CANVAS, a framework that combines visual and linguistic instructions for commonsense-aware navigation. Its success is driven by imitation learning, enabling the robot to learn from human navigation behavior. Our experiments show that CANVAS outperforms the strong rule-based system ROS NavStack across all environments.
  arXiv  Detail & Related papers  (2024-10-02T06:34:45Z)
• Learning Navigational Visual Representations with Semantic Map Supervision [85.91625020847358]
  We propose a navigational-specific visual representation learning method by contrasting the agent's egocentric views and semantic maps. Ego$2$-Map learning transfers the compact and rich information from a map, such as objects, structure and transition, to the agent's egocentric representations for navigation.
  arXiv  Detail & Related papers  (2023-07-23T14:01:05Z)
• Offline Reinforcement Learning for Visual Navigation [66.88830049694457]
  ReViND is the first offline RL system for robotic navigation that can leverage previously collected data to optimize user-specified reward functions in the real-world. We show that ReViND can navigate to distant goals using only offline training from this dataset, and exhibit behaviors that qualitatively differ based on the user-specified reward function.
  arXiv  Detail & Related papers  (2022-12-16T02:23:50Z)
• Learning Social Navigation from Demonstrations with Conditional Neural Processes [2.627046865670577]
  This paper presents a data-driven navigation architecture that uses Conditional Neural Processes to learn global and local controllers of the mobile robot from observations. Our results demonstrate that the proposed framework can successfully carry out navigation tasks regarding social norms in the data.
  arXiv  Detail & Related papers  (2022-10-07T14:37:56Z)
• Gesture2Path: Imitation Learning for Gesture-aware Navigation [54.570943577423094]
  We present Gesture2Path, a novel social navigation approach that combines image-based imitation learning with model-predictive control. We deploy our method on real robots and showcase the effectiveness of our approach for the four gestures-navigation scenarios.
  arXiv  Detail & Related papers  (2022-09-19T23:05:36Z)
• Learning Reward Functions from Scale Feedback [11.941038991430837]
  A common framework is to iteratively query the user about which of two presented robot trajectories they prefer. We propose scale feedback, where the user utilizes a slider to give more nuanced information. We demonstrate the performance benefit of slider feedback in simulations, and validate our approach in two user studies.
  arXiv  Detail & Related papers  (2021-10-01T09:45:18Z)
• Learning Perceptual Locomotion on Uneven Terrains using Sparse Visual Observations [75.60524561611008]
  This work aims to exploit the use of sparse visual observations to achieve perceptual locomotion over a range of commonly seen bumps, ramps, and stairs in human-centred environments. We first formulate the selection of minimal visual input that can represent the uneven surfaces of interest, and propose a learning framework that integrates such exteroceptive and proprioceptive data. We validate the learned policy in tasks that require omnidirectional walking over flat ground and forward locomotion over terrains with obstacles, showing a high success rate.
  arXiv  Detail & Related papers  (2021-09-28T20:25:10Z)
• VOILA: Visual-Observation-Only Imitation Learning for Autonomous Navigation [44.799092976955656]
  We introduce a new algorithm, Visual Observation only Imitation Learning for Autonomous navigation (VOILA) VOILA learns navigation policies from a single video demonstration collected from a physically different agent. We show that VOILA not only successfully imitates the expert, but that it also learns navigation policies that can generalize to novel environments.
  arXiv  Detail & Related papers  (2021-05-19T19:25:23Z)
• APPLD: Adaptive Planner Parameter Learning from Demonstration [48.63930323392909]
  We introduce APPLD, Adaptive Planner Learning from Demonstration, that allows existing navigation systems to be successfully applied to new complex environments. APPLD is verified on two robots running different navigation systems in different environments. Experimental results show that APPLD can outperform navigation systems with the default and expert-tuned parameters, and even the human demonstrator themselves.
  arXiv  Detail & Related papers  (2020-03-31T21:15:16Z)
• Visual Navigation Among Humans with Optimal Control as a Supervisor [72.5188978268463]
  We propose an approach that combines learning-based perception with model-based optimal control to navigate among humans. Our approach is enabled by our novel data-generation tool, HumANav. We demonstrate that the learned navigation policies can anticipate and react to humans without explicitly predicting future human motion.
  arXiv  Detail & Related papers  (2020-03-20T16:13:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.