The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation

• URL: http://arxiv.org/abs/2108.11550v1
• Date: Thu, 26 Aug 2021 02:12:49 GMT
• Title: The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation
• Authors: Xiaoming Zhao, Harsh Agrawal, Dhruv Batra, Alexander Schwing
• Abstract summary: PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal navigation task with near-perfect accuracy (99.6% success) We show that integrating visual odometry techniques into navigation policies improves the state-of-the-art on the popular Habitat PointNav benchmark by a large margin.
• Score: 100.08270721713149
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: It is fundamental for personal robots to reliably navigate to a specified goal. To study this task, PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal navigation task with near-perfect accuracy (99.6% success) in photo-realistically simulated environments, assuming noiseless egocentric vision, noiseless actuation, and most importantly, perfect localization. However, under realistic noise models for visual sensors and actuation, and without access to a "GPS and Compass sensor," the 99.6%-success agents for PointGoal navigation only succeed with 0.3%. In this work, we demonstrate the surprising effectiveness of visual odometry for the task of PointGoal navigation in this realistic setting, i.e., with realistic noise models for perception and actuation and without access to GPS and Compass sensors. We show that integrating visual odometry techniques into navigation policies improves the state-of-the-art on the popular Habitat PointNav benchmark by a large margin, improving success from 64.5% to 71.7% while executing 6.4 times faster.

Related papers

• TopoNav: Topological Navigation for Efficient Exploration in Sparse Reward Environments [0.6597195879147555]
  TopoNav is a novel framework for efficient goal-oriented exploration and navigation in sparse-reward settings. TopoNav dynamically constructs a topological map of the environment, capturing key locations and pathways. We evaluate TopoNav both in the simulated and real-world off-road environments using a Clearpath Jackal robot.
  arXiv  Detail & Related papers  (2024-02-06T15:05:25Z)
• Angle Robustness Unmanned Aerial Vehicle Navigation in GNSS-Denied Scenarios [66.05091704671503]
  We present a novel angle navigation paradigm to deal with flight deviation in point-to-point navigation tasks. We also propose a model that includes the Adaptive Feature Enhance Module, Cross-knowledge Attention-guided Module and Robust Task-oriented Head Module.
  arXiv  Detail & Related papers  (2024-02-04T08:41:20Z)
• Unsupervised Visual Odometry and Action Integration for PointGoal Navigation in Indoor Environment [14.363948775085534]
  PointGoal navigation in indoor environment is a fundamental task for personal robots to navigate to a specified point. To improve the PointGoal navigation accuracy without GPS signal, we use visual odometry (VO) and propose a novel action integration module (AIM) trained in unsupervised manner. Experiments show that the proposed system achieves satisfactory results and outperforms the partially supervised learning algorithms on the popular Gibson dataset.
  arXiv  Detail & Related papers  (2022-10-02T03:12:03Z)
• Is Mapping Necessary for Realistic PointGoal Navigation? [44.54452415882708]
  We show that map-less neural models can achieve 100% Success on a standard dataset. We then identify the main cause of this drop in performance: the absence of GPS+. We develop human-annotation-free data-augmentation techniques to train models for visual odometry.
  arXiv  Detail & Related papers  (2022-06-02T11:37:27Z)
• A Saliency-Guided Street View Image Inpainting Framework for Efficient Last-Meters Wayfinding [13.92492610110197]
  We propose a saliency-guided image inpainting framework to reduce visual distraction in image-based wayfinding. It aims at redirecting human visual attention from distracting objects to destination-related objects for more efficient and accurate wayfinding in the last meters.
  arXiv  Detail & Related papers  (2022-05-14T00:16:38Z)
• ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints [94.60414567852536]
  Long-range navigation requires both planning and reasoning about local traversability. We propose a learning-based approach that integrates learning and planning. ViKiNG can leverage its image-based learned controller and goal-directed to navigate to goals up to 3 kilometers away.
  arXiv  Detail & Related papers  (2022-02-23T02:14:23Z)
• Augmented reality navigation system for visual prosthesis [67.09251544230744]
  We propose an augmented reality navigation system for visual prosthesis that incorporates a software of reactive navigation and path planning. It consists on four steps: locating the subject on a map, planning the subject trajectory, showing it to the subject and re-planning without obstacles. Results show how our augmented navigation system help navigation performance by reducing the time and distance to reach the goals, even significantly reducing the number of obstacles collisions.
  arXiv  Detail & Related papers  (2021-09-30T09:41:40Z)
• Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents [90.65480527538723]
  We develop point-goal navigation agents that rely on visual estimates of egomotion under noisy action dynamics. Our agent was the runner-up in the PointNav track of CVPR 2020 Habitat Challenge.
  arXiv  Detail & Related papers  (2020-09-07T16:52:47Z)
• MVP: Unified Motion and Visual Self-Supervised Learning for Large-Scale Robotic Navigation [23.54696982881734]
  We propose a novel motion and visual perception approach, dubbed MVP, for large-scale, target-driven navigation tasks. Our MVP-based method can learn faster, and is more accurate and robust to both extreme environmental changes and poor GPS data. We evaluate our method on two large real-world datasets, Oxford Robotcar and Nordland Railway.
  arXiv  Detail & Related papers  (2020-03-02T05:19:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.