Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps

• URL: http://arxiv.org/abs/2412.12024v1
• Date: Mon, 16 Dec 2024 17:51:09 GMT
• Title: Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps
• Authors: Linfeng Zhao, Lawson L. S. Wong,
• Abstract summary: We focus on zero-shot navigation ability using given abstract $2$-D top-down maps. We propose a model-based reinforcement learning approach for this multi-task learning problem. Our method can adapt better to novel environments in zero-shot and is more robust to noise.
• Score: 12.505350896485389
• License:
• Abstract: Learning navigation capabilities in different environments has long been one of the major challenges in decision-making. In this work, we focus on zero-shot navigation ability using given abstract $2$-D top-down maps. Like human navigation by reading a paper map, the agent reads the map as an image when navigating in a novel layout, after learning to navigate on a set of training maps. We propose a model-based reinforcement learning approach for this multi-task learning problem, where it jointly learns a hypermodel that takes top-down maps as input and predicts the weights of the transition network. We use the DeepMind Lab environment and customize layouts using generated maps. Our method can adapt better to novel environments in zero-shot and is more robust to noise.

Related papers

• Semantic Map-based Generation of Navigation Instructions [9.197756644049862]
  We propose a new approach to navigation instruction generation by framing the problem as an image captioning task. Conventional approaches employ a sequence of panorama images to generate navigation instructions. We present a benchmark dataset for instruction generation using semantic maps, propose an initial model and ask human subjects to manually assess the quality of generated instructions.
  arXiv  Detail & Related papers  (2024-03-28T17:27:44Z)
• Feudal Networks for Visual Navigation [6.1190419149081245]
  We introduce a new approach to visual navigation using feudal learning. Agents at each level see a different aspect of the task and operate at different spatial and temporal scales. The resulting feudal navigation network achieves near SOTA performance.
  arXiv  Detail & Related papers  (2024-02-19T20:05:41Z)
• Object Goal Navigation with Recursive Implicit Maps [92.6347010295396]
  We propose an implicit spatial map for object goal navigation. Our method significantly outperforms the state of the art on the challenging MP3D dataset. We deploy our model on a real robot and achieve encouraging object goal navigation results in real scenes.
  arXiv  Detail & Related papers  (2023-08-10T14:21:33Z)
• Learning Navigational Visual Representations with Semantic Map Supervision [85.91625020847358]
  We propose a navigational-specific visual representation learning method by contrasting the agent's egocentric views and semantic maps. Ego$2$-Map learning transfers the compact and rich information from a map, such as objects, structure and transition, to the agent's egocentric representations for navigation.
  arXiv  Detail & Related papers  (2023-07-23T14:01:05Z)
• Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation [87.52136927091712]
  We address a practical yet challenging problem of training robot agents to navigate in an environment following a path described by some language instructions. To achieve accurate and efficient navigation, it is critical to build a map that accurately represents both spatial location and the semantic information of the environment objects. We propose a multi-granularity map, which contains both object fine-grained details (e.g., color, texture) and semantic classes, to represent objects more comprehensively.
  arXiv  Detail & Related papers  (2022-10-14T04:23:27Z)
• Find a Way Forward: a Language-Guided Semantic Map Navigator [53.69229615952205]
  This paper attacks the problem of language-guided navigation in a new perspective. We use novel semantic navigation maps, which enables robots to carry out natural language instructions and move to a target position based on the map observations. The proposed approach has noticeable performance gains, especially in long-distance navigation cases.
  arXiv  Detail & Related papers  (2022-03-07T07:40:33Z)
• PONI: Potential Functions for ObjectGoal Navigation with Interaction-free Learning [125.22462763376993]
  We propose Potential functions for ObjectGoal Navigation with Interaction-free learning (PONI) PONI disentangles the skills of where to look?' for an object and how to navigate to (x, y)?'
  arXiv  Detail & Related papers  (2022-01-25T01:07:32Z)
• Lifelong Topological Visual Navigation [16.41858724205884]
  We propose a learning-based visual navigation method with graph update strategies that improve lifelong navigation performance over time. We take inspiration from sampling-based planning algorithms to build image-based topological graphs, resulting in sparser graphs yet with higher navigation performance compared to baseline methods. Unlike controllers that learn from fixed training environments, we show that our model can be finetuned using a relatively small dataset from the real-world environment where the robot is deployed.
  arXiv  Detail & Related papers  (2021-10-16T06:16:14Z)
• Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation [143.6144560164782]
  We introduce a learning-based approach for room navigation using semantic maps. We train a model to generate amodal semantic top-down maps indicating beliefs of location, size, and shape of rooms. Next, we use these maps to predict a point that lies in the target room and train a policy to navigate to the point.
  arXiv  Detail & Related papers  (2020-07-20T02:19:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.