Full Stack Navigation, Mapping, and Planning for the Lunar Autonomy Challenge

• URL: http://arxiv.org/abs/2603.17232v1
• Date: Wed, 18 Mar 2026 00:32:56 GMT
• Title: Full Stack Navigation, Mapping, and Planning for the Lunar Autonomy Challenge
• Abstract summary: We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge.<n>Our pipeline integrates semantic segmentation, stereo visual odometry, pose graph SLAM with loop closures, and layered planning and control.<n>Our solution achieved first place in the final competition evaluation.
• Score: 0.8619139771027764
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. Operating in a GNSS-denied, visually challenging environment, our pipeline integrates semantic segmentation, stereo visual odometry, pose graph SLAM with loop closures, and layered planning and control. We leverage lightweight learning-based perception models for real-time segmentation and feature tracking and use a factor-graph backend to maintain globally consistent localization. High-level waypoint planning is designed to promote mapping coverage while encouraging frequent loop closures, and local motion planning uses arc sampling with geometric obstacle checks for efficient, reactive control. We evaluate our approach in the competition's high-fidelity lunar simulator, demonstrating centimeter-level localization accuracy, high-fidelity map generation, and strong repeatability across random seeds and rock distributions. Our solution achieved first place in the final competition evaluation.

Related papers

• Semantic Segmentation and Depth Estimation for Real-Time Lunar Surface Mapping Using 3D Gaussian Splatting [1.1240669509034298]
  This paper presents a real-time mapping framework that integrates dense perception models with a 3D Gaussian Splatting (3DGS) representation.<n>Our results demonstrate that combining semantic segmentation and dense depth estimation with learned map representations is an effective approach for creating detailed, large-scale maps to support future lunar surface missions.
  arXiv  Detail & Related papers  (2026-03-18T19:07:30Z)
• Visual SLAM with DEM Anchoring for Lunar Surface Navigation [1.1240669509034298]
  Future lunar missions will require autonomous rovers capable of traversing tens of kilometers across challenging terrain.<n>The absence of global positioning systems, extreme illumination, and low-texture regolith make long-range navigation on the Moon particularly difficult.<n>We present a stereo visual simultaneous localization and mapping (SLAM) system that integrates learned feature detection and matching with global constraints.
  arXiv  Detail & Related papers  (2026-03-18T00:24:05Z)
• SCOPE: Skeleton Graph-Based Computation-Efficient Framework for Autonomous UAV Exploration [30.628401434735906]
  SCOPE is a novel framework that incrementally constructs a real-time skeletal graph and introduces Implicit Unknown Region Analysis.<n>It achieves competitive exploration performance comparable to state-of-the-art global planners, while reducing computational cost by an average of 86.9%.
  arXiv  Detail & Related papers  (2026-02-26T07:31:29Z)
• Multi-session Localization and Mapping Exploiting Topological Information [1.3316173544577008]
  We propose a novel multi-session framework that builds on map-based localization.<n>Our approach incorporates a topology-informed, uncertainty-aware decision-making mechanism.<n>We validate our method on sequences overlapping from datasets and demonstrate its effectiveness in a real-world mine-like environment.
  arXiv  Detail & Related papers  (2026-02-19T10:17:46Z)
• CoWTracker: Tracking by Warping instead of Correlation [53.834673070954494]
  We propose a dense point tracker that eschews cost volumes in favor of warping.<n>Inspired by recent advances in optical flow, our approach iteratively refines track estimates by warping features from the target frame to the query frame based on the current estimate.<n>Our model is simple and achieves state-of-the-art performance on standard dense point tracking benchmarks, including TAP-Vid-DAVIS, TAP-Vid-Kinetics, and Robo-TAP.
  arXiv  Detail & Related papers  (2026-02-04T18:58:59Z)
• CSMapping: Scalable Crowdsourced Semantic Mapping and Topology Inference for Autonomous Driving [23.921417146230738]
  CSMapping produces accurate semantic maps and topological road centerlines.<n>Experiments on nuScenes, Argoverse 2, and a large proprietary dataset achieve state-of-the-art semantic and topological mapping performance.
  arXiv  Detail & Related papers  (2025-12-03T07:06:18Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• LunarLoc: Segment-Based Global Localization on the Moon [52.418394025548295]
  Global localization is necessary for autonomous operations on the lunar surface where traditional Earth-based navigation infrastructure, such as GPS, is unavailable.<n>We propose LunarLoc, an approach to global localization that leverages instance segmentation for zero-shot extraction of boulder landmarks from onboard stereo imagery.<n>LunarLoc achieves sub-cm level accuracy in multi-session global localization experiments, significantly outperforming the state of the art in lunar global localization.
  arXiv  Detail & Related papers  (2025-06-20T12:06:47Z)
• Real-time Spatial-temporal Traversability Assessment via Feature-based Sparse Gaussian Process [15.756895046886406]
  We propose a novel spatial-temporal traversability assessment method, which aims to enable autonomous robots to navigate through complex terrains.<n>Our method outper- forms SOTA approaches in both accuracy and computational efficiency.<n>We develop an autonomous navigation framework integrated with the traversability map and validate it with a differential driven vehicle in complex outdoor envi- ronments.
  arXiv  Detail & Related papers  (2025-03-06T06:26:57Z)
• Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigation [64.84996994779443]
  We propose a novel Affordances-Oriented Planner for continuous vision-language navigation (VLN) task. Our AO-Planner integrates various foundation models to achieve affordances-oriented low-level motion planning and high-level decision-making. Experiments on the challenging R2R-CE and RxR-CE datasets show that AO-Planner achieves state-of-the-art zero-shot performance.
  arXiv  Detail & Related papers  (2024-07-08T12:52:46Z)
• Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation [87.03299519917019]
  We propose a dual-scale graph transformer (DUET) for joint long-term action planning and fine-grained cross-modal understanding. We build a topological map on-the-fly to enable efficient exploration in global action space. The proposed approach, DUET, significantly outperforms state-of-the-art methods on goal-oriented vision-and-language navigation benchmarks.
  arXiv  Detail & Related papers  (2022-02-23T19:06:53Z)
• Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy [48.51396198176273]
  We propose an integrated system that can perform large-scale autonomous flights and real-time semantic mapping in challenging under-canopy environments. We detect and model tree trunks and ground planes from LiDAR data, which are associated across scans and used to constrain robot poses as well as tree trunk models. A drift-compensation mechanism is designed to minimize the odometry drift using semantic SLAM outputs in real time, while maintaining planner optimality and controller stability.
  arXiv  Detail & Related papers  (2021-09-14T07:24:53Z)
• Plan2Vec: Unsupervised Representation Learning by Latent Plans [106.37274654231659]
  We introduce plan2vec, an unsupervised representation learning approach that is inspired by reinforcement learning. Plan2vec constructs a weighted graph on an image dataset using near-neighbor distances, and then extrapolates this local metric to a global embedding by distilling path-integral over planned path. We demonstrate the effectiveness of plan2vec on one simulated and two challenging real-world image datasets.
  arXiv  Detail & Related papers  (2020-05-07T17:52:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.