nnMNet: Baseline for Martian Terrain Semantic Segmentation

• URL: http://arxiv.org/abs/2608.29609v1
• Date: Sun, 30 Aug 2026 07:03:33 GMT
• Title: nnMNet: Baseline for Martian Terrain Semantic Segmentation
• Abstract summary: We present nnMNet, a new baseline model designed for Martian semantic segmentation.<n>To bridge the gap between local and global representations, we introduce the Spatially-Aware Fusion Block (SAFB)<n>nnMNet achieves new state-of-the-art 86.61%, 83.25%, and 88.24% mIoU on SynMars-TW, SynMars-Air, and MarsScapes, respectively.
• Score: 0.8594140167290097
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semantic segmentation is a crucial task for understanding Mars, the most Earth-like planet in our solar system. However, it is challenging because the Martian surface is highly unstructured and complex, making accurate pixel-level prediction and fine-grained annotation difficult. Recent advancements in deep learning have introduced numerous methods and datasets to address these challenges. Nevertheless, the field lacks a robust, publicly available, and reproducible baseline, as well as a unified benchmark to facilitate fair evaluations. In this work, we present nnMNet, a new baseline model designed for Martian terrain semantic segmentation. Building upon nnWNet, we integrate linear attention to better capture global context and employ lightweight convolutions to reduce computational overhead. To bridge the gap between local and global representations, we introduce the Spatially-Aware Fusion Block (SAFB), which augments and combines features with diverse characteristics. Furthermore, we establish a new benchmark by curating and standardizing three high-quality datasets for thorough evaluation. nnMNet achieves new state-of-the-art 86.61%, 83.25%, and 88.24% mIoU on SynMars-TW, SynMars-Air, and MarsScapes, respectively. Our code, models, and datasets are publicly available at https://github.com/dereklee0310/nnMNet.

Related papers

• Global-Local Contextual Progressive Expansion Network for Martian Landslide Segmentation in Multimodal Remote Sensing Imagery [7.778724782015986]
  This work investigates the capability of deep learning to address Martian landslide segmentation.<n>We propose TransCPLES, a U-shaped network that couples Contextual Progressive Layer Expansion feature extraction with Transformer-based contextual reasoning.<n>Experiments on MMLSv2, a seven-band multimodal Martian landslide dataset, show that TransCPLES achieves the best overall performance.
  arXiv  Detail & Related papers  (2026-09-11T09:24:53Z)
• WOW-Seg: A Word-free Open World Segmentation Model [54.80135620139728]
  We propose WOW-Seg, a Word-free Open World model for segmenting and recognizing objects from open-set categories.<n>Specifically, WOW-Seg introduces a novel visual prompt module, Mask2Token, which transforms image masks into visual tokens.<n>We also construct an open world region recognition test benchmark: the Region Recognition dataset.
  arXiv  Detail & Related papers  (2026-05-16T09:28:46Z)
• LoMa: Local Feature Matching Revisited [56.73318466794448]
  Local feature matching has long been a fundamental component of 3D vision systems such as Structure-from-Motion (SfM)<n>In this paper, we revisit local feature matching from a data-driven perspective.<n>We combine large and diverse data mixtures, modern training recipes, scaled model capacity, and scaled compute, resulting in remarkable gains in performance.
  arXiv  Detail & Related papers  (2026-04-06T17:59:49Z)
• MarsRetrieval: Benchmarking Vision-Language Models for Planetary-Scale Geospatial Retrieval on Mars [21.01507072531742]
  We introduce MarsRetrieval, a retrieval benchmark for evaluating vision-language models for Martian geospatial discovery.<n>We propose a unified retrieval-centric protocol to benchmark multimodal embedding architectures.<n>Our evaluation shows MarsRetrieval is challenging, even strong foundation models often fail to capture domain-specific geomorphic distinctions.
  arXiv  Detail & Related papers  (2026-02-15T02:41:56Z)
• OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing [57.050679160659705]
  We introduce textbfOpenEarthSensing (OES), a large-scale fine-grained benchmark for open-world remote sensing.<n>OES includes 189 scene and object categories, covering the vast majority of potential semantic shifts that may occur in the real world.
  arXiv  Detail & Related papers  (2025-02-28T02:49:52Z)
• MarsSeg: Mars Surface Semantic Segmentation with Multi-level Extractor and Connector [19.053126804261034]
  We propose a novel encoder-decoder based Mars segmentation network, termed MarsSeg. The Mini-ASPP and PSA are specifically designed for shadow feature enhancement. The SPPM is employed for deep feature enhancement, facilitating the extraction of high-level semantic category-related information.
  arXiv  Detail & Related papers  (2024-04-05T15:04:57Z)
• ConeQuest: A Benchmark for Cone Segmentation on Mars [9.036303895516745]
  ConeQuest is the first expert-annotated public dataset to identify cones on Mars. We propose two benchmark tasks using ConeQuest: (i) Spatial Generalization and (ii) Cone-size Generalization.
  arXiv  Detail & Related papers  (2023-11-15T02:33:08Z)
• SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving [87.8761593366609]
  SSCBench is a benchmark that integrates scenes from widely used automotive datasets. We benchmark models using monocular, trinocular, and cloud input to assess the performance gap. We have unified semantic labels across diverse datasets to simplify cross-domain generalization testing.
  arXiv  Detail & Related papers  (2023-06-15T09:56:33Z)
• Navya3DSeg -- Navya 3D Semantic Segmentation Dataset & split generation for autonomous vehicles [63.20765930558542]
  3D semantic data are useful for core perception tasks such as obstacle detection and ego-vehicle localization. We propose a new dataset, Navya 3D (Navya3DSeg), with a diverse label space corresponding to a large scale production grade operational domain. It contains 23 labeled sequences and 25 supplementary sequences without labels, designed to explore self-supervised and semi-supervised semantic segmentation benchmarks on point clouds.
  arXiv  Detail & Related papers  (2023-02-16T13:41:19Z)
• GD-MAE: Generative Decoder for MAE Pre-training on LiDAR Point Clouds [72.60362979456035]
  Masked Autoencoders (MAE) are challenging to explore in large-scale 3D point clouds. We propose a textbfGenerative textbfDecoder for MAE (GD-MAE) to automatically merges the surrounding context. We demonstrate the efficacy of the proposed method on several large-scale benchmarks: KITTI, and ONCE.
  arXiv  Detail & Related papers  (2022-12-06T14:32:55Z)
• S$^{5}$Mars: Semi-Supervised Learning for Mars Semantic Segmentation [18.92602724896845]
  Mars semantic segmentation is an important Martian vision task, which is the base of rover autonomous planning and safe driving. There is a lack of sufficient detailed and high-confidence data annotations, which are exactly required by most deep learning methods to obtain a good model. We propose our solution from the perspective of joint data and method design. Experimental results show that our method can outperform state-of-the-art SSL approaches remarkably.
  arXiv  Detail & Related papers  (2022-07-04T05:03:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.