MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data

• URL: http://arxiv.org/abs/2605.29647v1
• Date: Thu, 28 May 2026 09:12:57 GMT
• Title: MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data
• Abstract summary: MARTIAN is an open-source rendering framework that synthesizes realistic aerial views of the Martian terrain under controllable lighting conditions.<n>MARTIAN has been validated through its deployment in work on map-based localization systems for Ingenuity and future Mars rotorcraft.
• Score: 1.929589089941562
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Aerial navigation on Mars requires vision-based pipelines that are robust to the diverse illumination conditions and terrain morphology of the Martian surface. A key bottleneck for training and evaluating such methods is the scarcity of large-scale, annotated aerial datasets. We present MARTIAN, an open-source Blender-based rendering framework that leverages real HiRISE orbital map products to synthesize realistic aerial views of the Martian terrain under controllable lighting conditions and at varying altitudes. MARTIAN generates observations with accurate pose annotations, directly addressing the scarcity of training data for vision-based navigation on Mars. The framework has been validated through its deployment in concurrent work on map-based localization systems for Ingenuity and future Mars rotorcraft, where synthetically trained deep image matchers were successfully evaluated on real Mars imagery. MARTIAN is publicly available at: https://github.com/nasa-jpl/martian.

Related papers

• REMAC: Reference-Based Martian Asymmetrical Image Compression [53.55260610604231]
  We propose a reference-based Martian asymmetrical image compression (REMAC) approach, which shifts computational complexity from the encoder to the resource-rich decoder.<n> Experimental results show that REMAC reduces encoder complexity by 43.51% compared to the state-of-the-art method, while achieving a BD-PSNR gain of 0.2664 dB.
  arXiv  Detail & Related papers  (2026-01-26T14:55:17Z)
• Inpainting the Red Planet: Diffusion Models for the Reconstruction of Martian Environments in Virtual Reality [0.0]
  Training was conducted on an augmented dataset of 12000 Martian heightmaps derived from NASA's HiRISE survey.<n>A non-homogeneous rescaling strategy captures terrain features across multiple scales before resizing to a fixed 128x128 model resolution.<n>Results show that our approach consistently outperforms these methods in terms of reconstruction accuracy (4-15% on RMSE) and perceptual similarity (29-81% on LPIPS) with the original data.
  arXiv  Detail & Related papers  (2025-10-16T15:02:05Z)
• Martian World Models: Controllable Video Synthesis with Physically Accurate 3D Reconstructions [116.56517155163716]
  We propose a data curation pipeline that reconstructs 3D Martian environments from real stereo navigation images.<n>A Martian terrain video generator, MarsGen, synthesizes novel videos visually realistic and geometrically consistent with the 3D structure encoded in the data.<n>Our approach outperforms video synthesis models trained on terrestrial datasets, achieving superior visual fidelity and 3D structural consistency.
  arXiv  Detail & Related papers  (2025-07-10T17:54:27Z)
• Vision-based Geo-Localization of Future Mars Rotorcraft in Challenging Illumination Conditions [4.6901215692204286]
  Geo-LoFTR is a geometry-aided deep learning model for image registration that is more robust under large illumination differences than prior models.<n>We show that our proposed system outperforms prior MbL efforts in terms of localization accuracy under significant lighting and scale variations.
  arXiv  Detail & Related papers  (2025-02-13T22:10:21Z)
• Structure-Invariant Range-Visual-Inertial Odometry [17.47284320862407]
  This work introduces a novel range-visual-inertial odometry system tailored for the Mars Science Helicopter mission. Our system extends the state-of-the-art xVIO framework by fusing consistent range information with visual and inertial measurements. We demonstrate that our range-VIO approach estimates terrain-relative velocity meeting the stringent mission requirements.
  arXiv  Detail & Related papers  (2024-09-06T21:49:10Z)
• MaRF: Representing Mars as Neural Radiance Fields [1.4680035572775534]
  MaRF is a framework able to synthesize the Martian environment using several collections of images from rover cameras. It addresses key challenges in planetary surface exploration such as: planetary geology, simulated navigation and shape analysis. In the experimental section, we demonstrate the environments created from actual Mars datasets captured by Curiosity rover, Perseverance rover and Ingenuity helicopter.
  arXiv  Detail & Related papers  (2022-12-03T18:58:00Z)
• LaMAR: Benchmarking Localization and Mapping for Augmented Reality [80.23361950062302]
  We introduce LaMAR, a new benchmark with a comprehensive capture and GT pipeline that co-registers realistic trajectories and sensor streams captured by heterogeneous AR devices. We publish a benchmark dataset of diverse and large-scale scenes recorded with head-mounted and hand-held AR devices.
  arXiv  Detail & Related papers  (2022-10-19T17:58:17Z)
• Mars Rover Localization Based on A2G Obstacle Distribution Pattern Matching [0.0]
  In NASA's Mars 2020 mission, the Ingenuity helicopter is carried together with the rover. Traditional image matching methods will struggle to obtain valid image correspondence. An algorithm combing image-based rock detection and rock distribution pattern matching is used to acquire A2G imagery correspondence.
  arXiv  Detail & Related papers  (2022-10-07T08:29:48Z)
• 6D Camera Relocalization in Visually Ambiguous Extreme Environments [79.68352435957266]
  We propose a novel method to reliably estimate the pose of a camera given a sequence of images acquired in extreme environments such as deep seas or extraterrestrial terrains. Our method achieves comparable performance with state-of-the-art methods on the indoor benchmark (7-Scenes dataset) using only 20% training data.
  arXiv  Detail & Related papers  (2022-07-13T16:40:02Z)
• xView3-SAR: Detecting Dark Fishing Activity Using Synthetic Aperture Radar Imagery [52.67592123500567]
  Unsustainable fishing practices worldwide pose a major threat to marine resources and ecosystems. It is now possible to automate detection of dark vessels day or night, under all-weather conditions. xView3-SAR consists of nearly 1,000 analysis-ready SAR images from the Sentinel-1 mission.
  arXiv  Detail & Related papers  (2022-06-02T06:53:45Z)
• Towards Robust Monocular Visual Odometry for Flying Robots on Planetary Missions [49.79068659889639]
  Ingenuity, that just landed on Mars, will mark the beginning of a new era of exploration unhindered by traversability. We present an advanced robust monocular odometry algorithm that uses efficient optical flow tracking. We also present a novel approach to estimate the current risk of scale drift based on a principal component analysis of the relative translation information matrix.
  arXiv  Detail & Related papers  (2021-09-12T12:52:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.