Self-Supervised Learning to Guide Scientifically Relevant Categorization of Martian Terrain Images

• URL: http://arxiv.org/abs/2204.09854v1
• Date: Thu, 21 Apr 2022 02:48:40 GMT
• Title: Self-Supervised Learning to Guide Scientifically Relevant Categorization of Martian Terrain Images
• Authors: Tejas Panambur, Deep Chakraborty, Melissa Meyer, Ralph Milliken, Erik Learned-Miller, Mario Parente
• Abstract summary: We present a self-supervised method that can cluster sedimentary textures in images captured from the Mast camera onboard the Curiosity rover. We then present a qualitative analysis of these clusters and describe their geologic significance via the creation of a set of granular terrain categories.
• Score: 1.282755489335386
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automatic terrain recognition in Mars rover images is an important problem not just for navigation, but for scientists interested in studying rock types, and by extension, conditions of the ancient Martian paleoclimate and habitability. Existing approaches to label Martian terrain either involve the use of non-expert annotators producing taxonomies of limited granularity (e.g. soil, sand, bedrock, float rock, etc.), or rely on generic class discovery approaches that tend to produce perceptual classes such as rover parts and landscape, which are irrelevant to geologic analysis. Expert-labeled datasets containing granular geological/geomorphological terrain categories are rare or inaccessible to public, and sometimes require the extraction of relevant categorical information from complex annotations. In order to facilitate the creation of a dataset with detailed terrain categories, we present a self-supervised method that can cluster sedimentary textures in images captured from the Mast camera onboard the Curiosity rover (Mars Science Laboratory). We then present a qualitative analysis of these clusters and describe their geologic significance via the creation of a set of granular terrain categories. The precision and geologic validation of these automatically discovered clusters suggest that our methods are promising for the rapid classification of important geologic features and will therefore facilitate our long-term goal of producing a large, granular, and publicly available dataset for Mars terrain recognition.

Related papers

• Deep Semantic Model Fusion for Ancient Agricultural Terrace Detection [17.102691286544136]
  We propose a deep semantic model fusion method for ancient agricultural terrace detection. The proposed method won the first prize in the International AI Archaeology Challenge.
  arXiv  Detail & Related papers  (2023-08-04T09:42:14Z)
• Knowledge distillation with Segment Anything (SAM) model for Planetary Geological Mapping [0.7266531288894184]
  We show the effectiveness of a prompt-based foundation model for rapid annotation and quick adaptability to a prime use case of mapping planetary skylights. Key results indicate that the use of knowledge distillation can significantly reduce the effort required by domain experts for manual annotation. This approach has the potential to accelerate extra-terrestrial discovery by automatically detecting and segmenting Martian landforms.
  arXiv  Detail & Related papers  (2023-05-12T16:30:58Z)
• Semi-Automated Segmentation of Geoscientific Data Using Superpixels [4.035753155957697]
  Geological processes determine the distribution of resources such as critical minerals, water, and geothermal energy. Inspired by the concept of superpixels, we propose a deep-learning based approach to segmentized survey data into regions with similar characteristics.
  arXiv  Detail & Related papers  (2023-03-20T19:21:46Z)
• Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection [57.85347204640585]
  We develop a Universal Domain Adaptation method DeepAstroUDA. It can be applied to datasets with different types of class overlap. For the first time, we demonstrate the successful use of domain adaptation on two very different observational datasets.
  arXiv  Detail & Related papers  (2022-11-01T18:07:21Z)
• PetroGAN: A novel GAN-based approach to generate realistic, label-free petrographic datasets [0.0]
  We develop a novel deep learning framework based on generative adversarial networks (GANs) to create the first realistic synthetic petrographic dataset. The training dataset consists of 10070 images of rock thin sections both in plane- and cross-polarized light. The algorithm trained for 264 GPU hours and reached a state-of-the-art Fr'echet Inception Distance (FID) score of 12.49 for petrographic images.
  arXiv  Detail & Related papers  (2022-04-07T01:55:53Z)
• AutoGeoLabel: Automated Label Generation for Geospatial Machine Learning [69.47585818994959]
  We evaluate a big data processing pipeline to auto-generate labels for remote sensing data. We utilize the big geo-data platform IBM PAIRS to dynamically generate such labels in dense urban areas.
  arXiv  Detail & Related papers  (2022-01-31T20:02:22Z)
• Towards Robust Monocular Visual Odometry for Flying Robots on Planetary Missions [49.79068659889639]
  Ingenuity, that just landed on Mars, will mark the beginning of a new era of exploration unhindered by traversability. We present an advanced robust monocular odometry algorithm that uses efficient optical flow tracking. We also present a novel approach to estimate the current risk of scale drift based on a principal component analysis of the relative translation information matrix.
  arXiv  Detail & Related papers  (2021-09-12T12:52:20Z)
• Generalized Unsupervised Clustering of Hyperspectral Images of Geological Targets in the Near Infrared [0.0]
  Clustering and classifying spectrally similar materials is often a first step in applications ranging from economic mineral exploration on Earth to planetary exploration on Mars. Here we develop a fully unsupervised workflow for feature extraction and clustering informed by both expert spectral geologist input and quantitative metrics. This pipeline provides a fast and accurate clustering map of similar geological materials and consistently identifies and separates major mineral classes in both laboratory imagery and remote sensing imagery.
  arXiv  Detail & Related papers  (2021-06-24T21:05:10Z)
• Potato Crop Stress Identification in Aerial Images using Deep Learning-based Object Detection [60.83360138070649]
  The paper presents an approach for analyzing aerial images of a potato crop using deep neural networks. The main objective is to demonstrate automated spatial recognition of a healthy versus stressed crop at a plant level. Experimental validation demonstrated the ability for distinguishing healthy and stressed plants in field images, achieving an average Dice coefficient of 0.74.
  arXiv  Detail & Related papers  (2021-06-14T21:57:40Z)
• Geo-Spatiotemporal Features and Shape-Based Prior Knowledge for Fine-grained Imbalanced Data Classification [63.916371837696396]
  Fine-grained classification aims at distinguishing between items with similar global perception and patterns, but that differ by minute details. Our primary challenges come from both small inter-class variations and large intra-class variations. We propose to combine several innovations to improve fine-grained classification within the use-case of wildlife.
  arXiv  Detail & Related papers  (2021-03-21T02:01:38Z)
• Semi-Supervised Semantic Segmentation in Earth Observation: The MiniFrance Suite, Dataset Analysis and Multi-task Network Study [82.02173199363571]
  We introduce a novel large-scale dataset for semi-supervised semantic segmentation in Earth Observation, the MiniFrance suite. MiniFrance has several unprecedented properties: it is large-scale, containing over 2000 very high resolution aerial images, accounting for more than 200 billions samples (pixels) We present tools for data representativeness analysis in terms of appearance similarity and a thorough study of MiniFrance data, demonstrating that it is suitable for learning and generalizes well in a semi-supervised setting.
  arXiv  Detail & Related papers  (2020-10-15T15:36:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.