A Neuromorphic Vision-Based Measurement for Robust Relative Localization in Future Space Exploration Missions

• URL: http://arxiv.org/abs/2206.11541v1
• Date: Thu, 23 Jun 2022 08:39:05 GMT
• Title: A Neuromorphic Vision-Based Measurement for Robust Relative Localization in Future Space Exploration Missions
• Authors: Mohammed Salah, Mohammed Chehadah, Muhammed Humais, Mohammed Wahbah, Abdulla Ayyad, Rana Azzam, Lakmal Senevirante, and Yahya Zweiri
• Abstract summary: This work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements. The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Space exploration has witnessed revolutionary changes upon landing of the Perseverance Rover on the Martian surface and demonstrating the first flight beyond Earth by the Mars helicopter, Ingenuity. During their mission on Mars, Perseverance Rover and Ingenuity collaboratively explore the Martian surface, where Ingenuity scouts terrain information for rover's safe traversability. Hence, determining the relative poses between both the platforms is of paramount importance for the success of this mission. Driven by this necessity, this work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements. The emergence of neuromorphic vision triggered a paradigm shift in the computer vision community, due to its unique working principle delineated with asynchronous events triggered by variations of light intensities occurring in the scene. This implies that observations cannot be acquired in static scenes due to illumination invariance. To circumvent this limitation, high frequency active landmarks are inserted in the scene to guarantee consistent event firing. These landmarks are adopted as salient features to facilitate relative localization. A novel event-based landmark identification algorithm using Gaussian Mixture Models (GMM) is developed for matching the landmarks correspondences formulating our NVBMs. The NVBMs are fused with inertial measurements in proposed state estimators, landmark tracking Kalman filter (LTKF) and translation decoupled Kalman filter (TDKF) for landmark tracking and relative localization, respectively. The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.

Related papers

• MARs: Multi-view Attention Regularizations for Patch-based Feature Recognition of Space Terrain [4.87717454493713]
  Current approaches rely on template matching with pre-gathered patch-based features. We introduce Multi-view Attention Regularizations (MARs) to constrain the channel and spatial attention across multiple feature views. We demonstrate improved terrain-feature recognition performance by upwards of 85%.
  arXiv  Detail & Related papers  (2024-10-07T16:41:45Z)
• Structure-Invariant Range-Visual-Inertial Odometry [17.47284320862407]
  This work introduces a novel range-visual-inertial odometry system tailored for the Mars Science Helicopter mission. Our system extends the state-of-the-art xVIO framework by fusing consistent range information with visual and inertial measurements. We demonstrate that our range-VIO approach estimates terrain-relative velocity meeting the stringent mission requirements.
  arXiv  Detail & Related papers  (2024-09-06T21:49:10Z)
• A Bionic Data-driven Approach for Long-distance Underwater Navigation with Anomaly Resistance [59.21686775951903]
  Various animals exhibit accurate navigation using environment cues. Inspired by animal navigation, this work proposes a bionic and data-driven approach for long-distance underwater navigation. The proposed approach uses measured geomagnetic data for the navigation, and requires no GPS systems or geographical maps.
  arXiv  Detail & Related papers  (2024-02-06T13:20:56Z)
• Unsupervised Landmark Discovery Using Consistency Guided Bottleneck [63.624186864522315]
  We introduce a consistency-guided bottleneck in an image reconstruction-based pipeline. We propose obtaining pseudo-supervision via forming landmark correspondence across images. The consistency then modulates the uncertainty of the discovered landmarks in the generation of adaptive heatmaps.
  arXiv  Detail & Related papers  (2023-09-19T10:57:53Z)
• View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
  This paper proposes a fine-grained self-localization method for outdoor robotics. The proposed method addresses limitations in existing cross-view localization methods. It is the first sparse visual-only method that enhances perception in dynamic environments.
  arXiv  Detail & Related papers  (2023-08-16T02:51:52Z)
• Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
  Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems. This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
  arXiv  Detail & Related papers  (2023-08-14T16:48:57Z)
• Mixed-domain Training Improves Multi-Mission Terrain Segmentation [0.9566312408744931]
  Current Martian terrain segmentation models require retraining for deployment across different domains. This research proposes a semi-supervised learning approach that leverages unsupervised contrastive pretraining of a backbone for a multi-mission semantic segmentation for Martian surfaces.
  arXiv  Detail & Related papers  (2022-09-27T20:25:24Z)
• Exploring Event Camera-based Odometry for Planetary Robots [39.46226359115717]
  Event cameras are poised to become enabling sensors for vision-based exploration on future Mars helicopter missions. Existing event-based visual-inertial odometry (VIO) algorithms either suffer from high tracking errors or are brittle. We introduce EKLT-VIO, which addresses both limitations by combining a state-of-the-art event-based with a filter-based backend.
  arXiv  Detail & Related papers  (2022-04-12T15:19:50Z)
• Towards Robust Monocular Visual Odometry for Flying Robots on Planetary Missions [49.79068659889639]
  Ingenuity, that just landed on Mars, will mark the beginning of a new era of exploration unhindered by traversability. We present an advanced robust monocular odometry algorithm that uses efficient optical flow tracking. We also present a novel approach to estimate the current risk of scale drift based on a principal component analysis of the relative translation information matrix.
  arXiv  Detail & Related papers  (2021-09-12T12:52:20Z)
• A Spatial-Temporal Attentive Network with Spatial Continuity for Trajectory Prediction [74.00750936752418]
  We propose a novel model named spatial-temporal attentive network with spatial continuity (STAN-SC) First, spatial-temporal attention mechanism is presented to explore the most useful and important information. Second, we conduct a joint feature sequence based on the sequence and instant state information to make the generative trajectories keep spatial continuity.
  arXiv  Detail & Related papers  (2020-03-13T04:35:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.