A Neuromorphic Vision-Based Measurement for Robust Relative Localization
in Future Space Exploration Missions
- URL: http://arxiv.org/abs/2206.11541v1
- Date: Thu, 23 Jun 2022 08:39:05 GMT
- Title: A Neuromorphic Vision-Based Measurement for Robust Relative Localization
in Future Space Exploration Missions
- Authors: Mohammed Salah, Mohammed Chehadah, Muhammed Humais, Mohammed Wahbah,
Abdulla Ayyad, Rana Azzam, Lakmal Senevirante, and Yahya Zweiri
- Abstract summary: This work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements.
The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Space exploration has witnessed revolutionary changes upon landing of the
Perseverance Rover on the Martian surface and demonstrating the first flight
beyond Earth by the Mars helicopter, Ingenuity. During their mission on Mars,
Perseverance Rover and Ingenuity collaboratively explore the Martian surface,
where Ingenuity scouts terrain information for rover's safe traversability.
Hence, determining the relative poses between both the platforms is of
paramount importance for the success of this mission. Driven by this necessity,
this work proposes a robust relative localization system based on a fusion of
neuromorphic vision-based measurements (NVBMs) and inertial measurements. The
emergence of neuromorphic vision triggered a paradigm shift in the computer
vision community, due to its unique working principle delineated with
asynchronous events triggered by variations of light intensities occurring in
the scene. This implies that observations cannot be acquired in static scenes
due to illumination invariance. To circumvent this limitation, high frequency
active landmarks are inserted in the scene to guarantee consistent event
firing. These landmarks are adopted as salient features to facilitate relative
localization. A novel event-based landmark identification algorithm using
Gaussian Mixture Models (GMM) is developed for matching the landmarks
correspondences formulating our NVBMs. The NVBMs are fused with inertial
measurements in proposed state estimators, landmark tracking Kalman filter
(LTKF) and translation decoupled Kalman filter (TDKF) for landmark tracking and
relative localization, respectively. The proposed system was tested in a
variety of experiments and has outperformed state-of-the-art approaches in
accuracy and range.
Related papers
- A Bionic Data-driven Approach for Long-distance Underwater Navigation with Anomaly Resistance [59.21686775951903]
Various animals exhibit accurate navigation using environment cues.
Inspired by animal navigation, this work proposes a bionic and data-driven approach for long-distance underwater navigation.
The proposed approach uses measured geomagnetic data for the navigation, and requires no GPS systems or geographical maps.
arXiv Detail & Related papers (2024-02-06T13:20:56Z) - Precision Mars Entry Navigation with Atmospheric Density Adaptation via Neural Networks [0.0]
This work introduces a new approach to online filtering for Martian entry using a neural network to estimate atmospheric density.
The network is trained on an exponential atmospheric density model, and its parameters are dynamically adapted in real time to account for any mismatch between the true and estimated densities.
arXiv Detail & Related papers (2024-01-17T19:10:09Z) - Unsupervised Landmark Discovery Using Consistency Guided Bottleneck [63.624186864522315]
We introduce a consistency-guided bottleneck in an image reconstruction-based pipeline.
We propose obtaining pseudo-supervision via forming landmark correspondence across images.
The consistency then modulates the uncertainty of the discovered landmarks in the generation of adaptive heatmaps.
arXiv Detail & Related papers (2023-09-19T10:57:53Z) - View Consistent Purification for Accurate Cross-View Localization [59.48131378244399]
This paper proposes a fine-grained self-localization method for outdoor robotics.
The proposed method addresses limitations in existing cross-view localization methods.
It is the first sparse visual-only method that enhances perception in dynamic environments.
arXiv Detail & Related papers (2023-08-16T02:51:52Z) - Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue
with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems.
This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
arXiv Detail & Related papers (2023-08-14T16:48:57Z) - Mixed-domain Training Improves Multi-Mission Terrain Segmentation [0.9566312408744931]
Current Martian terrain segmentation models require retraining for deployment across different domains.
This research proposes a semi-supervised learning approach that leverages unsupervised contrastive pretraining of a backbone for a multi-mission semantic segmentation for Martian surfaces.
arXiv Detail & Related papers (2022-09-27T20:25:24Z) - Exploring Event Camera-based Odometry for Planetary Robots [39.46226359115717]
Event cameras are poised to become enabling sensors for vision-based exploration on future Mars helicopter missions.
Existing event-based visual-inertial odometry (VIO) algorithms either suffer from high tracking errors or are brittle.
We introduce EKLT-VIO, which addresses both limitations by combining a state-of-the-art event-based with a filter-based backend.
arXiv Detail & Related papers (2022-04-12T15:19:50Z) - Towards Robust Monocular Visual Odometry for Flying Robots on Planetary
Missions [49.79068659889639]
Ingenuity, that just landed on Mars, will mark the beginning of a new era of exploration unhindered by traversability.
We present an advanced robust monocular odometry algorithm that uses efficient optical flow tracking.
We also present a novel approach to estimate the current risk of scale drift based on a principal component analysis of the relative translation information matrix.
arXiv Detail & Related papers (2021-09-12T12:52:20Z) - Gaussian Process Gradient Maps for Loop-Closure Detection in
Unstructured Planetary Environments [17.276441789710574]
The ability to recognize previously mapped locations is an essential feature for autonomous systems.
Unstructured planetary-like environments pose a major challenge to these systems due to the similarity of the terrain.
This paper presents a method to solve the loop closure problem using only spatial information.
arXiv Detail & Related papers (2020-09-01T04:41:40Z) - A Spatial-Temporal Attentive Network with Spatial Continuity for
Trajectory Prediction [74.00750936752418]
We propose a novel model named spatial-temporal attentive network with spatial continuity (STAN-SC)
First, spatial-temporal attention mechanism is presented to explore the most useful and important information.
Second, we conduct a joint feature sequence based on the sequence and instant state information to make the generative trajectories keep spatial continuity.
arXiv Detail & Related papers (2020-03-13T04:35:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.