A Hybrid Learner for Simultaneous Localization and Mapping
- URL: http://arxiv.org/abs/2101.01158v1
- Date: Mon, 4 Jan 2021 18:41:09 GMT
- Title: A Hybrid Learner for Simultaneous Localization and Mapping
- Authors: Thangarajah Akilan and Edna Johnson and Japneet Sandhu and Ritika
Chadha and Gaurav Taluja
- Abstract summary: Simultaneous localization and mapping (SLAM) is used to predict the dynamic motion path of a moving platform.
This work introduces a hybrid learning model that explores beyond feature fusion.
It carries out weight enhancement of the front end feature extractor of the SLAM via mutation of different deep networks' top layers.
The trajectory predictions from independently trained models are amalgamated to refine the location detail.
- Score: 2.1041384320978267
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Simultaneous localization and mapping (SLAM) is used to predict the dynamic
motion path of a moving platform based on the location coordinates and the
precise mapping of the physical environment. SLAM has great potential in
augmented reality (AR), autonomous vehicles, viz. self-driving cars, drones,
Autonomous navigation robots (ANR). This work introduces a hybrid learning
model that explores beyond feature fusion and conducts a multimodal weight
sewing strategy towards improving the performance of a baseline SLAM algorithm.
It carries out weight enhancement of the front end feature extractor of the
SLAM via mutation of different deep networks' top layers. At the same time, the
trajectory predictions from independently trained models are amalgamated to
refine the location detail. Thus, the integration of the aforesaid early and
late fusion techniques under a hybrid learning framework minimizes the
translation and rotation errors of the SLAM model. This study exploits some
well-known deep learning (DL) architectures, including ResNet18, ResNet34,
ResNet50, ResNet101, VGG16, VGG19, and AlexNet for experimental analysis. An
extensive experimental analysis proves that hybrid learner (HL) achieves
significantly better results than the unimodal approaches and multimodal
approaches with early or late fusion strategies. Hence, it is found that the
Apolloscape dataset taken in this work has never been used in the literature
under SLAM with fusion techniques, which makes this work unique and insightful.
Related papers
- Deep Learning Methods for Adjusting Global MFD Speed Estimations to Local Link Configurations [4.2185937778110825]
This study introduces a Local Correction Factor (LCF) that integrates MFD-derived network mean speed with network configurations to accurately estimate the individual speed of a link.
We use a novel deep learning framework to capture both spatial configurations and temporal dynamics of the network.
Our model enhances the precision of link-level traffic speed estimations while preserving the computational benefits of aggregate models.
arXiv Detail & Related papers (2024-05-23T07:37:33Z) - Probing Multimodal LLMs as World Models for Driving [72.18727651074563]
This study focuses on the application of Multimodal Large Language Models (MLLMs) within the domain of autonomous driving.
We evaluate the capability of various MLLMs as world models for driving from the perspective of a fixed in-car camera.
Our results highlight a critical gap in the current capabilities of state-of-the-art MLLMs.
arXiv Detail & Related papers (2024-05-09T17:52:42Z) - A Collaborative Model-driven Network for MRI Reconstruction [9.441882492801174]
We propose a collaborative model-driven network to exploit the complementarity of different regularizers.
We show significant improvements in the final results without additional computational costs.
arXiv Detail & Related papers (2024-02-04T07:29:00Z) - Learning Controllable Adaptive Simulation for Multi-resolution Physics [86.8993558124143]
We introduce Learning controllable Adaptive simulation for Multi-resolution Physics (LAMP) as the first full deep learning-based surrogate model.
LAMP consists of a Graph Neural Network (GNN) for learning the forward evolution, and a GNN-based actor-critic for learning the policy of spatial refinement and coarsening.
We demonstrate that our LAMP outperforms state-of-the-art deep learning surrogate models, and can adaptively trade-off computation to improve long-term prediction error.
arXiv Detail & Related papers (2023-05-01T23:20:27Z) - Gradient-Based Trajectory Optimization With Learned Dynamics [80.41791191022139]
We use machine learning techniques to learn a differentiable dynamics model of the system from data.
We show that a neural network can model highly nonlinear behaviors accurately for large time horizons.
In our hardware experiments, we demonstrate that our learned model can represent complex dynamics for both the Spot and Radio-controlled (RC) car.
arXiv Detail & Related papers (2022-04-09T22:07:34Z) - Parallel Successive Learning for Dynamic Distributed Model Training over
Heterogeneous Wireless Networks [50.68446003616802]
Federated learning (FedL) has emerged as a popular technique for distributing model training over a set of wireless devices.
We develop parallel successive learning (PSL), which expands the FedL architecture along three dimensions.
Our analysis sheds light on the notion of cold vs. warmed up models, and model inertia in distributed machine learning.
arXiv Detail & Related papers (2022-02-07T05:11:01Z) - Aerial Images Meet Crowdsourced Trajectories: A New Approach to Robust
Road Extraction [110.61383502442598]
We introduce a novel neural network framework termed Cross-Modal Message Propagation Network (CMMPNet)
CMMPNet is composed of two deep Auto-Encoders for modality-specific representation learning and a tailor-designed Dual Enhancement Module for cross-modal representation refinement.
Experiments on three real-world benchmarks demonstrate the effectiveness of our CMMPNet for robust road extraction.
arXiv Detail & Related papers (2021-11-30T04:30:10Z) - A Hybrid Sparse-Dense Monocular SLAM System for Autonomous Driving [0.5735035463793008]
We reconstruct a dense 3D model of the geometry of an outdoor environment using a single monocular camera attached to a moving vehicle.
Our system employs dense depth prediction with a hybrid mapping architecture combining state-of-the-art sparse features and dense fusion-based visual SLAM algorithms.
arXiv Detail & Related papers (2021-08-17T16:13:01Z) - Distributed Dynamic Map Fusion via Federated Learning for Intelligent
Networked Vehicles [9.748996198083425]
This paper proposes a federated learning based dynamic map fusion framework to achieve high map quality.
The proposed framework is implemented in the Car Learning to Act (CARLA) simulation platform.
arXiv Detail & Related papers (2021-03-05T16:28:46Z) - Attention-SLAM: A Visual Monocular SLAM Learning from Human Gaze [19.99938539199779]
This paper proposes a novel simultaneous localization and mapping (SLAM) approach, namely Attention-SLAM.
It combines a visual saliency model (SalNavNet) with traditional monocular visual SLAM.
Test results prove that Attention-SLAM outperforms benchmarks such as Direct Sparse Odometry (DSO), ORB-SLAM, and Salient DSO.
arXiv Detail & Related papers (2020-09-15T06:59:12Z) - A Generative Learning Approach for Spatio-temporal Modeling in Connected
Vehicular Network [55.852401381113786]
This paper proposes LaMI (Latency Model Inpainting), a novel framework to generate a comprehensive-temporal quality framework for wireless access latency of connected vehicles.
LaMI adopts the idea from image inpainting and synthesizing and can reconstruct the missing latency samples by a two-step procedure.
In particular, it first discovers the spatial correlation between samples collected in various regions using a patching-based approach and then feeds the original and highly correlated samples into a Varienational Autocoder (VAE)
arXiv Detail & Related papers (2020-03-16T03:43:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.