Brain-Inspired Visual Odometry: Balancing Speed and Interpretability
through a System of Systems Approach
- URL: http://arxiv.org/abs/2312.13162v1
- Date: Wed, 20 Dec 2023 16:23:48 GMT
- Title: Brain-Inspired Visual Odometry: Balancing Speed and Interpretability
through a System of Systems Approach
- Authors: Habib Boloorchi Tabrizi, Christopher Crick
- Abstract summary: This study addresses the challenge of balancing speed and accuracy in visual odometry (VO) systems.
Traditional VO systems often face a trade-off between computational speed and the precision of pose estimation.
Our system is unique in its approach to handle each degree of freedom independently within the fully connected network (FCN)
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: In this study, we address the critical challenge of balancing speed and
accuracy while maintaining interpretablity in visual odometry (VO) systems, a
pivotal aspect in the field of autonomous navigation and robotics. Traditional
VO systems often face a trade-off between computational speed and the precision
of pose estimation. To tackle this issue, we introduce an innovative system
that synergistically combines traditional VO methods with a specifically
tailored fully connected network (FCN). Our system is unique in its approach to
handle each degree of freedom independently within the FCN, placing a strong
emphasis on causal inference to enhance interpretability. This allows for a
detailed and accurate assessment of relative pose error (RPE) across various
degrees of freedom, providing a more comprehensive understanding of parameter
variations and movement dynamics in different environments. Notably, our system
demonstrates a remarkable improvement in processing speed without compromising
accuracy. In certain scenarios, it achieves up to a 5% reduction in Root Mean
Square Error (RMSE), showcasing its ability to effectively bridge the gap
between speed and accuracy that has long been a limitation in VO research. This
advancement represents a significant step forward in developing more efficient
and reliable VO systems, with wide-ranging applications in real-time navigation
and robotic systems.
Related papers
- Task-Oriented Real-time Visual Inference for IoVT Systems: A Co-design Framework of Neural Networks and Edge Deployment [61.20689382879937]
Task-oriented edge computing addresses this by shifting data analysis to the edge.
Existing methods struggle to balance high model performance with low resource consumption.
We propose a novel co-design framework to optimize neural network architecture.
arXiv Detail & Related papers (2024-10-29T19:02:54Z) - SLIDE: A machine-learning based method for forced dynamic response estimation of multibody systems [42.87502453001109]
SLiding-window Initially-truncated Dynamic-response Estimator (SLIDE)
Deep learning-based method designed to estimate output sequences of mechanical or multibody systems.
Results demonstrate significant speedups from the simulation up to several millions, exceeding real-time performance substantially.
arXiv Detail & Related papers (2024-09-26T20:34:07Z) - Visual Agents as Fast and Slow Thinkers [88.6691504568041]
We introduce FaST, which incorporates the Fast and Slow Thinking mechanism into visual agents.
FaST employs a switch adapter to dynamically select between System 1/2 modes.
It tackles uncertain and unseen objects by adjusting model confidence and integrating new contextual data.
arXiv Detail & Related papers (2024-08-16T17:44:02Z) - Graph Neural Networks for Virtual Sensing in Complex Systems: Addressing Heterogeneous Temporal Dynamics [8.715570103753697]
Real-time condition monitoring is crucial for the reliable and efficient operation of complex systems.
We propose a Heterogeneous Temporal Graph Neural Network (HTGNN) framework to address this problem.
HTGNN explicitly models signals from diverse sensors and integrates operating conditions into the model architecture.
arXiv Detail & Related papers (2024-07-26T12:16:53Z) - Reinforcement Learning Meets Visual Odometry [22.34784125002176]
We reframing Visual Odometry (VO) as a decision-making task and applying Reinforcement Learning (RL) to adapt the VO process dynamically.
Our approach introduces a neural network, operating as an agent within the VO pipeline, to make decisions such as sequential and grid-size selection.
Our method minimizes reliance on choices using a reward function based on pose error, runtime, and other metrics to guide the system.
arXiv Detail & Related papers (2024-07-22T13:37:55Z) - RefreshNet: Learning Multiscale Dynamics through Hierarchical Refreshing [0.0]
"refreshing" mechanism in RefreshNet allows coarser blocks to reset inputs of finer blocks, effectively controlling and alleviating error accumulation.
"refreshing" mechanism in RefreshNet allows coarser blocks to reset inputs of finer blocks, effectively controlling and alleviating error accumulation.
arXiv Detail & Related papers (2024-01-24T07:47:01Z) - On Robust Numerical Solver for ODE via Self-Attention Mechanism [82.95493796476767]
We explore training efficient and robust AI-enhanced numerical solvers with a small data size by mitigating intrinsic noise disturbances.
We first analyze the ability of the self-attention mechanism to regulate noise in supervised learning and then propose a simple-yet-effective numerical solver, Attr, which introduces an additive self-attention mechanism to the numerical solution of differential equations.
arXiv Detail & Related papers (2023-02-05T01:39:21Z) - On Fast Simulation of Dynamical System with Neural Vector Enhanced
Numerical Solver [59.13397937903832]
We introduce a deep learning-based corrector called Neural Vector (NeurVec)
NeurVec can compensate for integration errors and enable larger time step sizes in simulations.
Our experiments on a variety of complex dynamical system benchmarks demonstrate that NeurVec exhibits remarkable generalization capability.
arXiv Detail & Related papers (2022-08-07T09:02:18Z) - Scalable Vehicle Re-Identification via Self-Supervision [66.2562538902156]
Vehicle Re-Identification is one of the key elements in city-scale vehicle analytics systems.
Many state-of-the-art solutions for vehicle re-id mostly focus on improving the accuracy on existing re-id benchmarks and often ignore computational complexity.
We propose a simple yet effective hybrid solution empowered by self-supervised training which only uses a single network during inference time.
arXiv Detail & Related papers (2022-05-16T12:14:42Z) - Differentially Private Federated Learning via Reconfigurable Intelligent
Surface [27.004823731436765]
Federated learning (FL) enables the collaborative training of a global model over decentralized local datasets without sharing them.
We propose a reconfigurable intelligent surface (RIS) empowered over-the-air FL system to alleviate the dilemma between learning accuracy and privacy.
arXiv Detail & Related papers (2022-03-31T13:45:02Z) - Efficient and Robust LiDAR-Based End-to-End Navigation [132.52661670308606]
We present an efficient and robust LiDAR-based end-to-end navigation framework.
We propose Fast-LiDARNet that is based on sparse convolution kernel optimization and hardware-aware model design.
We then propose Hybrid Evidential Fusion that directly estimates the uncertainty of the prediction from only a single forward pass.
arXiv Detail & Related papers (2021-05-20T17:52:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.