Multi-Visual-Inertial System: Analysis, Calibration and Estimation
- URL: http://arxiv.org/abs/2308.05303v3
- Date: Fri, 24 Nov 2023 18:43:54 GMT
- Title: Multi-Visual-Inertial System: Analysis, Calibration and Estimation
- Authors: Yulin Yang and Patrick Geneva and Guoquan Huang
- Abstract summary: We study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms.
We are interested in the full calibration of the associated visual-inertial sensors.
- Score: 29.96165001561947
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we study state estimation of multi-visual-inertial systems
(MVIS) and develop sensor fusion algorithms to optimally fuse an arbitrary
number of asynchronous inertial measurement units (IMUs) or gyroscopes and
global and(or) rolling shutter cameras. We are especially interested in the
full calibration of the associated visual-inertial sensors, including the IMU
or camera intrinsics and the IMU-IMU(or camera) spatiotemporal extrinsics as
well as the image readout time of rolling-shutter cameras (if used). To this
end, we develop a new analytic combined IMU integration with intrinsics-termed
ACI3-to preintegrate IMU measurements, which is leveraged to fuse auxiliary
IMUs and(or) gyroscopes alongside a base IMU. We model the multi-inertial
measurements to include all the necessary inertial intrinsic and IMU-IMU
spatiotemporal extrinsic parameters, while leveraging IMU-IMU rigid-body
constraints to eliminate the necessity of auxiliary inertial poses and thus
reducing computational complexity. By performing observability analysis of
MVIS, we prove that the standard four unobservable directions remain - no
matter how many inertial sensors are used, and also identify, for the first
time, degenerate motions for IMU-IMU spatiotemporal extrinsics and auxiliary
inertial intrinsics. In addition to the extensive simulations that validate our
analysis and algorithms, we have built our own MVIS sensor rig and collected
over 25 real-world datasets to experimentally verify the proposed calibration
against the state-of-the-art calibration method such as Kalibr. We show that
the proposed MVIS calibration is able to achieve competing accuracy with
improved convergence and repeatability, which is open sourced to better benefit
the community.
Related papers
- Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution [49.902047563260496]
We develop the first attempt to integrate the Vision State Space Model (Mamba) for remote sensing image (RSI) super-resolution.
To achieve better SR reconstruction, building upon Mamba, we devise a Frequency-assisted Mamba framework, dubbed FMSR.
Our FMSR features a multi-level fusion architecture equipped with the Frequency Selection Module (FSM), Vision State Space Module (VSSM), and Hybrid Gate Module (HGM)
arXiv Detail & Related papers (2024-05-08T11:09:24Z) - Traj-LIO: A Resilient Multi-LiDAR Multi-IMU State Estimator Through
Sparse Gaussian Process [20.452961476175812]
We introduce a multi-LiDAR multi-IMU state estimator by taking advantage of Gaussian Process (GP)
Our proposed approach is capable of handling different sensor configurations and resilient to sensor failures.
To contribute to the community, we will make our source code publicly available.
arXiv Detail & Related papers (2024-02-14T14:08:06Z) - A Multi-Grained Symmetric Differential Equation Model for Learning
Protein-Ligand Binding Dynamics [74.93549765488103]
In drug discovery, molecular dynamics simulation provides a powerful tool for predicting binding affinities, estimating transport properties, and exploring pocket sites.
We propose NeuralMD, the first machine learning surrogate that can facilitate numerical MD and provide accurate simulations in protein-ligand binding.
We show the efficiency and effectiveness of NeuralMD, with a 2000$times$ speedup over standard numerical MD simulation and outperforming all other ML approaches by up to 80% under the stability metric.
arXiv Detail & Related papers (2024-01-26T09:35:17Z) - Towards Scale-Aware, Robust, and Generalizable Unsupervised Monocular
Depth Estimation by Integrating IMU Motion Dynamics [74.1720528573331]
Unsupervised monocular depth and ego-motion estimation has drawn extensive research attention in recent years.
We propose DynaDepth, a novel scale-aware framework that integrates information from vision and IMU motion dynamics.
We validate the effectiveness of DynaDepth by conducting extensive experiments and simulations on the KITTI and Make3D datasets.
arXiv Detail & Related papers (2022-07-11T07:50:22Z) - Transformer Inertial Poser: Attention-based Real-time Human Motion
Reconstruction from Sparse IMUs [79.72586714047199]
We propose an attention-based deep learning method to reconstruct full-body motion from six IMU sensors in real-time.
Our method achieves new state-of-the-art results both quantitatively and qualitatively, while being simple to implement and smaller in size.
arXiv Detail & Related papers (2022-03-29T16:24:52Z) - Trust Your IMU: Consequences of Ignoring the IMU Drift [2.253916533377465]
We develop the first-ever solver to jointly solve the relative pose problem with unknown and equal focal length and radial distortion profile.
We show significant speed-up compared to state-of-the-art algorithms, with small or negligible loss in accuracy for partially calibrated setups.
We evaluate the proposed solvers on different commercially available low-cost UAVs, and demonstrate that the novel assumption on IMU drift is feasible in real-life applications.
arXiv Detail & Related papers (2021-03-15T11:24:54Z) - Deep Inertial Odometry with Accurate IMU Preintegration [16.598260336275892]
Inertial Measurement Units (IMUs) are interceptive modalities that provide ego-motion measurements independent of the environmental factors.
In this study, we aim to investigate the efficacy of accurate preintegration as a more realistic solution to the IMU motion model for deep inertial odometry (DIO)
The resultant DIO is a fusion of model-driven and data-driven approaches.
arXiv Detail & Related papers (2021-01-18T13:16:04Z) - Statistical control for spatio-temporal MEG/EEG source imaging with
desparsified multi-task Lasso [102.84915019938413]
Non-invasive techniques like magnetoencephalography (MEG) or electroencephalography (EEG) offer promise of non-invasive techniques.
The problem of source localization, or source imaging, poses however a high-dimensional statistical inference challenge.
We propose an ensemble of desparsified multi-task Lasso (ecd-MTLasso) to deal with this problem.
arXiv Detail & Related papers (2020-09-29T21:17:16Z) - MIMC-VINS: A Versatile and Resilient Multi-IMU Multi-Camera
Visual-Inertial Navigation System [44.76768683036822]
We propose a real-time consistent multi-IMU multi-camera (CMU)-VINS estimator for visual-inertial navigation systems.
Within an efficient multi-state constraint filter, the proposed MIMC-VINS algorithm optimally fuses asynchronous measurements from all sensors.
The proposed MIMC-VINS is validated in both Monte-Carlo simulations and real-world experiments.
arXiv Detail & Related papers (2020-06-28T20:16:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.