Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capture
- URL: http://arxiv.org/abs/2506.10580v1
- Date: Thu, 12 Jun 2025 11:18:40 GMT
- Title: Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capture
- Abstract summary: We propose a novel dynamic calibration method for sparse inertial motion capture systems.<n>We achieve real-time estimation of RG'G and RBS under two relaxed assumptions.<n>To our knowledge, we are the first to achieve implicit IMU calibration.
- Score: 25.103306425456005
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose a novel dynamic calibration method for sparse inertial motion capture systems, which is the first to break the restrictive absolute static assumption in IMU calibration, i.e., the coordinate drift RG'G and measurement offset RBS remain constant during the entire motion, thereby significantly expanding their application scenarios. Specifically, we achieve real-time estimation of RG'G and RBS under two relaxed assumptions: i) the matrices change negligibly in a short time window; ii) the human movements/IMU readings are diverse in such a time window. Intuitively, the first assumption reduces the number of candidate matrices, and the second assumption provides diverse constraints, which greatly reduces the solution space and allows for accurate estimation of RG'G and RBS from a short history of IMU readings in real time. To achieve this, we created synthetic datasets of paired RG'G, RBS matrices and IMU readings, and learned their mappings using a Transformer-based model. We also designed a calibration trigger based on the diversity of IMU readings to ensure that assumption ii) is met before applying our method. To our knowledge, we are the first to achieve implicit IMU calibration (i.e., seamlessly putting IMUs into use without the need for an explicit calibration process), as well as the first to enable long-term and accurate motion capture using sparse IMUs. The code and dataset are available at https://github.com/ZuoCX1996/TIC.
Related papers
- Gravity-aware partially calibrated absolute pose estimation from affine- or rotation-covariant features [8.4929502957148]
Inertial measurement units (IMUs) are now standard in most consumer devices, such as smartphones, drones, and extended reality (XR) headsets.<n>By fusing visual and inertial data, localization systems gain significantly in speed and robustness compared to vision-only or IMU-only approaches.<n>Traditional pose estimation methods fail to utilize the local geometric information embedded in feature descriptors like SIFT.<n>Recent work has proved the advantages of leveraging this information for relative and absolute pose estimation, but its application to partially calibrated absolute pose estimation remains unexplored.
arXiv Detail & Related papers (2026-08-20T13:52:54Z) - Spatiotemporal Calibration and Ground Truth Estimation for High-Precision SLAM Benchmarking in Extended Reality [5.399977774911282]
Simultaneous localization and mapping (SLAM) plays a fundamental role in extended reality (XR) applications.<n>As the standards for immersion in immersive XR continue to increase, the demands for benchmarking have become more stringent.<n>This paper presents a novel continuous-time likelihood to address these challenges.
arXiv Detail & Related papers (2025-12-08T07:04:49Z) - WUSH: Near-Optimal Adaptive Transforms for LLM Quantization [52.77441224845925]
Quantization to low bitwidth is a standard approach for deploying large language models.<n>A few extreme weights and activations stretch the dynamic range and reduce the effective resolution of the quantizer.<n>We derive, for the first time, closed-form optimal linear blockwise transforms for joint weight-activation quantization.
arXiv Detail & Related papers (2025-11-30T16:17:34Z) - Neural 5G Indoor Localization with IMU Supervision [63.45775390000508]
Radio signals are well suited for user localization because they are ubiquitous, can operate in the dark and maintain privacy.
Many prior works learn mappings between channel state information (CSI) and position fully-supervised.
In this work, this requirement is relaxed by using pseudo-labels during deployment, which are calculated from an inertial measurement unit (IMU)
arXiv Detail & Related papers (2024-02-15T13:51:21Z) - SIMPL: A Simple and Efficient Multi-agent Motion Prediction Baseline for
Autonomous Driving [27.776472262857045]
This paper presents a Simple and effIcient Motion Prediction baseLine (SIMPL) for autonomous vehicles.
We propose a compact and efficient global feature fusion module that performs directed message passing in a symmetric manner.
As a strong baseline, SIMPL exhibits highly competitive performance on Argoverse 1 & 2 motion forecasting benchmarks.
arXiv Detail & Related papers (2024-02-04T15:07:49Z) - Multi-Visual-Inertial System: Analysis, Calibration and Estimation [26.658649118048032]
We study state estimation of multi-visual-inertial systems (MVIS) and develop sensor fusion algorithms.
We are interested in the full calibration of the associated visual-inertial sensors.
arXiv Detail & Related papers (2023-08-10T02:47:36Z) - Physics-based Reduced Order Modeling for Uncertainty Quantification of
Guided Wave Propagation using Bayesian Optimization [0.0]
Guided wave propagation (GWP) is commonly employed for the inspection of structures in structural health monitoring (SHM)
Uncertainty quantification (UQ) is regularly applied to improve the reliability of predictions.
We propose a machine learning (ML)-based reduced order model (ROM) to decrease the computational time related to the simulation of the GWP.
arXiv Detail & Related papers (2023-07-18T22:03:43Z) - Learning Controllable Adaptive Simulation for Multi-resolution Physics [86.8993558124143]
We introduce Learning controllable Adaptive simulation for Multi-resolution Physics (LAMP) as the first full deep learning-based surrogate model.
LAMP consists of a Graph Neural Network (GNN) for learning the forward evolution, and a GNN-based actor-critic for learning the policy of spatial refinement and coarsening.
We demonstrate that our LAMP outperforms state-of-the-art deep learning surrogate models, and can adaptively trade-off computation to improve long-term prediction error.
arXiv Detail & Related papers (2023-05-01T23:20:27Z) - Transformer Inertial Poser: Attention-based Real-time Human Motion
Reconstruction from Sparse IMUs [79.72586714047199]
We propose an attention-based deep learning method to reconstruct full-body motion from six IMU sensors in real-time.
Our method achieves new state-of-the-art results both quantitatively and qualitatively, while being simple to implement and smaller in size.
arXiv Detail & Related papers (2022-03-29T16:24:52Z) - DM-VIO: Delayed Marginalization Visual-Inertial Odometry [62.746533939737446]
We present DM-VIO, a visual-inertial system based on delayed marginalization and pose graph bundle adjustment.
We evaluate our system on the EuRoC, TUM-VI, and 4Seasons datasets, which comprise flying drone, large-scale handheld, and automotive scenarios.
arXiv Detail & Related papers (2022-01-11T18:30:37Z) - Trust Your IMU: Consequences of Ignoring the IMU Drift [2.253916533377465]
We develop the first-ever solver to jointly solve the relative pose problem with unknown and equal focal length and radial distortion profile.
We show significant speed-up compared to state-of-the-art algorithms, with small or negligible loss in accuracy for partially calibrated setups.
We evaluate the proposed solvers on different commercially available low-cost UAVs, and demonstrate that the novel assumption on IMU drift is feasible in real-life applications.
arXiv Detail & Related papers (2021-03-15T11:24:54Z) - Pushing the Envelope of Rotation Averaging for Visual SLAM [69.7375052440794]
We propose a novel optimization backbone for visual SLAM systems.
We leverage averaging to improve the accuracy, efficiency and robustness of conventional monocular SLAM systems.
Our approach can exhibit up to 10x faster with comparable accuracy against the state-art on public benchmarks.
arXiv Detail & Related papers (2020-11-02T18:02:26Z) - Transfer Learning for Motor Imagery Based Brain-Computer Interfaces: A
Complete Pipeline [54.73337667795997]
Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject.
This paper proposes that TL could be considered in all three components (spatial filtering, feature engineering, and classification) of MI-based BCIs.
arXiv Detail & Related papers (2020-07-03T23:44:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.