ROFT-VINS: Robust Feature Tracking-based Visual-Inertial State Estimation for Harsh Environment

• URL: http://arxiv.org/abs/2603.18746v1
• Date: Thu, 19 Mar 2026 10:49:22 GMT
• Title: ROFT-VINS: Robust Feature Tracking-based Visual-Inertial State Estimation for Harsh Environment
• Abstract summary: We propose a method that leverages deep learning to robustly track visual features in monocular camera images.<n>This method operates reliably even in textureless environments and situations with rapid lighting changes.<n>We evaluate the performance of our proposed method by integrating it into VINS-Fusion, a commonly used Visual-Inertial Odometry (VIO) system.
• Score: 8.10554738370527
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: SLAM (Simultaneous Localization and Mapping) and Odometry are important systems for estimating the position of mobile devices, such as robots and cars, utilizing one or more sensors. Particularly in camera-based SLAM or Odometry, effectively tracking visual features is important as it significantly impacts system performance. In this paper, we propose a method that leverages deep learning to robustly track visual features in monocular camera images. This method operates reliably even in textureless environments and situations with rapid lighting changes. Additionally, we evaluate the performance of our proposed method by integrating it into VINS-Fusion (Monocular-Inertial), a commonly used Visual-Inertial Odometry (VIO) system.

Related papers

• Sensor Configuration Matters: A Systematic Evaluation of Multimodal SLAM on Quadruped Robots [15.924751226144979]
  We present a systematic evaluation of state-of-the-art visual, visual-inertial, and LiDAR-visual-inertial SLAM methods.<n>We quantify the impacts of camera modalities, shutter techniques, and inertial sensor tiers, analyzing their trade-offs across localization accuracy, algorithmic robustness, and computational resource utilization.
  arXiv  Detail & Related papers  (2026-06-17T13:41:07Z)
• VGP-Nav: Metric-Aware Visual Geometric Perception for Robot Navigation [59.44896676402453]
  VGP-Nav is a unified framework for textitMetric-Aware Visual Geometric Perception<n>It relies solely on monocular RGB input to jointly support metric localization and obstacle perception.<n>VGP-Nav resolves monocular scale ambiguity online and produces localization-grounded, metric obstacle representations.
  arXiv  Detail & Related papers  (2026-06-08T09:38:14Z)
• Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling [68.1289208938377]
  Eye feature extraction from event-based data streams can be performed efficiently and with low energy consumption.<n>We introduce the emphadaptive inference state space model (AISSM), a novel architecture for feature extraction.<n>We also craft and evaluate a novel learning technique that improves training efficiency.
  arXiv  Detail & Related papers  (2026-03-14T18:47:08Z)
• How to deal with glare for improved perception of Autonomous Vehicles [0.0]
  Vision sensors are versatile and can capture a wide range of visual cues, such as color, texture, shape, and depth. vision-based environment perception systems can be easily affected by glare in the presence of a bright source of light.
  arXiv  Detail & Related papers  (2024-04-17T02:05:05Z)
• Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality [2.2639735235640015]
  This work provides an objective assessment of the impact of several contemporary machine learning (ML)-based methods for eye feature tracking. Metrics include the accuracy and precision of the gaze estimate, as well as drop-out rate.
  arXiv  Detail & Related papers  (2024-03-28T18:43:25Z)
• LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry [53.5449912019877]
  We present the Long-term Effective Any Point Tracking (LEAP) module.<n>LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation.<n>Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes.
  arXiv  Detail & Related papers  (2024-01-03T18:57:27Z)
• Inertial Guided Uncertainty Estimation of Feature Correspondence in Visual-Inertial Odometry/SLAM [8.136426395547893]
  We propose a method to estimate the uncertainty of feature correspondence using an inertial guidance. We also demonstrate the feasibility of our approach by incorporating it into one of recent visual-inertial odometry/SLAM algorithms.
  arXiv  Detail & Related papers  (2023-11-07T04:56:29Z)
• RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments [55.864869961717424]
  It is typically challenging for visual or visual-inertial odometry systems to handle the problems of dynamic scenes and pure rotation. We design a novel visual-inertial odometry (VIO) system called RD-VIO to handle both of these problems.
  arXiv  Detail & Related papers  (2023-10-23T16:30:39Z)
• Event-based Simultaneous Localization and Mapping: A Comprehensive Survey [52.73728442921428]
  Review of event-based vSLAM algorithms that exploit the benefits of asynchronous and irregular event streams for localization and mapping tasks. Paper categorizes event-based vSLAM methods into four main categories: feature-based, direct, motion-compensation, and deep learning methods.
  arXiv  Detail & Related papers  (2023-04-19T16:21:14Z)
• Optimization-Based Eye Tracking using Deflectometric Information [14.010352335803873]
  State-of-the-art eye tracking methods are either-based and track reflections of sparse point light sources, or image-based and exploit 2D features of the acquired eye image. We develop a differentiable pipeline based on PyTorch3D that simulates a virtual eye under screen illumination. In general, our method does not require a specific pattern rendering and can work with ordinary video frames of the main VR/AR/MR screen itself.
  arXiv  Detail & Related papers  (2023-03-09T02:41:13Z)
• EMA-VIO: Deep Visual-Inertial Odometry with External Memory Attention [5.144653418944836]
  Visual-inertial odometry (VIO) algorithms exploit the information from camera and inertial sensors to estimate position and translation. Recent deep learning based VIO models attract attentions as they provide pose information in a data-driven way. We propose a novel learning based VIO framework with external memory attention that effectively and efficiently combines visual and inertial features for states estimation.
  arXiv  Detail & Related papers  (2022-09-18T07:05:36Z)
• Object-based Illumination Estimation with Rendering-aware Neural Networks [56.01734918693844]
  We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. With the estimated lighting, virtual objects can be rendered in AR scenarios with shading that is consistent to the real scene.
  arXiv  Detail & Related papers  (2020-08-06T08:23:19Z)
• Redesigning SLAM for Arbitrary Multi-Camera Systems [51.81798192085111]
  Adding more cameras to SLAM systems improves robustness and accuracy but complicates the design of the visual front-end significantly. In this work, we aim at an adaptive SLAM system that works for arbitrary multi-camera setups. We adapt a state-of-the-art visual-inertial odometry with these modifications, and experimental results show that the modified pipeline can adapt to a wide range of camera setups.
  arXiv  Detail & Related papers  (2020-03-04T11:44:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.