Geometry-Aware Visual Odometry for Bronchoscopic Navigation via High-Gain Observer Fusion
- URL: http://arxiv.org/abs/2607.05162v1
- Date: Mon, 06 Jul 2026 14:46:33 GMT
- Title: Geometry-Aware Visual Odometry for Bronchoscopic Navigation via High-Gain Observer Fusion
- Abstract summary: Vision-only navigation offers a scalable alternative to conventional visual odometry.<n>We present a geometry-aware VO framework that explicitly leverages vanishing-point cues from airway lumens.<n>We validate the method on ex-vivo mechanically ventilated human lungs with electromagnetic tracking ground truth.
- Score: 13.267244611023324
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Navigational bronchoscopy is critical for pulmonary interventions, yet current platforms depend heavily on pre-operative CT or external sensors, limiting their use in critical care and resource-constrained settings. Vision-only navigation offers a scalable alternative, but conventional visual odometry (VO) struggles with texture-poor airway images, specularities, and the vanishing-point singularities of tubular anatomy, leading to frequent tracking failures and drift. We present a geometry-aware VO framework that explicitly leverages vanishing-point cues from airway lumens. Detected lumens are back-projected to 3D rays, whose weighted fusion yields a stable forward heading even when parallax cues are absent. This heading, together with looming-based velocity estimates, is fused with noisy VO outputs using a bespoke high-gain observer that enforces airway-following priors and rejects drift. We validate the method on ex-vivo mechanically ventilated human lungs with electromagnetic tracking ground truth. Compared to state-of-the-art pipelines (ORB-SLAM2, LoFTR-VO, DPVO), our approach reduces absolute trajectory error by more than 50% and achieves the lowest relative pose error across all test sequences.
Related papers
- Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach [0.0]
Parkinson's disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control.<n> automated freezing-of-gait (FOG) detection supports the objective assessment of gait-related motor impairment.<n>Two common approaches are used for FOG prediction: (i) analysing video recordings of the patient's movements and (ii) analysing data collected using inertial measurement unit (IMU) wearable sensors attached to the patient's lower limbs.<n>Video-based approaches may suffer detection errors during continuous turning-in-place tasks because the lower limbs undergo substantial geometric self-occlusion, degrading pose-estimation accuracy.
arXiv Detail & Related papers (2026-09-09T07:29:13Z) - LightAIR: Lightweight Action Inversion and Riemannian Rectification for Text-based Person Anomaly Search [47.5045602470916]
We propose a lightweight action inversion and rectification network (LightAIR) for Person Anomaly Search.<n>Experiments on the widely used TPAS and TIPR datasets demonstrate that LightAIR significantly outperforms existing state-of-the-art methods.
arXiv Detail & Related papers (2026-08-10T05:59:07Z) - Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach [60.596944437968524]
PartialVisGraph is a novel framework for robust skeleton-based action recognition under constrained field-of-view.<n>It consistently achieves state-of-the-art accuracy under partial visibility, with gains of up to 68.8% on subsets with severe FoV restrictions.<n>Our approach offers a principled and practical pathway toward deployable skeleton-based action understanding in unconstrained environments.
arXiv Detail & Related papers (2026-07-01T10:03:11Z) - CT-VIR: Continuous-Time Visual-Inertial-Ranging Fusion for Indoor Localization with Sparse Anchors [8.090575303185078]
We propose a continuous-time state estimation method for visual-inertial-ranging (VIR) fusion localization.<n>Introductor, visual, and ranging constraints are formulated as factors in a sliding-window graph.<n> Evaluations on public datasets and real-world experiments demonstrate the effectiveness and practical potential of the proposed approach.
arXiv Detail & Related papers (2026-04-16T02:23:57Z) - ASBA: A-line State Space Model and B-line Attention for Sparse Optical Doppler Tomography Reconstruction [52.60553814186938]
A 2D Optical Doppler Tomography (ODT) image (B-scan) is generated by sequentially acquiring 1D depth-resolved raw A-scans (A-line) along the lateral axis (B-line)<n>Current practices rely on dense sampling, which prolongs scanning time, increases storage demands, and limits the capture of rapid blood flow dynamics.<n>In this study, we introduce a novel blood flow-aware network, named ASBA, to reconstruct ODT images from highly sparsely sampled raw A-scans.
arXiv Detail & Related papers (2026-01-20T17:17:02Z) - Adaptive Anomaly Recovery for Telemanipulation: A Diffusion Model Approach to Vision-Based Tracking [3.9594367082013546]
This work introduces the Diffusion-Enhanced Telemanipulation framework.<n>It incorporates the Frame-Difference Detection (FDD) technique to identify and segment anomalies in video streams.
arXiv Detail & Related papers (2025-03-11T20:52:01Z) - A Novel Tracking Framework for Devices in X-ray Leveraging Supplementary Cue-Driven Self-Supervised Features [6.262161803642583]
We propose a self-supervised learning approach that enhances its-temporal visibility.<n>We introduce a generic real-time tracking framework that effectively leverages the pretrained-temporal network.<n>Our method achieves an 87% reduction in max error for balloon marker detection and a 61% reduction in max error for catheter tip detection.
arXiv Detail & Related papers (2025-01-22T15:32:07Z) - Unsupervised Multi-Parameter Inverse Solving for Reducing Ring Artifacts in 3D X-Ray CBCT [51.95884144860506]
Ring artifacts are prevalent in 3D cone-beam computed tomography (CBCT)<n>Existing state-of-the-art (SOTA) ring artifact reduction (RAR) methods rely on supervised learning with large-scale paired CT datasets.<n>In this work, we propose Riner, a new unsupervised RAR method.
arXiv Detail & Related papers (2024-12-08T08:22:58Z) - LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry [53.5449912019877]
We present the Long-term Effective Any Point Tracking (LEAP) module.<n>LEAP innovatively combines visual, inter-track, and temporal cues with mindfully selected anchors for dynamic track estimation.<n>Based on these traits, we develop LEAP-VO, a robust visual odometry system adept at handling occlusions and dynamic scenes.
arXiv Detail & Related papers (2024-01-03T18:57:27Z) - REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT
Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images.
To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
arXiv Detail & Related papers (2022-08-17T03:42:19Z) - Robust Landmark-based Stent Tracking in X-ray Fluoroscopy [10.917460255497227]
We propose an end-to-end deep learning framework for single stent tracking.
It consists of three hierarchical modules: U-Net based landmark detection, ResNet based stent proposal and feature extraction.
Experiments show that our method performs significantly better in detection compared with the state-of-the-art point-based tracking models.
arXiv Detail & Related papers (2022-07-20T14:20:03Z) - Deep Open Snake Tracker for Vessel Tracing [32.97987423431042]
Vessel tracing by modeling vascular structures in 3D medical images with centerlines and radii can provide useful information for vascular health.
Existing algorithms have been developed but there are certain persistent problems such as incomplete or inaccurate vessel tracing.
We propose here a deep learning based open curve active contour model (DOST) to trace vessels in 3D images.
arXiv Detail & Related papers (2021-07-19T17:59:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.