Stop Holding Your Breath: CT-Informed Gaussian Splatting for Dynamic Bronchoscopy

• URL: http://arxiv.org/abs/2604.28179v1
• Date: Thu, 30 Apr 2026 17:57:19 GMT
• Title: Stop Holding Your Breath: CT-Informed Gaussian Splatting for Dynamic Bronchoscopy
• Abstract summary: Bronchoscopic navigation relies on registering endoscopic video to a preoperative CT scan.<n> respiratory motion deforms the airway by 5-20 mm, creating CT-to-body divergence.<n>We propose to eliminate the need for breath-hold protocols by leveraging patient-specific respiratory modeling.
• Score: 19.10420788280643
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Bronchoscopic navigation relies on registering endoscopic video to a preoperative CT scan, but respiratory motion deforms the airway by 5-20 mm, creating CT-to-body divergence that limits localization accuracy. In practice, this is mitigated through breath-hold protocols, which attempt to match the intraoperative anatomy to a static CT, but are difficult to reproduce and disrupt clinical workflow. We propose to eliminate the need for breath-hold protocols by leveraging patient-specific respiratory modeling. Paired inhale-exhale CT scans, already acquired for planning, implicitly define the patient-specific deformation space of the breathing airway. By registering these scans, we reduce respiratory motion to a single scalar breathing phase per frame, constraining all reconstructions to anatomically observed configurations. We embed this representation within a mesh-anchored Gaussian splatting framework, where a lightweight estimator infers breathing phase directly from endoscopic RGB, enabling continuous, deformation-aware reconstruction throughout the respiratory cycle without breath-holds or external sensing. To enable quantitative evaluation, we introduce RESPIRE, a physically grounded bronchoscopy simulation pipeline with per-frame ground truth for geometry, pose, breathing phase, and deformation. Experiments on RESPIRE show that our approach achieves geometrically faithful reconstruction, over 20x faster training, and 1.22 mm target localization accuracy (within the 3mm clinically relevant tolerances) outperforming unconstrained single-CT baselines. Please check out our website for additional visuals: https://asdunnbe.github.io/RESPIRE/

Related papers

• A Low-Power Wearable Respiratory Sensor for Non-Invasive Stress Monitoring [0.5416422382471174]
  We present a compact non-invasive respiratory sensing system based on a force-sensitive resistor embedded in an abdominal belt.<n>We evaluate the complete sensing pipeline across multiple breathing patterns and body positions.<n>Our results show that the proposed platform enables real-time respiratory monitoring across diverse daily-life scenarios.
  arXiv  Detail & Related papers  (2026-08-06T07:41:34Z)
• Motion-Robust Deep Reconstruction for Free-Breathing Cardiac Cine MRI [4.896454236357851]
  Free-breathing radial acquisitions can alleviate limitations, but robust reconstruction at high acceleration remains challenging due to prominent streak artifacts.<n>We propose Cine-DL, a clinically oriented framework that couples targeted k-space preprocessing with fast, model-based deep reconstruction.<n>Our experiments show that Cine-DL consistently improves quantitative metrics and visual fidelity, supporting a practical route toward routine, time-sensitive clinical adoption of free-breathing cine MRI.
  arXiv  Detail & Related papers  (2026-05-20T04:31:03Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [64.2059940799033]
  Current methods discretize temporal resolution into fixed phases with respiratory gating devices.<n>X$2$-Gaussian, a novel framework, enables continuous-time 4DCT reconstruction by integrating dynamic radiative splatting with self-supervised respiratory motion learning.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• Investigating the impact of kernel harmonization and deformable registration on inspiratory and expiratory chest CT images for people with COPD [5.293488807720599]
  We propose a two-stage pipeline to harmonize reconstruction kernels and perform deformable image registration.<n>We use a cycle generative adversarial network (GAN) to harmonize inspiratory scans reconstructed with a hard kernel (BONE) to match expiratory scans reconstructed with a soft kernel (STANDARD)<n>Results show harmonization significantly reduces emphysema measurement inconsistencies.
  arXiv  Detail & Related papers  (2025-02-07T17:41:49Z)
• Airway Label Prediction in Video Bronchoscopy: Capturing Temporal Dependencies Utilizing Anatomical Knowledge [0.0]
  This paper addresses navigation guidance solely incorporating bronchosopy video data. We take maximally advantage of anatomical constraints of airway trees being sequentially traversed. We are able to improve the accuracy up to to 0.98 compared to 0.81 for a classification based on individual frames.
  arXiv  Detail & Related papers  (2023-07-17T08:26:36Z)
• Using BOLD-fMRI to Compute the Respiration Volume per Time (RTV) and Respiration Variation (RV) with Convolutional Neural Networks (CNN) in the Human Connectome Development Cohort [55.41644538483948]
  This study proposes a one-dimensional CNN model for reconstruction of two respiratory measures, RV and RVT. Results show that a CNN can capture informative features from resting BOLD signals and reconstruct realistic RV and RVT timeseries.
  arXiv  Detail & Related papers  (2023-07-03T18:06:36Z)
• An Efficient and Robust Method for Chest X-Ray Rib Suppression that Improves Pulmonary Abnormality Diagnosis [0.49998148477760956]
  Suppression of thoracic bone shadows on chest X-rays (CXRs) has been indicated to improve the diagnosis of pulmonary disease. Previous approaches can be categorized as unsupervised physical and supervised deep learning models. We propose a generalizable yet efficient workflow of two stages: (1) training pairs generation with GT bone shadows eliminated in minimization by a physical model in spatially transformed gradient fields. (2) fully supervised image denoising network training on stage-one datasets for fast rib removal on incoming CXRs.
  arXiv  Detail & Related papers  (2023-02-19T23:47:02Z)
• RMSim: Controlled Respiratory Motion Simulation on Static Patient Scans [7.575469466607952]
  We present a novel 3D Seq2Seq deep learning respiratory motion simulator (RMSim) that learns from 4D-CT images. 10-phase 4D-CTs of 140 internal patients were used to train and test RMSim. We validated our RMSim output with both private and public benchmark datasets.
  arXiv  Detail & Related papers  (2023-01-26T21:20:14Z)
• REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
  REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
  arXiv  Detail & Related papers  (2022-08-17T03:42:19Z)
• What Makes for Automatic Reconstruction of Pulmonary Segments [50.216231776343115]
  3D reconstruction of pulmonary segments plays an important role in surgical treatment planning of lung cancer. However, automatic reconstruction of pulmonary segments remains unexplored in the era of deep learning. We propose ImPulSe, a deep implicit surface model designed for pulmonary segment reconstruction.
  arXiv  Detail & Related papers  (2022-07-07T04:24:17Z)
• 2-D Respiration Navigation Framework for 3-D Continuous Cardiac Magnetic Resonance Imaging [61.701281723900216]
  We propose a sampling adaption to acquire 2-D respiration information during a continuous scan. We develop a pipeline to extract the different respiration states from the acquired signals, which are used to reconstruct data from one respiration phase.
  arXiv  Detail & Related papers  (2020-12-26T08:29:57Z)
• Airflow recovery from thoracic and abdominal movements using Synchrosqueezing Transform and Locally Stationary Gaussian Process Regression [6.496038875667294]
  We propose to use the nonlinear-type time-frequency analysis tool, synchrosqueezing transform, to represent the thoracic and abdominal movement signals as the features. We show that, using a dataset that contains respiratory signals under normal sleep conditions, an accurate prediction can be achieved by fitting the proposed model in the feature space.
  arXiv  Detail & Related papers  (2020-08-11T01:37:38Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.