BREA-Depth: Bronchoscopy Realistic Airway-geometric Depth Estimation
- URL: http://arxiv.org/abs/2509.11885v1
- Date: Mon, 15 Sep 2025 13:02:42 GMT
- Title: BREA-Depth: Bronchoscopy Realistic Airway-geometric Depth Estimation
- Abstract summary: Brea-Depth is a novel framework that integrates airway-specific geometric priors into foundation model adaptation for bronchoscopic depth estimation.<n>Our method introduces a depth-aware CycleGAN, refining the translation between real bronchoscopic images and airway geometries from anatomical data.<n>By incorporating anatomical priors, Brea-Depth enhances model generalization and yields more robust, accurate 3D airway reconstructions.
- Score: 7.685220083971859
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Monocular depth estimation in bronchoscopy can significantly improve real-time navigation accuracy and enhance the safety of interventions in complex, branching airways. Recent advances in depth foundation models have shown promise for endoscopic scenarios, yet these models often lack anatomical awareness in bronchoscopy, overfitting to local textures rather than capturing the global airway structure, particularly under ambiguous depth cues and poor lighting. To address this, we propose Brea-Depth, a novel framework that integrates airway-specific geometric priors into foundation model adaptation for bronchoscopic depth estimation. Our method introduces a depth-aware CycleGAN, refining the translation between real bronchoscopic images and airway geometries from anatomical data, effectively bridging the domain gap. In addition, we introduce an airway structure awareness loss to enforce depth consistency within the airway lumen while preserving smooth transitions and structural integrity. By incorporating anatomical priors, Brea-Depth enhances model generalization and yields more robust, accurate 3D airway reconstructions. To assess anatomical realism, we introduce Airway Depth Structure Evaluation, a new metric for structural consistency. We validate BREA-Depth on a collected ex vivo human lung dataset and an open bronchoscopic dataset, where it outperforms existing methods in anatomical depth preservation.
Related papers
- ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning [66.42476564611607]
Diffusion models assume that depth can be recovered as a globally smooth field through iterative denoising.<n>We introduce ARDepth, which formulates depth estimation as structured auto-regressive generation.<n>We show that our approach achieves strong performance and produces structurally consistent depth predictions across scales.
arXiv Detail & Related papers (2026-07-14T07:06:46Z) - EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images [7.350425834778092]
EndoUFM is an unsupervised monocular depth estimation framework.<n>It enhances the depth estimation performance by leveraging the powerful pre-learned priors.<n>This work contributes to augmenting surgeons' spatial perception during minimally invasive procedures.
arXiv Detail & Related papers (2025-08-25T11:33:05Z) - Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction? [50.68335638232752]
We propose a suite of anatomy-aware evaluation metrics to assess structural completeness across anatomical structures.<n> CARE incorporates structural penalties during training to encourage anatomical preservation of significant structures.<n> CARE substantially improves structural completeness in CT reconstructions, achieving up to +32% improvement for large organs, +22% for small organs, +40% for intestines, and +36% for vessels.
arXiv Detail & Related papers (2025-06-02T17:07:10Z) - Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors [10.61978045582697]
3D mapping in endoscopy enables quantitative, holistic lesion characterization within the gastrointestinal (GI) tract.<n>Existing methods relying on synthetic datasets or complex models often lack generalizability in challenging endoscopic conditions.<n>We propose a robust self-supervised monocular depth and pose estimation framework that incorporates a Generative Latent Bank and a Variational Autoencoder.
arXiv Detail & Related papers (2024-11-26T15:43:06Z) - Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy [2.906891207990726]
We introduce a novel fine-tuning strategy for the Depth Anything Model.<n>We integrate it with an intrinsic-based unsupervised monocular depth estimation framework.<n>Our results show that our method achieves state-of-the-art performance while minimizing the number of trainable parameters.
arXiv Detail & Related papers (2024-09-12T03:04:43Z) - ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptation [67.22294293695255]
We propose a novel reconstruction pipeline with a bi-directional adaptation architecture named ToDER to get precise depth estimations.
Experimental results demonstrate that our approach can precisely predict depth maps in both realistic and synthetic colonoscopy videos.
arXiv Detail & Related papers (2024-07-23T14:24:26Z) - PANS: Probabilistic Airway Navigation System for Real-time Robust Bronchoscope Localization [4.755280006199144]
We propose a novel Probabilistic Airway Navigation System (PANS) for bronchoscope localization.
Our PANS incorporates diverse visual representations by leveraging two key modules, including the Depth-based Motion Inference (DMI) and the Bronchial Semantic Analysis (BSA)
Under this probabilistic formulation, our PANS is capable of achieving the 6-DOF bronchoscope localization with superior accuracy and robustness.
arXiv Detail & Related papers (2024-07-08T02:13:41Z) - Fuzzy Attention Neural Network to Tackle Discontinuity in Airway
Segmentation [67.19443246236048]
Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases.
Some small-sized airway branches (e.g., bronchus and terminaloles) significantly aggravate the difficulty of automatic segmentation.
This paper presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network and a comprehensive loss function.
arXiv Detail & Related papers (2022-09-05T16:38:13Z) - What Makes for Automatic Reconstruction of Pulmonary Segments [50.216231776343115]
3D reconstruction of pulmonary segments plays an important role in surgical treatment planning of lung cancer.
However, automatic reconstruction of pulmonary segments remains unexplored in the era of deep learning.
We propose ImPulSe, a deep implicit surface model designed for pulmonary segment reconstruction.
arXiv Detail & Related papers (2022-07-07T04:24:17Z) - BronchusNet: Region and Structure Prior Embedded Representation Learning
for Bronchus Segmentation and Classification [53.53758990624962]
We propose a region and structure prior embedded framework named BronchusNet to achieve accurate bronchial analysis.
For bronchus segmentation, we propose an adaptive hard region-aware UNet that incorporates multi-level prior guidance of hard pixel-wise samples.
For the classification of bronchial branches, we propose a hybrid point-voxel graph learning module.
arXiv Detail & Related papers (2022-05-14T02:32:33Z) - Adversarial Domain Feature Adaptation for Bronchoscopic Depth Estimation [111.89519571205778]
In this work, we propose an alternative domain-adaptive approach to depth estimation.
Our novel two-step structure first trains a depth estimation network with labeled synthetic images in a supervised manner.
The results of our experiments show that the proposed method improves the network's performance on real images by a considerable margin.
arXiv Detail & Related papers (2021-09-24T08:11:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.