Multi-Stage Airway Segmentation in Lung CT Based on Multi-scale Nested Residual UNet

• URL: http://arxiv.org/abs/2410.18456v2
• Date: Sun, 10 Nov 2024 12:13:17 GMT
• Title: Multi-Stage Airway Segmentation in Lung CT Based on Multi-scale Nested Residual UNet
• Authors: Bingyu Yang, Huai Liao, Xinyan Huang, Qingyao Tian, Jinlin Wu, Jingdi Hu, Hongbin Liu,
• Abstract summary: Deep learning has led to significant advancements in medical image segmentation, but maintaining airway continuity remains challenging. This paper introduces a nested residual framework to enhance information flow, effectively capturing the intricate details of small airways. We develop a three-stage segmentation pipeline to optimize the training of the MNR-UNet.
• Score: 3.1903847117782274
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate and complete segmentation of airways in chest CT images is essential for the quantitative assessment of lung diseases and the facilitation of pulmonary interventional procedures. Although deep learning has led to significant advancements in medical image segmentation, maintaining airway continuity remains particularly challenging. This difficulty arises primarily from the small and dispersed nature of airway structures, as well as class imbalance in CT scans. To address these challenges, we designed a Multi-scale Nested Residual U-Net (MNR-UNet), incorporating multi-scale inputs and Residual Multi-scale Modules (RMM) into a nested residual framework to enhance information flow, effectively capturing the intricate details of small airways and mitigating gradient vanishing. Building on this, we developed a three-stage segmentation pipeline to optimize the training of the MNR-UNet. The first two stages prioritize high accuracy and sensitivity, while the third stage focuses on repairing airway breakages to balance topological completeness and correctness. To further address class imbalance, we introduced a weighted Breakage-Aware Loss (wBAL) to heighten focus on challenging samples, penalizing breakages and thereby extending the length of the airway tree. Additionally, we proposed a hierarchical evaluation framework to offer more clinically meaningful analysis. Validation on both in-house and public datasets demonstrates that our approach achieves superior performance in detecting more accurate airway voxels and identifying additional branches, significantly improving airway topological completeness. The code will be released publicly following the publication of the paper.

Related papers

• Semi- and Weakly-Supervised Learning for Mammogram Mass Segmentation with Limited Annotations [49.33388736227072]
  We propose a semi- and weakly-supervised learning framework for mass segmentation. We use limited strongly-labeled samples and sufficient weakly-labeled samples to achieve satisfactory performance. Experiments on CBIS-DDSM and INbreast datasets demonstrate the effectiveness of our method.
  arXiv  Detail & Related papers  (2024-03-14T12:05:25Z)
• Skeleton Supervised Airway Segmentation [27.65479179170118]
  We introduce a novel skeleton-level annotation (SkA) tailored to the airway, which simplifies the annotation workflow. We also propose a skeleton-supervised learning framework to achieve accurate airway segmentation. Experiments reveal that our proposed framework outperforms the competing methods with SKA, which amounts to only 1.96% airways.
  arXiv  Detail & Related papers  (2024-03-11T08:37:03Z)
• Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning [52.249748801637196]
  3D medical image segmentation is a challenging task with crucial implications for disease diagnosis and treatment planning. Recent advances in deep learning have significantly enhanced fully supervised medical image segmentation. We propose a novel probabilistic-aware weakly supervised learning pipeline, specifically designed for 3D medical imaging.
  arXiv  Detail & Related papers  (2024-03-05T00:46:53Z)
• Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory optimization [87.21285093582446]
  Diffusion Generative Flow Samplers (DGFS) is a sampling-based framework where the learning process can be tractably broken down into short partial trajectory segments. Our method takes inspiration from the theory developed for generative flow networks (GFlowNets)
  arXiv  Detail & Related papers  (2023-10-04T09:39:05Z)
• Accurate Airway Tree Segmentation in CT Scans via Anatomy-aware Multi-class Segmentation and Topology-guided Iterative Learning [15.492349389589121]
  Intrathoracic airway segmentation in computed tomography (CT) is a prerequisite for various respiratory disease analyses. Most of the existing airway datasets are incompletely labeled/annotated. We propose a new anatomy-aware multi-class airway segmentation method enhanced by topology-guided iterative self-learning.
  arXiv  Detail & Related papers  (2023-06-15T13:23:05Z)
• MESAHA-Net: Multi-Encoders based Self-Adaptive Hard Attention Network with Maximum Intensity Projections for Lung Nodule Segmentation in CT Scan [6.266053305874546]
  We propose an efficient end-to-end framework, the multi-encoder-based self-adaptive hard attention network (MESAHA-Net) for precise lung nodule segmentation in CT scans. MESAHA-Net iteratively performs slice-by-slice 2D segmentation of lung nodules, focusing on the nodule region in each slice to generate 3D segmentation of lung nodules. The proposed framework has been evaluated on the LIDC-IDRI dataset, the largest publicly available dataset for lung nodule segmentation.
  arXiv  Detail & Related papers  (2023-04-04T07:05:15Z)
• Adversarial Transformer for Repairing Human Airway Segmentation [7.176060570019899]
  This paper presents a patch-scale adversarial-based refinement network that takes in preliminary segmentation along with original CT images and outputs a refined mask of the airway structure. The results are quantitatively evaluated by seven metrics and achieved more than a 15% rise in detected length ratio and detected branch ratio.
  arXiv  Detail & Related papers  (2022-10-21T15:20:08Z)
• Differentiable Topology-Preserved Distance Transform for Pulmonary Airway Segmentation [34.22415353209505]
  We propose a Differentiable Topology-Preserved Distance Transform (DTPDT) framework to improve the performance of airway segmentation. A Topology-Preserved Surrogate (TPS) learning strategy is first proposed to balance the training progress within-class distribution. A Convolutional Distance Transform (CDT) is designed to identify the breakage phenomenon with superior sensitivity and minimize the variation of the distance map between the predictionand ground-truth.
  arXiv  Detail & Related papers  (2022-09-17T15:47:01Z)
• Boundary Guided Semantic Learning for Real-time COVID-19 Lung Infection Segmentation System [69.40329819373954]
  The coronavirus disease 2019 (COVID-19) continues to have a negative impact on healthcare systems around the world. At the current stage, automatically segmenting the lung infection area from CT images is essential for the diagnosis and treatment of COVID-19. We propose a boundary guided semantic learning network (BSNet) in this paper.
  arXiv  Detail & Related papers  (2022-09-07T05:01:38Z)
• Fuzzy Attention Neural Network to Tackle Discontinuity in Airway Segmentation [67.19443246236048]
  Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases. Some small-sized airway branches (e.g., bronchus and terminaloles) significantly aggravate the difficulty of automatic segmentation. This paper presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network and a comprehensive loss function.
  arXiv  Detail & Related papers  (2022-09-05T16:38:13Z)
• What Makes for Automatic Reconstruction of Pulmonary Segments [50.216231776343115]
  3D reconstruction of pulmonary segments plays an important role in surgical treatment planning of lung cancer. However, automatic reconstruction of pulmonary segments remains unexplored in the era of deep learning. We propose ImPulSe, a deep implicit surface model designed for pulmonary segment reconstruction.
  arXiv  Detail & Related papers  (2022-07-07T04:24:17Z)
• BronchusNet: Region and Structure Prior Embedded Representation Learning for Bronchus Segmentation and Classification [53.53758990624962]
  We propose a region and structure prior embedded framework named BronchusNet to achieve accurate bronchial analysis. For bronchus segmentation, we propose an adaptive hard region-aware UNet that incorporates multi-level prior guidance of hard pixel-wise samples. For the classification of bronchial branches, we propose a hybrid point-voxel graph learning module.
  arXiv  Detail & Related papers  (2022-05-14T02:32:33Z)
• Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases [57.90226879210227]
  FedCy is a semi-supervised learning (FSSL) method that combines FL and self-supervised learning to exploit a decentralized dataset of both labeled and unlabeled videos. We demonstrate significant performance gains over state-of-the-art FSSL methods on the task of automatic recognition of surgical phases.
  arXiv  Detail & Related papers  (2022-03-14T17:44:53Z)
• LTSP: Long-Term Slice Propagation for Accurate Airway Segmentation [19.40457329997144]
  Bronchoscopic intervention is a widely-used clinical technique for pulmonary diseases. The airway map could be extracted from chest computed tomography (CT) scans automatically. Due to the complex tree-like structure of the airway, preserving its topology completeness is a challenging task.
  arXiv  Detail & Related papers  (2022-02-13T08:47:01Z)
• Cross-Site Severity Assessment of COVID-19 from CT Images via Domain Adaptation [64.59521853145368]
  Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event. To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites. This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
  arXiv  Detail & Related papers  (2021-09-08T07:56:51Z)
• Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT [45.93021999366973]
  Training convolutional neural networks (CNNs) for segmentation of pulmonary airway, artery, and vein is challenging. We present a CNNs-based method for accurate airway and artery-vein segmentation in non-contrast computed tomography. It enjoys superior sensitivity to tenuous peripheral bronchioles, arterioles, and venules.
  arXiv  Detail & Related papers  (2020-12-10T15:56:08Z)
• Alleviating Class-wise Gradient Imbalance for Pulmonary Airway Segmentation [35.18277191213468]
  Automated airway segmentation is a prerequisite for pre-operative diagnosis and intra-operative navigation for pulmonary intervention. Due to the small size and scattered spatial distribution of peripheral bronchi, this is hampered by severe class imbalance between foreground and background regions. In this paper, we demonstrate that this problem is arisen by gradient erosion and dilation of the neighborhood voxels. We propose a General Union loss function which obviates the impact of airway size by distance-based weights and adaptively tunes the gradient ratio based on the learning process.
  arXiv  Detail & Related papers  (2020-11-24T08:14:38Z)
• Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNet [74.22397862400177]
  We propose a novel catheter segmentation approach, which requests fewer annotations than the supervised learning method. Our scheme considers a deep Q learning as the pre-localization step, which avoids voxel-level annotation. With the detected catheter, patch-based Dual-UNet is applied to segment the catheter in 3D volumetric data.
  arXiv  Detail & Related papers  (2020-06-25T21:10:04Z)
• ADRN: Attention-based Deep Residual Network for Hyperspectral Image Denoising [52.01041506447195]
  We propose an attention-based deep residual network to learn a mapping from noisy HSI to the clean one. Experimental results demonstrate that our proposed ADRN scheme outperforms the state-of-the-art methods both in quantitative and visual evaluations.
  arXiv  Detail & Related papers  (2020-03-04T08:36:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.