Two-stage Contextual Transformer-based Convolutional Neural Network for
Airway Extraction from CT Images
- URL: http://arxiv.org/abs/2212.07651v1
- Date: Thu, 15 Dec 2022 08:18:37 GMT
- Title: Two-stage Contextual Transformer-based Convolutional Neural Network for
Airway Extraction from CT Images
- Authors: Yanan Wu, Shuiqing Zhao, Shouliang Qi, Jie Feng, Haowen Pang, Runsheng
Chang, Long Bai, Mengqi Li, Shuyue Xia, Wei Qian, Hongliang Ren
- Abstract summary: We propose a novel two-stage 3D contextual transformer-based U-Net for airway segmentation using CT images.
The method consists of two stages, performing initial and refined airway segmentation.
In the first stage, the total airway mask and CT images are provided to the subnetwork, and the intrapulmonary airway mask and corresponding CT scans to the subnetwork.
- Score: 17.45239343953272
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate airway extraction from computed tomography (CT) images is a critical
step for planning navigation bronchoscopy and quantitative assessment of
airway-related chronic obstructive pulmonary disease (COPD). The existing
methods are challenging to sufficiently segment the airway, especially the
high-generation airway, with the constraint of the limited label and cannot
meet the clinical use in COPD. We propose a novel two-stage 3D contextual
transformer-based U-Net for airway segmentation using CT images. The method
consists of two stages, performing initial and refined airway segmentation. The
two-stage model shares the same subnetwork with different airway masks as
input. Contextual transformer block is performed both in the encoder and
decoder path of the subnetwork to finish high-quality airway segmentation
effectively. In the first stage, the total airway mask and CT images are
provided to the subnetwork, and the intrapulmonary airway mask and
corresponding CT scans to the subnetwork in the second stage. Then the
predictions of the two-stage method are merged as the final prediction.
Extensive experiments were performed on in-house and multiple public datasets.
Quantitative and qualitative analysis demonstrate that our proposed method
extracted much more branches and lengths of the tree while accomplishing
state-of-the-art airway segmentation performance. The code is available at
https://github.com/zhaozsq/airway_segmentation.
Related papers
- Multi-Stage Airway Segmentation in Lung CT Based on Multi-scale Nested Residual UNet [3.1903847117782274]
Deep learning has led to significant advancements in medical image segmentation, but maintaining airway continuity remains challenging.
This paper introduces a nested residual framework to enhance information flow, effectively capturing the intricate details of small airways.
We develop a three-stage segmentation pipeline to optimize the training of the MNR-UNet.
arXiv Detail & Related papers (2024-10-24T06:10:09Z) - Low-Dose CT Image Reconstruction by Fine-Tuning a UNet Pretrained for
Gaussian Denoising for the Downstream Task of Image Enhancement [3.7960472831772765]
Computed Tomography (CT) is a widely used medical imaging modality, and reconstruction from low-dose CT data is a challenging task.
In this paper, we propose a less complex two-stage method for reconstruction of LDCT images.
The proposed method achieves a shared top ranking in the LoDoPaB-CT challenge and a first position with respect to the SSIM metric.
arXiv Detail & Related papers (2024-03-06T08:51:09Z) - Dual Multi-scale Mean Teacher Network for Semi-supervised Infection
Segmentation in Chest CT Volume for COVID-19 [76.51091445670596]
Automated detecting lung infections from computed tomography (CT) data plays an important role for combating COVID-19.
Most current COVID-19 infection segmentation methods mainly relied on 2D CT images, which lack 3D sequential constraint.
Existing 3D CT segmentation methods focus on single-scale representations, which do not achieve the multiple level receptive field sizes on 3D volume.
arXiv Detail & Related papers (2022-11-10T13:11:21Z) - A CT-Based Airway Segmentation Using U$^2$-net Trained by the Dice Loss
Function [0.0]
We employ the U$2$-net trained by the Dice loss function to model the airway tree from the multi-site CT scans.
The derived saliency probability map from the training is applied to the validation data to extract the corresponding airway trees.
arXiv Detail & Related papers (2022-09-22T05:57:33Z) - Fuzzy Attention Neural Network to Tackle Discontinuity in Airway
Segmentation [67.19443246236048]
Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases.
Some small-sized airway branches (e.g., bronchus and terminaloles) significantly aggravate the difficulty of automatic segmentation.
This paper presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network and a comprehensive loss function.
arXiv Detail & Related papers (2022-09-05T16:38:13Z) - LTSP: Long-Term Slice Propagation for Accurate Airway Segmentation [19.40457329997144]
Bronchoscopic intervention is a widely-used clinical technique for pulmonary diseases.
The airway map could be extracted from chest computed tomography (CT) scans automatically.
Due to the complex tree-like structure of the airway, preserving its topology completeness is a challenging task.
arXiv Detail & Related papers (2022-02-13T08:47:01Z) - InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal
Artifact Reduction in CT Images [53.4351366246531]
We construct a novel interpretable dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded.
We analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance.
arXiv Detail & Related papers (2021-12-23T15:52:37Z) - FDA: Feature Decomposition and Aggregation for Robust Airway
Segmentation [28.880817101034715]
We propose a new dual-stream network to address the variability between the clean domain and noisy domain.
We designed two different encoders to extract the transferable clean features and the unique noisy features separately.
Our method accurately segmented more bronchi in the noisy CT scans.
arXiv Detail & Related papers (2021-09-07T08:16:51Z) - MetricUNet: Synergistic Image- and Voxel-Level Learning for Precise CT
Prostate Segmentation via Online Sampling [66.01558025094333]
We propose a two-stage framework, with the first stage to quickly localize the prostate region and the second stage to precisely segment the prostate.
We introduce a novel online metric learning module through voxel-wise sampling in the multi-task network.
Our method can effectively learn more representative voxel-level features compared with the conventional learning methods with cross-entropy or Dice loss.
arXiv Detail & Related papers (2020-05-15T10:37:02Z) - Synergistic Learning of Lung Lobe Segmentation and Hierarchical
Multi-Instance Classification for Automated Severity Assessment of COVID-19
in CT Images [61.862364277007934]
We propose a synergistic learning framework for automated severity assessment of COVID-19 in 3D CT images.
A multi-task deep network (called M$2$UNet) is then developed to assess the severity of COVID-19 patients.
Our M$2$UNet consists of a patch-level encoder, a segmentation sub-network for lung lobe segmentation, and a classification sub-network for severity assessment.
arXiv Detail & Related papers (2020-05-08T03:16:15Z) - Detecting Pancreatic Ductal Adenocarcinoma in Multi-phase CT Scans via
Alignment Ensemble [77.5625174267105]
Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal cancers among the population.
Multiple phases provide more information than single phase, but they are unaligned and inhomogeneous in texture.
We suggest an ensemble of all these alignments as a promising way to boost the performance of PDAC detection.
arXiv Detail & Related papers (2020-03-18T19:06:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.