Coarse-to-Fine Covid-19 Segmentation via Vision-Language Alignment
- URL: http://arxiv.org/abs/2303.00279v1
- Date: Wed, 1 Mar 2023 07:01:29 GMT
- Title: Coarse-to-Fine Covid-19 Segmentation via Vision-Language Alignment
- Authors: Dandan Shan, Zihan Li, Wentao Chen, Qingde Li, Jie Tian, Qingqi Hong
- Abstract summary: We propose C2FVL, a Coarse-to-Fine segmentation framework via Vision-Language alignment to merge text information.
The introduction of text information allows the network to achieve better prediction results on challenging datasets.
We conduct extensive experiments on two COVID-19 datasets including chest X-ray and CT, and the results demonstrate that our proposed method outperforms other state-of-the-art segmentation methods.
- Score: 6.754040546065469
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Segmentation of COVID-19 lesions can assist physicians in better diagnosis
and treatment of COVID-19. However, there are few relevant studies due to the
lack of detailed information and high-quality annotation in the COVID-19
dataset. To solve the above problem, we propose C2FVL, a Coarse-to-Fine
segmentation framework via Vision-Language alignment to merge text information
containing the number of lesions and specific locations of image information.
The introduction of text information allows the network to achieve better
prediction results on challenging datasets. We conduct extensive experiments on
two COVID-19 datasets including chest X-ray and CT, and the results demonstrate
that our proposed method outperforms other state-of-the-art segmentation
methods.
Related papers
- COVIDx CXR-4: An Expanded Multi-Institutional Open-Source Benchmark
Dataset for Chest X-ray Image-Based Computer-Aided COVID-19 Diagnostics [79.90346960083775]
We introduce COVIDx CXR-4, an expanded multi-institutional open-source benchmark dataset for chest X-ray image-based computer-aided COVID-19 diagnostics.
COVIDx CXR-4 expands significantly on the previous COVIDx CXR-3 dataset by increasing the total patient cohort size by greater than 2.66 times.
We provide extensive analysis on the diversity of the patient demographic, imaging metadata, and disease distributions to highlight potential dataset biases.
arXiv Detail & Related papers (2023-11-29T14:40:31Z) - Enhancing COVID-19 Severity Analysis through Ensemble Methods [13.792760290422185]
This paper presents a domain knowledge-based pipeline for extracting regions of infection in COVID-19 patients.
The severity of the infection is then classified into different categories using an ensemble of three machine-learning models.
The proposed system was evaluated on a validation dataset in the AI-Enabled Medical Image Analysis Workshop and COVID-19 Diagnosis Competition.
arXiv Detail & Related papers (2023-03-13T13:59:47Z) - Optimising Chest X-Rays for Image Analysis by Identifying and Removing
Confounding Factors [49.005337470305584]
During the COVID-19 pandemic, the sheer volume of imaging performed in an emergency setting for COVID-19 diagnosis has resulted in a wide variability of clinical CXR acquisitions.
The variable quality of clinically-acquired CXRs within publicly available datasets could have a profound effect on algorithm performance.
We propose a simple and effective step-wise approach to pre-processing a COVID-19 chest X-ray dataset to remove undesired biases.
arXiv Detail & Related papers (2022-08-22T13:57:04Z) - A Deep Ensemble Learning Approach to Lung CT Segmentation for COVID-19
Severity Assessment [0.5512295869673147]
We present a novel deep learning approach to categorical segmentation of lung CTs of COVID-19 patients.
We partition the scans into healthy lung tissues, non-lung regions, and two different, yet visually similar, pathological lung tissues.
The proposed framework achieves competitive results and outstanding generalization capabilities for three COVID-19 datasets.
arXiv Detail & Related papers (2022-07-05T21:28:52Z) - Multi-scale alignment and Spatial ROI Module for COVID-19 Diagnosis [13.31017458409054]
We propose a deep spatial pyramid pooling (D-SPP) module to integrate contextual information over different resolutions.
We also propose a COVID-19 infection detection (CID) module to draw attention to the lesion area and remove interference from irrelevant information.
Our method produces higher accuracy of detecting COVID-19 lesions in CT and CXR images.
arXiv Detail & Related papers (2022-07-04T12:07:17Z) - COVIDx CT-3: A Large-scale, Multinational, Open-Source Benchmark Dataset
for Computer-aided COVID-19 Screening from Chest CT Images [82.74877848011798]
We introduce COVIDx CT-3, a large-scale benchmark dataset for detection of COVID-19 cases from chest CT images.
COVIDx CT-3 includes 431,205 CT slices from 6,068 patients across at least 17 countries.
We examine the data diversity and potential biases of the COVIDx CT-3 dataset, finding significant geographic and class imbalances.
arXiv Detail & Related papers (2022-06-07T06:35:48Z) - Calibrated Bagging Deep Learning for Image Semantic Segmentation: A Case
Study on COVID-19 Chest X-ray Image [3.135883872525168]
Imaging tests such as chest X-ray (CXR) and computed tomography (CT) can provide useful information to clinical staff.
Deep learning has been applied to perform COVID-19 infection region segmentation and disease classification.
We propose a novel ensemble deep learning model through integrating bagging deep learning and model calibration.
arXiv Detail & Related papers (2022-05-27T20:06:45Z) - Towards Unbiased COVID-19 Lesion Localisation and Segmentation via
Weakly Supervised Learning [66.36706284671291]
We propose a data-driven framework supervised by only image-level labels to support unbiased lesion localisation.
The framework can explicitly separate potential lesions from original images, with the help of a generative adversarial network and a lesion-specific decoder.
arXiv Detail & Related papers (2021-03-01T06:05:49Z) - Exploiting Shared Knowledge from Non-COVID Lesions for
Annotation-Efficient COVID-19 CT Lung Infection Segmentation [10.667692828593125]
We propose a relation-driven collaborative learning model for COVID-19 lung infection segmentation.
We exploit shared knowledge between COVID and non-COVID lesions to regularize the relation consistency between extracted features.
Our method achieves superior segmentation performance compared with existing methods in the absence of sufficient high-quality COVID-19 annotations.
arXiv Detail & Related papers (2020-12-31T11:40:29Z) - Multi-Task Driven Explainable Diagnosis of COVID-19 using Chest X-ray
Images [61.24431480245932]
COVID-19 Multi-Task Network is an automated end-to-end network for COVID-19 screening.
We manually annotate the lung regions of 9000 frontal chest radiographs taken from ChestXray-14, CheXpert and a consolidated COVID-19 dataset.
This database will be released to the research community.
arXiv Detail & Related papers (2020-08-03T12:52:23Z) - Adaptive Feature Selection Guided Deep Forest for COVID-19
Classification with Chest CT [49.09507792800059]
We propose an Adaptive Feature Selection guided Deep Forest (AFS-DF) for COVID-19 classification based on chest CT images.
We evaluate our proposed AFS-DF on COVID-19 dataset with 1495 patients of COVID-19 and 1027 patients of community acquired pneumonia (CAP)
arXiv Detail & Related papers (2020-05-07T06:00:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.