COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models

• URL: http://arxiv.org/abs/2107.01682v1
• Date: Sun, 4 Jul 2021 16:55:51 GMT
• Title: COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models
• Authors: Xiaohong Gao, Yu Qian, Alice Gao
• Abstract summary: This paper is responding to the MIA-COV19 challenge to classify COVID from non-COVID based on CT lung images. The overarching aim is to predict the diagnosis of the COVID-19 virus from chest radiographs. Two deep learning methods are studied, which are vision transformer (ViT) based on attention models and DenseNet that is built upon conventional convolutional neural network (CNN)
• Score: 0.8594140167290099
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper is responding to the MIA-COV19 challenge to classify COVID from non-COVID based on CT lung images. The COVID-19 virus has devastated the world in the last eighteen months by infecting more than 182 million people and causing over 3.9 million deaths. The overarching aim is to predict the diagnosis of the COVID-19 virus from chest radiographs, through the development of explainable vision transformer deep learning techniques, leading to population screening in a more rapid, accurate and transparent way. In this competition, there are 5381 three-dimensional (3D) datasets in total, including 1552 for training, 374 for evaluation and 3455 for testing. While most of the data volumes are in axial view, there are a number of subjects' data are in coronal or sagittal views with 1 or 2 slices are in axial view. Hence, while 3D data based classification is investigated, in this competition, 2D images remains the main focus. Two deep learning methods are studied, which are vision transformer (ViT) based on attention models and DenseNet that is built upon conventional convolutional neural network (CNN). Initial evaluation results based on validation datasets whereby the ground truth is known indicate that ViT performs better than DenseNet with F1 scores being 0.76 and 0.72 respectively. Codes are available at GitHub at <https://github/xiaohong1/COVID-ViT>.

Related papers

• Evaluating Generalizability of Deep Learning Models Using Indian-COVID-19 CT Dataset [5.398550081886242]
  ma-chine learning (ML) approaches for automatic processing of CT scan images in clinical setting are trained on limited and biased sub-sets of publicly available COVID-19 data. This has raised concerns regarding the generalizability of these models on external datasets, not seen by the model during training. To address some of these issues, in this work CT scan images from confirmed COVID-19 data obtained from one of the largest public repositories, COVIDx CT 2A were used for training and internal vali-dation of machine learning models.
  arXiv  Detail & Related papers  (2022-12-28T16:23:18Z)
• Cov3d: Detection of the presence and severity of COVID-19 from CT scans using 3D ResNets [0.0]
  Cov3d is a three dimensional convolutional neural network for detecting the presence and severity of COVID19 from chest CT scans. For the task of classifying the severity of COVID19, it achieves a macro f1 score of 0.7552.
  arXiv  Detail & Related papers  (2022-07-05T05:22:38Z)
• COVIDx CXR-3: A Large-Scale, Open-Source Benchmark Dataset of Chest X-ray Images for Computer-Aided COVID-19 Diagnostics [69.55060769611916]
  The use of chest X-ray (CXR) imaging as a complementary screening strategy to RT-PCR testing is increasing. Many visual perception models have been proposed for COVID-19 screening based on CXR imaging. We introduce COVIDx CXR-3, a large-scale benchmark dataset of CXR images for supporting COVID-19 computer vision research.
  arXiv  Detail & Related papers  (2022-06-08T04:39:44Z)
• CNN Filter Learning from Drawn Markers for the Detection of Suggestive Signs of COVID-19 in CT Images [58.720142291102135]
  We propose a method that does not require either large annotated datasets or backpropagation to estimate the filters of a convolutional neural network (CNN) For a few CT images, the user draws markers at representative normal and abnormal regions. The method generates a feature extractor composed of a sequence of convolutional layers, whose kernels are specialized in enhancing regions similar to the marked ones.
  arXiv  Detail & Related papers  (2021-11-16T15:03:42Z)
• The Report on China-Spain Joint Clinical Testing for Rapid COVID-19 Risk Screening by Eye-region Manifestations [59.48245489413308]
  We developed and tested a COVID-19 rapid prescreening model using the eye-region images captured in China and Spain with cellphone cameras. The performance was measured using area under receiver-operating-characteristic curve (AUC), sensitivity, specificity, accuracy, and F1.
  arXiv  Detail & Related papers  (2021-09-18T02:28:01Z)
• COV-ECGNET: COVID-19 detection using ECG trace images with deep convolutional neural network [0.40631409309544836]
  This study will explore the possibility of using deep convolutional neural network (CNN) models to detect COVID-19 from electrocardiogram (ECG) trace images. In this work, COVID-19 and other cardiovascular diseases (CVDs) were detected using deep-learning techniques.
  arXiv  Detail & Related papers  (2021-06-01T12:33:08Z)
• Randomly Initialized Convolutional Neural Network for the Recognition of COVID-19 using X-ray Images [0.0]
  coronavirus disease (COVID-19) has been declared a worldwide pandemic. One potential solution to detect COVID-19 is by analyzing the chest X-ray images using Deep Learning (DL) models. In this study, we propose a novel randomly CNN architecture for the recognition of COVID-19. The proposed CNN model yields encouraging results with 94% and 99% of accuracy for COVIDx and enhanced COVID-19 dataset, respectively.
  arXiv  Detail & Related papers  (2021-05-17T23:40:37Z)
• COVID-Net CT-2: Enhanced Deep Neural Networks for Detection of COVID-19 from Chest CT Images Through Bigger, More Diverse Learning [70.92379567261304]
  We introduce COVID-Net CT-2, enhanced deep neural networks for COVID-19 detection from chest CT images. We leverage explainability to investigate the decision-making behaviour of COVID-Net CT-2. Results are promising and suggest the strong potential of deep neural networks as an effective tool for computer-aided COVID-19 assessment.
  arXiv  Detail & Related papers  (2021-01-19T03:04:09Z)
• Automated Model Design and Benchmarking of 3D Deep Learning Models for COVID-19 Detection with Chest CT Scans [72.04652116817238]
  We propose a differentiable neural architecture search (DNAS) framework to automatically search for the 3D DL models for 3D chest CT scans classification. We also exploit the Class Activation Mapping (CAM) technique on our models to provide the interpretability of the results.
  arXiv  Detail & Related papers  (2021-01-14T03:45:01Z)
• Classification of COVID-19 in CT Scans using Multi-Source Transfer Learning [91.3755431537592]
  We propose the use of Multi-Source Transfer Learning to improve upon traditional Transfer Learning for the classification of COVID-19 from CT scans. With our multi-source fine-tuning approach, our models outperformed baseline models fine-tuned with ImageNet. Our best performing model was able to achieve an accuracy of 0.893 and a Recall score of 0.897, outperforming its baseline Recall score by 9.3%.
  arXiv  Detail & Related papers  (2020-09-22T11:53:06Z)
• Automated Chest CT Image Segmentation of COVID-19 Lung Infection based on 3D U-Net [0.0]
  The coronavirus disease 2019 (COVID-19) affects billions of lives around the world and has a significant impact on public healthcare. We propose an innovative automated segmentation pipeline for COVID-19 infected regions. Our method focuses on on-the-fly generation of unique and random image patches for training by performing several preprocessing methods.
  arXiv  Detail & Related papers  (2020-06-24T17:29:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.