Attention-based Multi-scale Gated Recurrent Encoder with Novel
Correlation Loss for COVID-19 Progression Prediction
- URL: http://arxiv.org/abs/2107.08330v1
- Date: Sun, 18 Jul 2021 00:37:55 GMT
- Title: Attention-based Multi-scale Gated Recurrent Encoder with Novel
Correlation Loss for COVID-19 Progression Prediction
- Authors: Aishik Konwer, Joseph Bae, Gagandeep Singh, Rishabh Gattu, Syed Ali,
Jeremy Green, Tej Phatak, Prateek Prasanna
- Abstract summary: We present a deep learning-based approach to predict lung infiltrate progression from serial chest radiographs (CXRs) of COVID-19 patients.
Our framework predicts zone-wise disease severity for a patient on a given day by learning representations from the previous temporal CXRs.
- Score: 3.3070542851160782
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: COVID-19 image analysis has mostly focused on diagnostic tasks using single
timepoint scans acquired upon disease presentation or admission. We present a
deep learning-based approach to predict lung infiltrate progression from serial
chest radiographs (CXRs) of COVID-19 patients. Our method first utilizes
convolutional neural networks (CNNs) for feature extraction from patches within
the concerned lung zone, and also from neighboring and remote boundary regions.
The framework further incorporates a multi-scale Gated Recurrent Unit (GRU)
with a correlation module for effective predictions. The GRU accepts CNN
feature vectors from three different areas as input and generates a fused
representation. The correlation module attempts to minimize the correlation
loss between hidden representations of concerned and neighboring area feature
vectors, while maximizing the loss between the same from concerned and remote
regions. Further, we employ an attention module over the output hidden states
of each encoder timepoint to generate a context vector. This vector is used as
an input to a decoder module to predict patch severity grades at a future
timepoint. Finally, we ensemble the patch classification scores to calculate
patient-wise grades. Specifically, our framework predicts zone-wise disease
severity for a patient on a given day by learning representations from the
previous temporal CXRs. Our novel multi-institutional dataset comprises
sequential CXR scans from N=93 patients. Our approach outperforms transfer
learning and radiomic feature-based baseline approaches on this dataset.
Related papers
- Domain Adaptive Synapse Detection with Weak Point Annotations [63.97144211520869]
We present AdaSyn, a framework for domain adaptive synapse detection with weak point annotations.
In the WASPSYN challenge at I SBI 2023, our method ranks the 1st place.
arXiv Detail & Related papers (2023-08-31T05:05:53Z) - Deep reproductive feature generation framework for the diagnosis of
COVID-19 and viral pneumonia using chest X-ray images [0.0]
Two-stage feature extraction framework using eight state-of-the-art pre-trained deep Convolutional Neural Networks (CNNs) and an autoencoder is proposed.
X-ray scans are divided into four equally sized sections and analyzed by deep pre-trained CNNs.
Autoencoder with three hidden layers is trained to extract reproductive features from the ouput of CNNs.
arXiv Detail & Related papers (2023-04-20T23:52:21Z) - Improving Classification Model Performance on Chest X-Rays through Lung
Segmentation [63.45024974079371]
We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations.
Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
arXiv Detail & Related papers (2022-02-22T15:24:06Z) - CNN Filter Learning from Drawn Markers for the Detection of Suggestive
Signs of COVID-19 in CT Images [58.720142291102135]
We propose a method that does not require either large annotated datasets or backpropagation to estimate the filters of a convolutional neural network (CNN)
For a few CT images, the user draws markers at representative normal and abnormal regions.
The method generates a feature extractor composed of a sequence of convolutional layers, whose kernels are specialized in enhancing regions similar to the marked ones.
arXiv Detail & Related papers (2021-11-16T15:03:42Z) - A Deep Learning Approach to Predicting Collateral Flow in Stroke
Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow.
The actual grading is mostly done through manual inspection of the acquired images.
We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
arXiv Detail & Related papers (2021-10-24T18:58:40Z) - Dense Regression Activation Maps For Lesion Segmentation in CT scans of
COVID-19 patients [9.313053265087262]
We propose a weakly-supervised segmentation method based on dense regression activation maps (dRAM)
Our method substantially improves the intersection over union from 0.335 in the CAM-based weakly supervised segmentation method to 0.495.
arXiv Detail & Related papers (2021-05-25T08:29:35Z) - A Structure-Aware Relation Network for Thoracic Diseases Detection and
Segmentation [63.76299770460766]
Instance level detection and segmentation of thoracic diseases or abnormalities are crucial for automatic diagnosis in chest X-ray images.
We propose a structure-aware relation network (SAR-Net) extending Mask R-CNN.
We release ChestX-Det, a chest X-Ray dataset with instance-level annotations (boxes and masks)
arXiv Detail & Related papers (2021-04-21T02:57:02Z) - COVID-19 identification from volumetric chest CT scans using a
progressively resized 3D-CNN incorporating segmentation, augmentation, and
class-rebalancing [4.446085353384894]
COVID-19 is a global pandemic disease overgrowing worldwide.
Computer-aided screening tools with greater sensitivity is imperative for disease diagnosis and prognosis.
This article proposes a 3D Convolutional Neural Network (CNN)-based classification approach.
arXiv Detail & Related papers (2021-02-11T18:16:18Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z) - BS-Net: learning COVID-19 pneumonia severity on a large Chest X-Ray
dataset [6.5800499500032705]
We design an end-to-end deep learning architecture for predicting, on Chest X-rays images (CXR), a multi-regional score conveying the degree of lung compromise in COVID-19 patients.
We exploit a clinical dataset of almost 5,000 CXR annotated images collected in the same hospital.
Our solution outperforms single human annotators in rating accuracy and consistency.
arXiv Detail & Related papers (2020-06-08T13:55:58Z) - A Deep Convolutional Neural Network for COVID-19 Detection Using Chest
X-Rays [2.2843885788439797]
We present image classifiers based on Dense Convolutional Networks and transfer learning to classify chest X-ray images according to three labels: COVID-19, pneumonia and normal.
We were able to reach test accuracy of 100% on our test dataset.
arXiv Detail & Related papers (2020-04-30T13:20:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.