Interpretable CNN-Multilevel Attention Transformer for Rapid Recognition of Pneumonia from Chest X-Ray Images

• URL: http://arxiv.org/abs/2210.16584v2
• Date: Sat, 13 Jan 2024 12:00:45 GMT
• Title: Interpretable CNN-Multilevel Attention Transformer for Rapid Recognition of Pneumonia from Chest X-Ray Images
• Authors: Shengchao Chen, Sufen Ren, Guanjun Wang, Mengxing Huang, and Chenyang Xue
• Abstract summary: This paper develops a pneumonia recognition framework with interpretability to provide high-speed analytics support for medical practice. To reduce the computational complexity to accelerate the recognition process, a novel multi-level self-attention mechanism within Transformer has been proposed. The effectiveness of the proposed method has been demonstrated on the classic COVID-19 recognition task using the widespread pneumonia CXR image dataset.
• Score: 2.1408385210297656
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Chest imaging plays an essential role in diagnosing and predicting patients with COVID-19 with evidence of worsening respiratory status. Many deep learning-based approaches for pneumonia recognition have been developed to enable computer-aided diagnosis. However, the long training and inference time makes them inflexible, and the lack of interpretability reduces their credibility in clinical medical practice. This paper aims to develop a pneumonia recognition framework with interpretability, which can understand the complex relationship between lung features and related diseases in chest X-ray (CXR) images to provide high-speed analytics support for medical practice. To reduce the computational complexity to accelerate the recognition process, a novel multi-level self-attention mechanism within Transformer has been proposed to accelerate convergence and emphasize the task-related feature regions. Moreover, a practical CXR image data augmentation has been adopted to address the scarcity of medical image data problems to boost the model's performance. The effectiveness of the proposed method has been demonstrated on the classic COVID-19 recognition task using the widespread pneumonia CXR image dataset. In addition, abundant ablation experiments validate the effectiveness and necessity of all of the components of the proposed method.

Related papers

• Hybrid CNN with Chebyshev Polynomial Expansion for Medical Image Analysis [0.0]
  Lung cancer remains one of the leading causes of cancer-related mortality worldwide. Traditional Convolutional Neural Networks (CNNs) have shown considerable promise in medical image analysis. In this study, we propose a novel hybrid deep learning architecture that incorporates Chebyshev-CNN.
  arXiv  Detail & Related papers  (2025-04-09T12:02:56Z)
• BS-Diff: Effective Bone Suppression Using Conditional Diffusion Models from Chest X-Ray Images [21.19843479423806]
  Chest X-rays (CXRs) are commonly utilized as a low-dose modality for lung screening. Approximately 75% of the lung area overlaps with bone, which in turn hampers the detection and diagnosis of diseases. Bone suppression techniques have been introduced, but the current dual-energy subtraction imaging technique in the clinic requires costly equipment and subjects being exposed to high radiation. This paper proposes a new bone suppression framework, termed BS-Diff, that comprises a conditional diffusion model equipped with a U-Net architecture and a simple enhancement module to incorporate an autoencoder.
  arXiv  Detail & Related papers  (2023-11-26T15:13:13Z)
• Multi-Scale Feature Fusion using Parallel-Attention Block for COVID-19 Chest X-ray Diagnosis [2.15242029196761]
  Under the global COVID-19 crisis, accurate diagnosis of COVID-19 from Chest X-ray (CXR) images is critical. We propose a novel multi-feature fusion network using parallel attention blocks to fuse the original CXR images and local-phase feature-enhanced CXR images at multi-scales.
  arXiv  Detail & Related papers  (2023-04-25T16:56:12Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Images [2.2098092675263423]
  We propose a novel explainable deep learning framework (CXRNet) for accurate COVID-19 pneumonia detection. The proposed framework is based on a new multitask architecture, allowing for both disease classification and visual explanation. The experimental results demonstrate that the proposed method can achieve a satisfactory level of accuracy.
  arXiv  Detail & Related papers  (2021-10-20T22:50:35Z)
• In-Line Image Transformations for Imbalanced, Multiclass Computer Vision Classification of Lung Chest X-Rays [91.3755431537592]
  This study aims to leverage a body of literature in order to apply image transformations that would serve to balance the lack of COVID-19 LCXR data. Deep learning techniques such as convolutional neural networks (CNNs) are able to select features that distinguish between healthy and disease states. This study utilizes a simple CNN architecture for high-performance multiclass LCXR classification at 94 percent accuracy.
  arXiv  Detail & Related papers  (2021-04-06T02:01:43Z)
• Variational Knowledge Distillation for Disease Classification in Chest X-Rays [102.04931207504173]
  We propose itvariational knowledge distillation (VKD), which is a new probabilistic inference framework for disease classification based on X-rays. We demonstrate the effectiveness of our method on three public benchmark datasets with paired X-ray images and EHRs.
  arXiv  Detail & Related papers  (2021-03-19T14:13:56Z)
• Longitudinal Quantitative Assessment of COVID-19 Infection Progression from Chest CTs [36.71379097297172]
  We propose a new framework to identify infection at a voxel level and visualize the progression of COVID-19. In particular, we devise a longitudinal segmentation network that utilizes the reference scan information to improve the performance of disease identification.
  arXiv  Detail & Related papers  (2021-03-12T12:35:11Z)
• Fibrosis-Net: A Tailored Deep Convolutional Neural Network Design for Prediction of Pulmonary Fibrosis Progression from Chest CT Images [59.622239796473885]
  Pulmonary fibrosis is a chronic lung disease that causes irreparable lung tissue scarring and damage, resulting in progressive loss in lung capacity and no known cure. We introduce Fibrosis-Net, a deep convolutional neural network design tailored for the prediction of pulmonary fibrosis progression from chest CT images.
  arXiv  Detail & Related papers  (2021-03-06T02:16:41Z)
• Diagnosis of Coronavirus Disease 2019 (COVID-19) with Structured Latent Multi-View Representation Learning [48.05232274463484]
  Recently, the outbreak of Coronavirus Disease 2019 (COVID-19) has spread rapidly across the world. Due to the large number of affected patients and heavy labor for doctors, computer-aided diagnosis with machine learning algorithm is urgently needed. In this study, we propose to conduct the diagnosis of COVID-19 with a series of features extracted from CT images.
  arXiv  Detail & Related papers  (2020-05-06T15:19:15Z)
• Residual Attention U-Net for Automated Multi-Class Segmentation of COVID-19 Chest CT Images [46.844349956057776]
  coronavirus disease 2019 (COVID-19) has been spreading rapidly around the world and caused significant impact on the public health and economy. There is still lack of studies on effectively quantifying the lung infection caused by COVID-19. We propose a novel deep learning algorithm for automated segmentation of multiple COVID-19 infection regions.
  arXiv  Detail & Related papers  (2020-04-12T16:24:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.