A Novel Vision Transformer with Residual in Self-attention for Biomedical Image Classification

• URL: http://arxiv.org/abs/2306.01594v2
• Date: Mon, 5 Jun 2023 04:45:36 GMT
• Title: A Novel Vision Transformer with Residual in Self-attention for Biomedical Image Classification
• Authors: Arun K. Sharma and Nishchal K. Verma
• Abstract summary: This article presents the novel framework of multi-head self-attention for vision transformer (ViT) The proposed method uses the concept of residual connection for accumulating the best attention output in each block of multi-head attention. The results show the significant improvement over traditional ViT and other convolution based state-of-the-art classification models.
• Score: 8.92307560991779
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Biomedical image classification requires capturing of bio-informatics based on specific feature distribution. In most of such applications, there are mainly challenges due to limited availability of samples for diseased cases and imbalanced nature of dataset. This article presents the novel framework of multi-head self-attention for vision transformer (ViT) which makes capable of capturing the specific image features for classification and analysis. The proposed method uses the concept of residual connection for accumulating the best attention output in each block of multi-head attention. The proposed framework has been evaluated on two small datasets: (i) blood cell classification dataset and (ii) brain tumor detection using brain MRI images. The results show the significant improvement over traditional ViT and other convolution based state-of-the-art classification models.

Related papers

• A Multimodal Approach For Endoscopic VCE Image Classification Using BiomedCLIP-PubMedBERT [0.62914438169038]
  This Paper presents an advanced approach for fine-tuning BiomedCLIP PubMedBERT, a multimodal model, to classify abnormalities in Video Capsule Endoscopy frames. Our method categorizes images into ten specific classes: angioectasia, bleeding, erosion, erythema, foreign body, lymphangiectasia, polyp, ulcer, worms, and normal. Performance metrics, including classification, accuracy, recall, and F1 score, indicate the models strong ability to accurately identify abnormalities in endoscopic frames.
  arXiv  Detail & Related papers  (2024-10-25T19:42:57Z)
• Discrepancy-based Diffusion Models for Lesion Detection in Brain MRI [1.8420387715849447]
  Diffusion probabilistic models (DPMs) have exhibited significant effectiveness in computer vision tasks. Their notable performance heavily relies on labelled datasets, which limits their application in medical images. This paper introduces a novel framework by incorporating distinctive discrepancy features.
  arXiv  Detail & Related papers  (2024-05-08T11:26:49Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• Causality-Driven One-Shot Learning for Prostate Cancer Grading from MRI [1.049712834719005]
  We present a novel method to automatically classify medical images that learns and leverages weak causal signals in the image. Our framework consists of a convolutional neural network backbone and a causality-extractor module. Our findings show that causal relationships among features play a crucial role in enhancing the model's ability to discern relevant information.
  arXiv  Detail & Related papers  (2023-09-19T16:08:33Z)
• Multi-Label Retinal Disease Classification using Transformers [0.0]
  A new multi-label retinal disease dataset, MuReD, is constructed, using a number of publicly available datasets for fundus disease classification. A transformer-based model optimized through extensive experimentation is used for image analysis and decision making. It is shown that the approach performs better than state-of-the-art works on the same task by 7.9% and 8.1% in terms of AUC score for disease detection and disease classification.
  arXiv  Detail & Related papers  (2022-07-05T22:06:52Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Microscopic fine-grained instance classification through deep attention [7.50282814989294]
  Fine-grained classification of microscopic image data with limited samples is an open problem in computer vision and biomedical imaging. We propose a simple yet effective deep network that performs two tasks simultaneously in an end-to-end manner. The result is a robust but lightweight end-to-end trainable deep network that yields state-of-the-art results.
  arXiv  Detail & Related papers  (2020-10-06T15:29:58Z)
• Multi-label Thoracic Disease Image Classification with Cross-Attention Networks [65.37531731899837]
  We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images. We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
  arXiv  Detail & Related papers  (2020-07-21T14:37:00Z)
• Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model [71.80319052891817]
  We present a relation-driven semi-supervised framework for medical image classification. It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations. Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
  arXiv  Detail & Related papers  (2020-05-15T06:57:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.