an interpretable vision transformer framework for automated brain tumor classification

• URL: http://arxiv.org/abs/2604.21311v1
• Date: Thu, 23 Apr 2026 06:07:10 GMT
• Title: an interpretable vision transformer framework for automated brain tumor classification
• Abstract summary: This paper proposes a deep learning framework for automated four-class brain tumor classification.<n>The proposed system employs a Vision Transformer (ViT-B/16) pretrained on ImageNet-21k as the backbone.<n>The proposed model achieves a test accuracy of 99.29%, macro F1-score of 99.25%, and perfect recall on both healthy and meningioma classes.
• Score: 0.04999814847776097
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Brain tumors represent one of the most critical neurological conditions, where early and accurate diagnosis is directly correlated with patient survival rates. Manual interpretation of Magnetic Resonance Imaging (MRI) scans is time-intensive, subject to inter-observer variability, and demands significant specialist expertise. This paper proposes a deep learning framework for automated four-class brain tumor classification distinguishing glioma, meningioma, pituitary tumor, and healthy brain tissue from a dataset of 7,023 MRI scans. The proposed system employs a Vision Transformer (ViT-B/16) pretrained on ImageNet-21k as the backbone, augmented with a clinically motivated preprocessing and training pipeline. Contrast Limited Adaptive Histogram Equalization (CLAHE) is applied to enhance local contrast and accentuate tumor boundaries invisible to standard normalization. A two-stage fine-tuning strategy is adopted: the classification head is warmed up with the backbone frozen, followed by full fine-tuning with discriminative learning rates. MixUp and CutMix augmentation is applied per batch to improve generalization. Exponential Moving Average (EMA) of weights and Test-Time Augmentation (TTA) further stabilize and boost performance. Attention Rollout visualization provides clinically interpretable heatmaps of the brain regions driving each prediction. The proposed model achieves a test accuracy of 99.29%, macro F1-score of 99.25%, and perfect recall on both healthy and meningioma classes, outperforming all CNN-based baselines

Related papers

• B-MIM: Biased Masked Image Modeling for Generalizable Segmentation of Fine-Grained Anatomical Structures [42.844780603412325]
  Self-supervised pretraining enables transferable representations for medical imaging.<n>Most CT encoders remain biased toward coarse semantic understanding.<n>We introduce Biased Masked Image Modeling to reduce global semantic alignment.
  arXiv  Detail & Related papers  (2026-08-25T10:20:05Z)
• Bridging Topology and Deep Representation Learning: A TDA-ViT Fusion Model for Four-Class Brain Tumor Classification [0.8374077003751697]
  We propose a fusion framework that combines Topological Data Analysis features with pretrained Vision Transformer representations for four-class brain tumor classification.<n>The proposed TDA-ViT fusion model achieves an accuracy of 99.10%, precision of 99.27%, recall of 99.15%, F1-score of 99.21%, and an AUC of 99.98%.
  arXiv  Detail & Related papers  (2026-05-30T23:28:15Z)
• Enhancing Brain Tumor Classification Using Vision Transformers with Colormap-Based Feature Representation on BRISC2025 Dataset [0.8374077003751697]
  We propose a deep learning framework based on Vision Transformers (ViT) enhanced with colormap-based feature representation to improve brain tumor classification performance.<n>Experiments are conducted on the BRISC2025 dataset, which includes four classes: glioma, meningioma, pituitary tumor, and non-tumor cases.<n>The proposed method achieves a classification accuracy of 98.90%, outperforming baseline convolutional neural network models.
  arXiv  Detail & Related papers  (2026-03-22T13:46:05Z)
• Brain-WM: Brain Glioblastoma World Model [56.45393372490125]
  We present Brain-WM, a pioneering GBM world model that unifies next-step treatment prediction and future MRI generation.<n>Brain-WM encodes latent dynamics into a shared latent space for joint autoregressive treatment prediction and flow-based future MRI generation.<n>Ultimately, Brain-WM offers a robust clinical sandbox for optimizing patient healthcare.
  arXiv  Detail & Related papers  (2026-03-08T09:54:08Z)
• Interpretability and Individuality in Knee MRI: Patient-Specific Radiomic Fingerprint with Reconstructed Healthy Personas [40.168029561784216]
  A radiomic fingerprint is a patient-specific feature set derived from MRI.<n>A healthy persona synthesises a pathology-free baseline for each patient.<n>Comparing features extracted from pathological images against their personas highlights deviations from normal anatomy.
  arXiv  Detail & Related papers  (2026-01-13T14:48:01Z)
• Squeezed-Eff-Net: Edge-Computed Boost of Tomography Based Brain Tumor Classification leveraging Hybrid Neural Network Architecture [0.7829352305480285]
  This work proposes a hybrid deep learning model based on SqueezeNet v1 which is a lightweight model, and EfficientNet-B0, which is a high-performing model.<n>The framework was trained and tested only on publicly available Nickparvar Brain Tumor MRI dataset.
  arXiv  Detail & Related papers  (2025-12-08T07:37:30Z)
• Accelerating Cerebral Diagnostics with BrainFusion: A Comprehensive MRI Tumor Framework [0.41998444721319217]
  This study presents BrainFusion, a significant advancement in brain tumor analysis using magnetic resonance imaging (MRI)<n>We combine fine-tuned convolutional neural networks (CNNs) for tumor classification--including VGG16, ResNet50, and Xception--with YOLOv8 for precise tumor localization with bounding boxes.<n>Our experiments reveal that the fine-tuned VGG16 model achieves test accuracy of 99.86%, substantially exceeding previous benchmarks.
  arXiv  Detail & Related papers  (2025-09-29T00:53:17Z)
• Light Weight CNN for classification of Brain Tumors from MRI Images [0.0]
  This study presents a convolutional neural network (CNN)-based approach for the multi-class classification of brain tumors.<n>We utilize a publicly available dataset containing MRI images categorized into four classes: glioma, meningioma, pituitary tumor, and no tumor.<n> Experimental results demonstrate that the proposed model achieves a classification accuracy of 98.78%, indicating its potential as a diagnostic aid in clinical settings.
  arXiv  Detail & Related papers  (2025-04-29T21:45:11Z)
• MAST-Pro: Dynamic Mixture-of-Experts for Adaptive Segmentation of Pan-Tumors with Knowledge-Driven Prompts [54.915060471994686]
  We propose MAST-Pro, a novel framework that integrates dynamic Mixture-of-Experts (D-MoE) and knowledge-driven prompts for pan-tumor segmentation.<n>Specifically, text and anatomical prompts provide domain-specific priors guiding tumor representation learning, while D-MoE dynamically selects experts to balance generic and tumor-specific feature learning.<n>Experiments on multi-anatomical tumor datasets demonstrate that MAST-Pro outperforms state-of-the-art approaches, achieving up to a 5.20% improvement in average improvement while reducing trainable parameters by 91.04%, without compromising accuracy.
  arXiv  Detail & Related papers  (2025-03-18T15:39:44Z)
• Analysis of the BraTS 2023 Intracranial Meningioma Segmentation Challenge [44.76736949127792]
  We describe the design and results from the BraTS 2023 Intracranial Meningioma Challenge.<n>The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas.<n>The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor.
  arXiv  Detail & Related papers  (2024-05-16T03:23:57Z)
• Learning-based Bone Quality Classification Method for Spinal Metastasis [36.59899006688448]
  Early detection of spinal metastasis is critical for accurate staging and optimal treatment. In this paper, we explore a learning-based automatic bone quality classification method for spinal metastasis based on CT images.
  arXiv  Detail & Related papers  (2024-02-14T02:53:51Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.