Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data

• URL: http://arxiv.org/abs/2606.25894v1
• Date: Wed, 24 Jun 2026 14:41:27 GMT
• Title: Enhancing Brain MRI Anomaly Detection and Reasoning with ROI Rethink and Synthetic Data
• Abstract summary: We present BrReMark, a framework that introduces explicit region marking into brain MRI diagnosis.<n>The model first generates hypotheses about potential abnormalities and grounds them through explicit bounding box marking.<n>We integrate a domain randomization-based pathology synthesis augmentation strategy to improve the model's generalizability to out-of-distribution (OOD) data.
• Score: 9.98520042320808
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Medical vision-language models typically generate diagnoses through single-pass inference without indicating which image regions support their conclusions. This lack of spatial grounding limits clinical utility: outputs cannot be audited, and models may hallucinate findings on normal scans. We present BrReMark (Brain Rethink via ROI Marking), a framework that introduces explicit region marking into brain MRI diagnosis. The model first generates hypotheses about potential abnormalities and grounds them through explicit bounding box marking, then verifies conclusions by re-examining the marked evidence. Training combines supervised fine-tuning on structured reasoning trajectories with reinforcement learning using a composite reward over localization accuracy and diagnostic reasoning. Furthermore, we integrate a domain randomization-based pathology synthesis augmentation strategy to improve the model's generalizability to out-of-distribution (OOD) data. On internal benchmark, BrReMark improves mAP50 from 0.74% to 37.54% compared to the base model, while achieving 21.57% Clinical F1 and 45.26% diagnostic accuracy. On NOVA OOD benchmark, it also achieves competitive overall performance with a 45.7% reduction in false positives compared to the state-of-the-art, indicating reduced hallucination on rare pathologies. These findings suggest that explicit hypothesis-verification grounding is a practical path toward trustworthy open-ended brain MRI diagnosis across both in-distribution and OOD settings.

Related papers

• PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models on Whole-Slide Pathology Image [16.376573433449458]
  Whole-slide image (WSI) diagnosis requires identifying diagnostically relevant regions, examining them across magnifications, and integrating multi-scale evidence.<n>Most existing pathology benchmarks evaluate models on pre-cropped patches or pre-extracted slide features, leaving their ability to acquire evidence directly from gigapixel WSIs largely untested.<n>We introduce PathAgentBench, a benchmark for evaluating evidence-seeking vision-language models (VLMs) across four complementary capabilities.
  arXiv  Detail & Related papers  (2026-07-21T16:33:44Z)
• SHOVIR: A Benchmark for Evaluating Vision Shortcut Learning in Radiology Report Generation [1.5782980044380892]
  Current evaluation protocols for Vision-Language Models in Radiology Report Generation rely on report-level metrics that measure lexical overlap or aggregate clinical correctness.<n>We introduce SHOVIR, a benchmark for evaluating vision shortcut behavior in RRG.
  arXiv  Detail & Related papers  (2026-06-29T12:17:35Z)
• OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models [45.337436216670746]
  We introduce OpenMedReason, a large-scale, open multimodal medical reasoning corpus.<n>It covers diverse medical domain vision modalities such as radiological scans, microscopic images, visible light photographs, charts, and others.<n>Training with OpenMedReason yields a 20% average improvement in VQA accuracy over the base model.
  arXiv  Detail & Related papers  (2026-06-10T14:56:51Z)
• FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis [44.21684876717324]
  We introduce FairGen, a fairness-aware diffusion framework that synthesizes demographically balanced medical images.<n>By embedding physician-aligned preferences into the generation process, FairGen improves coverage during synthesis and downstream classification.
  arXiv  Detail & Related papers  (2026-06-01T15:45:20Z)
• One-shot synthesis of rare gastrointestinal lesions improves diagnostic accuracy and clinical training [45.49415063761575]
  EndoRare is a one-shot, retraining-free generative framework that synthesizes diverse, high-fidelity lesion exemplars from a single reference image.<n>We validated the framework across four rare pathologies.<n>These results establish a practical, data-efficient pathway to bridge the rare-disease gap in both computer-aided diagnostics and clinical education.
  arXiv  Detail & Related papers  (2025-12-30T15:07:09Z)
• An Explainable Hybrid AI Framework for Enhanced Tuberculosis and Symptom Detection [55.35661671061754]
  Tuberculosis remains a critical global health issue, particularly in resource-limited and remote areas.<n>We propose a framework which enhances disease and symptom detection on chest X-rays by integrating two supervised heads and a self-supervised head.<n>Our model achieves an accuracy of 98.85% for distinguishing between COVID-19, tuberculosis, and normal cases, and a macro-F1 score of 90.09% for multilabel symptom detection.
  arXiv  Detail & Related papers  (2025-10-21T17:18:55Z)
• Expert-Guided Explainable Few-Shot Learning for Medical Image Diagnosis [2.7946918847372277]
  We propose an expert-guided explainable few-shot learning framework that integrates radiologist-provided regions of interest into model training.<n>We evaluate our framework on two distinct datasets: BraTS (MRI) and VinDr-CXR (Chest X-ray)<n>Our findings demonstrate the effectiveness of incorporating expert-guided attention supervision to bridge the gap between performance and interpretability in few-shot medical image diagnosis.
  arXiv  Detail & Related papers  (2025-09-08T05:31:37Z)
• Fusion-Based Brain Tumor Classification Using Deep Learning and Explainable AI, and Rule-Based Reasoning [0.0]
  This study presents an ensemble-based deep learning framework that combines MobileNetV2 and DenseNet121 convolutional neural networks (CNNs)<n>The models were trained and evaluated on the Figshare dataset using a stratified 5-fold cross-validation protocol.<n>The ensemble achieved superior performance compared to individual CNNs, with an accuracy of 91.7%, precision of 91.9%, recall of 91.7%, and F1-score of 91.6%.
  arXiv  Detail & Related papers  (2025-08-09T08:46:36Z)
• AXIAL: Attention-based eXplainability for Interpretable Alzheimer's Localized Diagnosis using 2D CNNs on 3D MRI brain scans [43.06293430764841]
  This study presents an innovative method for Alzheimer's disease diagnosis using 3D MRI designed to enhance the explainability of model decisions. Our approach adopts a soft attention mechanism, enabling 2D CNNs to extract volumetric representations. With voxel-level precision, our method identified which specific areas are being paid attention to, identifying these predominant brain regions.
  arXiv  Detail & Related papers  (2024-07-02T16:44:00Z)
• Modeling T1 Resting-State MRI Variants Using Convolutional Neural Networks in Diagnosis of OCD [0.0]
  Obsessive-compulsive disorder (OCD) presents itself as a highly debilitating disorder. OCD has common associations with the prefrontal cortex and the glutamate receptor known as Metabotropic Glutamate Receptor 5 (mGluR5) Computational modeling methods were used as a means of validation for previous hypotheses involving mGluR5.
  arXiv  Detail & Related papers  (2023-06-15T12:02:57Z)
• Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis [44.45598796591008]
  Brain imaging-to-graph generation (BIGG) framework is proposed to map functional magnetic resonance imaging (fMRI) into effective connectivity for mild cognitive impairment analysis. The hierarchical transformers in the generator are designed to estimate the noise at multiple scales. Evaluations of the ADNI dataset demonstrate the feasibility and efficacy of the proposed model.
  arXiv  Detail & Related papers  (2023-05-18T06:54:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.