MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter

• URL: http://arxiv.org/abs/2608.16709v1
• Date: Mon, 17 Aug 2026 15:25:38 GMT
• Title: MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter
• Abstract summary: MIRROR is a research prototype built to separate failures from successes.<n>It chains a multi-label classifier, a Grad-CAM localizer, and a report writer that receives the labels, probabilities, and regions but never the image.<n>A MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text.
• Score: 1.3106404792425626
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A radiologist reading a model's output faces two problems. The model returns a number and no reason, and any system that turns that number into readable prose can quietly add claims the model never made. MIRROR is a research prototype built to separate those failures. It chains a multi-label classifier, a Grad-CAM localizer that turns each positive finding into a named anatomical region, and a report writer that receives the labels, probabilities, and regions but never the image. Because the language layer cannot see pixels, it cannot assert a finding the classifier did not make. We are precise about what that buys: a MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text, and we show one stating a cardiothoracic ratio the system never measured. One registry holds the taxonomy, anatomy, and phrasing for chest X-ray, brain MRI, and head CT, so adding a modality is a data change; all three are routed and tested, one is trained. On ChestMNIST that classifier reaches macro AUROC 0.729 and ranks better than chance on all 14 labels, at 1.6 to 6.8 times the precision a random ranker would get. Yet at the default 0.5 threshold it emits no positive prediction at all for 11 of them, and its excellent-looking Brier score of 0.045 sits beside the 0.047 earned by a predictor that ignores the image. The discrimination is real; the decisions are not. Under the class imbalance normal in radiology, aggregate metrics flatter models that do nothing, and should be reported against that floor.

Related papers

• The Diagnosis a Reporter Leaves Unspoken: Surfacing Frozen Tumor Features for Brain-Tumor MRI Reporting [0.9283653948385912]
  A capable brain-MRI report generator can still be diagnostically silent.<n>NeuroFusion surfaces this latent signal rather than overriding it.<n>Two board-certified neurologists independently rated NeuroFusion highest in every tumour type.
  arXiv  Detail & Related papers  (2026-09-02T10:29:53Z)
• Explaining AI-Image Detection: What the Heatmap Actually Shows [65.01025489527173]
  We build a detector and attach an attribution map as its evidence.<n>We measure what that pair delivers on 186,527 images under controls.<n>Whether an attribution ranking exists at all depends on whether the detector reacts to the image.
  arXiv  Detail & Related papers  (2026-07-31T16:07:05Z)
• Trustworthy Medical Segmentation: Uncertainty-Aware U-Net Evaluation Under Clinical Image Degradation [0.0]
  We present a framework for evaluating uncertainty-aware segmentation under clinical degradation.<n>We measure segmentation accuracy, calibration, failure detection, and selective prediction coverage.<n>These results argue for uncertainty-aware inference as a practical safety layer in physician-in-the-loop radiology.
  arXiv  Detail & Related papers  (2026-07-22T06:35:33Z)
• Monte Carlo Dropout Uncertainty and Entropy-Thresholded Selective Prediction for Architecture-Agnostic Brain Tumor MRI Triage [0.0]
  This study proposes an uncertainty-first pipeline for four-class brain tumor MRI.<n>It reads predictive uncertainty from Monte Carlo (MC) Dropout over T = 20 passes and turns the resulting entropy into an explicit rule for deferring uncertain cases to a radiologist.
  arXiv  Detail & Related papers  (2026-07-15T06:21:17Z)
• CogRad: A Cognitively-Inspired Multi-Agent Framework for Radiology Report Generation [5.995766869240907]
  CogRad is a framework that structures generation around four stages of a radiologist's reading process.<n>On CheXpert Plus, CogRad attains a BLEU-4 of 0.316 and a CIDEr of 0.322, the best scores among the methods we compare against.
  arXiv  Detail & Related papers  (2026-07-04T12:43:04Z)
• Vision-language models for chest radiography do not always need the image [4.363746910191589]
  Medical vision-language models report strong chest radiograph accuracy, and this is increasingly read as evidence that they use the image.<n>We introduce a causal audit that intervenes on the image, occluding the relevant region, occluding an irrelevant one, and swapping in another patient's same-label scan.<n>Across nine systems, a text-only model with no image access reaches within 5.7 accuracy points of the best multimodal one.
  arXiv  Detail & Related papers  (2026-06-16T09:22:10Z)
• Automated Spinal MRI Labelling from Reports Using a Large Language Model [45.348320669329205]
  We propose a pipeline to automate the extraction of labels from radiology reports using large language models. Our method equals or surpasses GPT-4 on a held-out set of reports. We show that the extracted labels can be used to train imaging models to classify the identified conditions in the accompanying MR scans.
  arXiv  Detail & Related papers  (2024-10-22T17:54:07Z)
• Brain Tumor Classification on MRI in Light of Molecular Markers [56.99710477905796]
  Co-deletion of the 1p/19q gene is associated with clinical outcomes in low-grade gliomas.<n>This study aims to utilize a specially MRI-based convolutional neural network for brain cancer detection.
  arXiv  Detail & Related papers  (2024-09-29T07:04:26Z)
• Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation [42.06416052431378]
  2D radiology captioning is incompetent to reflect the real-world diagnostic challenge in the volumetric 3D anatomy. We collected an 18,885 text-scan pairs 3D-BrainCT dataset and applied clinical visual instruction tuning to train BrainGPT models to generate radiology-adherent 3D brain CT reports. Our work embodies a holistic framework that showcased the first-hand experience of curating a 3D brain CT dataset, fine-tuning anatomy-sensible language models, and proposing robust radiology evaluation metrics.
  arXiv  Detail & Related papers  (2024-07-02T12:58:35Z)
• Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders [50.689585476660554]
  We propose a new fine-tuning strategy that includes positive-pair loss relaxation and random sentence sampling. Our approach consistently improves overall zero-shot pathology classification across four chest X-ray datasets and three pre-trained models.
  arXiv  Detail & Related papers  (2022-12-14T06:04:18Z)
• StRegA: Unsupervised Anomaly Detection in Brain MRIs using a Compact Context-encoding Variational Autoencoder [48.2010192865749]
  Unsupervised anomaly detection (UAD) can learn a data distribution from an unlabelled dataset of healthy subjects and then be applied to detect out of distribution samples. This research proposes a compact version of the "context-encoding" VAE (ceVAE) model, combined with pre and post-processing steps, creating a UAD pipeline (StRegA) The proposed pipeline achieved a Dice score of 0.642$pm$0.101 while detecting tumours in T2w images of the BraTS dataset and 0.859$pm$0.112 while detecting artificially induced anomalies.
  arXiv  Detail & Related papers  (2022-01-31T14:27:35Z)
• An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization [45.00998416720726]
  We propose a framework to address the unique properties of medical images. This model first uses a low-capacity, yet memory-efficient, network on the whole image to identify the most informative regions. It then applies another higher-capacity network to collect details from chosen regions. Finally, it employs a fusion module that aggregates global and local information to make a final prediction.
  arXiv  Detail & Related papers  (2020-02-13T15:28:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.