Calibrated Triage, Not Autonomy: Confidence Estimation for Medical Vision-Language Models

• URL: http://arxiv.org/abs/2606.15910v1
• Date: Sun, 14 Jun 2026 16:39:17 GMT
• Title: Calibrated Triage, Not Autonomy: Confidence Estimation for Medical Vision-Language Models
• Abstract summary: A vision-language model can answer a question about a medical image fluently and confidently while barely using the image.<n>We evaluate seven confidence estimators across five open-weight LVLMs and three medical visual-question-answering datasets.
• Score: 4.0196226339562555
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A vision-language model can answer a question about a medical image fluently and confidently while barely using the image, leaning instead on language priors. In medicine this is the failure that matters most, because the answer looks trustworthy and is not, and the only protection is a confidence score reliable enough to tell the system when to abstain. We ask a deployment question rather than an accuracy one: how much imaging work a model can safely handle alone, and which confidence signal makes that possible. We evaluate seven confidence estimators across five open-weight LVLMs and three medical visual-question-answering datasets spanning broad clinical imaging, radiology, and pathology, with every probe trained only on natural images and applied without adaptation. Recast as bounded selective prediction (automate a case only when confidence clears a threshold, defer the rest), the comparison is cautionary. The standard metrics are poor guides: discrimination barely separates the methods, and the weak calibration of a cheap self-report is cheaply removed by off-domain temperature scaling without changing deployable yield. What distinguishes a usable estimator is the high-confidence region a clinician acts on: the weakest baselines are confidently wrong on 41 to 45 percent of their errors against 1 to 4 percent for the best probe, and no estimator is reliably best across domains or models. Safe handoff is governed at two levels: base-model competence sets a ceiling, so a well-calibrated score recovers roughly a third of radiology cases at a 20 percent error tolerance but almost none of pathology; the confidence layer then decides how much of that ceiling is reachable. The usable role today is calibrated triage, not autonomy: automate the cases a calibrated score marks safe, route the rest to a clinician. We release all outputs, correctness judgments, and confidence scores, with code.

Related papers

• EVADE: Evidence-Verified Agentic Diagnosis with Escape [0.880899367147235]
  EVADE is an inferential, non-training method that enhances the safety of deploying a single frozen VLM.<n>It commits only when both the entire image and the zoomed view responses agree.<n>It reduces expected calibration error (ECE) by up to 45% compared to zero-shot.
  arXiv  Detail & Related papers  (2026-08-19T11:51:24Z)
• Confidence Estimation for Financial Vision-Language Models in Chart and Document Understanding [8.289856517294075]
  We evaluate seven confidence estimators, three inference-only and four trained internal probes, across five open-weight LVLMs.<n>Every probe is trained only on natural images and applied to finance without adaptation, so the results measure out-of-distribution transfer.
  arXiv  Detail & Related papers  (2026-08-06T19:33:11Z)
• Confident but Unreliable: A Behavioral Safety Audit of Vision-Language Models on Brain MRI [1.2744523252873352]
  We use brain MRI as a controlled, high-stakes testbed for a broader failure mode in frontier multimodal systems.<n>We present an automatically graded behavioral audit and pilot study of six instruction-tuned vision-language models (VLMs) on 4,102 images.<n>Across models, answer coverage is near-complete, but verbalized-confidence calibration is poor.<n>Open-ended diagnostics show that hallucination and abstention vary separately from multiple-choice accuracy.
  arXiv  Detail & Related papers  (2026-08-03T18:42:04Z)
• Cybersecurity Detection Classification with Reasoning-enabled Language Models [50.72675435043546]
  A major issue in Security Operations Centers (SOCs) is alert fatigue.<n>Prior work prompts or fine-tunes large language models (LLMs) to emit a triage label directly, but does not train them to reason about whether a detection is a genuine threat.<n>We train a chain-of-thought (CoT) reasoning-enabled triage classifier on real, human-labeled Windows endpoint detections.
  arXiv  Detail & Related papers  (2026-07-30T16:22:13Z)
• Grounded or Guessing? LVLM Confidence Estimation via Blind-Image Contrastive Ranking [7.845652284569666]
  We introduce BICR (Blind-Image Contrastive Ranking), a model-agnostic confidence estimation framework.<n>A lightweight probe is trained on the real-image hidden state and regularized by a ranking loss that penalizes higher confidence on the blacked-out view.<n> evaluated across five modern LVLMs and seven baselines on a benchmark covering visual question answering, object detection, medical imaging, and financial document understanding.
  arXiv  Detail & Related papers  (2026-05-11T17:35:10Z)
• Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correction [72.89352076103889]
  Large language models (LLMs) achieve high accuracy in medical diagnosis when all clinical information is provided in a single turn.<n>We introduce MINT, a high-fidelity, multi-turn medical diagnosis benchmark comprising 1,035 cases.<n>We uncover three persistent behavioral patterns that significantly impact diagnostic decisions.
  arXiv  Detail & Related papers  (2026-04-06T00:23:10Z)
• When Can We Trust LLM Graders? Calibrating Confidence for Automated Assessment [1.896929753246251]
  Large Language Models (LLMs) show promise for automated grading, but their outputs can be unreliable.<n>This enables selective automation where high-confidence predictions are processed automatically while uncertain cases are flagged for human review.
  arXiv  Detail & Related papers  (2026-03-31T10:38:22Z)
• Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations [19.488236277427358]
  Vision-language models (VLMs) often produce chain-of-thought (CoT) explanations that sound plausible yet fail to reflect the underlying decision process.<n>We present a clinically grounded framework for chest X-ray visual question answering (VQA) that probes CoT faithfulness via controlled text and image modifications.
  arXiv  Detail & Related papers  (2025-10-13T09:28:22Z)
• EchoBench: Benchmarking Sycophancy in Medical Large Vision-Language Models [82.43729208063468]
  Recent benchmarks for medical Large Vision-Language Models (LVLMs) emphasize leaderboard accuracy, overlooking reliability and safety.<n>We study sycophancy -- models' tendency to uncritically echo user-provided information.<n>We introduce EchoBench, a benchmark to systematically evaluate sycophancy in medical LVLMs.
  arXiv  Detail & Related papers  (2025-09-24T14:09:55Z)
• ConfTuner: Training Large Language Models to Express Their Confidence Verbally [58.63318088243125]
  Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as science, law, and healthcare.<n>LLMs are often observed to generate incorrect answers with high confidence, a phenomenon known as "overconfidence"
  arXiv  Detail & Related papers  (2025-08-26T09:25:32Z)
• Revisiting Confidence Estimation: Towards Reliable Failure Prediction [53.79160907725975]
  We find a general, widely existing but actually-neglected phenomenon that most confidence estimation methods are harmful for detecting misclassification errors. We propose to enlarge the confidence gap by finding flat minima, which yields state-of-the-art failure prediction performance.
  arXiv  Detail & Related papers  (2024-03-05T11:44:14Z)
• Towards Reliable Medical Image Segmentation by Modeling Evidential Calibrated Uncertainty [57.023423137202485]
  Concerns regarding the reliability of medical image segmentation persist among clinicians.<n>We introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks.<n>By leveraging subjective logic theory, we explicitly model probability and uncertainty for medical image segmentation.
  arXiv  Detail & Related papers  (2023-01-01T05:02:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.