Conformal confidence sets for biomedical image segmentation

• URL: http://arxiv.org/abs/2410.03406v2
• Date: Tue, 8 Oct 2024 09:26:09 GMT
• Title: Conformal confidence sets for biomedical image segmentation
• Authors: Samuel Davenport,
• Abstract summary: We develop confidence sets which provide spatial uncertainty guarantees for the output of a black-box machine learning model. We prove that these confidence sets, when applied to new predictions of the model, are guaranteed to contain the true unknown segmented mask with desired probability.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop confidence sets which provide spatial uncertainty guarantees for the output of a black-box machine learning model designed for image segmentation. To do so we adapt conformal inference to the imaging setting, obtaining thresholds on a calibration dataset based on the distribution of the maximum of the transformed logit scores within and outside of the ground truth masks. We prove that these confidence sets, when applied to new predictions of the model, are guaranteed to contain the true unknown segmented mask with desired probability. We show that learning appropriate score transformations on a learning dataset before performing calibration is crucial for optimizing performance. We illustrate and validate our approach on a polpys tumor dataset. To do so we obtain the logit scores from a deep neural network trained for polpys segmentation and show that using distance transformed scores to obtain outer confidence sets and the original scores for inner confidence sets enables tight bounds on tumor location whilst controlling the false coverage rate.

Related papers

• Controlling False Positives in Image Segmentation via Conformal Prediction [2.339515934428971]
  We introduce a simple framework that constructs confidence masks with distribution-free, image-level control of false-positive predictions.<n>Our framework enables practical, risk-aware segmentation in settings where over-segmentation can have clinical consequences.
  arXiv  Detail & Related papers  (2025-11-19T13:02:50Z)
• Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation [0.01066386648660129]
  We evaluate the use of a modified Residual U-Net for breast ultrasound segmentation.<n>We identify and correct for data duplication in the BUSI dataset.<n>Epistemic uncertainty is quantified using Monte Carlo dropout, deep ensembles, and their combination.
  arXiv  Detail & Related papers  (2025-08-25T08:06:07Z)
• Conformal Prediction for Image Segmentation Using Morphological Prediction Sets [0.7673339435080445]
  In this paper we focus on binary segmentation and address these challenges using conformal prediction. Our approach involves computing nonconformity scores, a type of prediction residual, on held-out calibration data not used during training. We evaluate our approach on several medical imaging applications.
  arXiv  Detail & Related papers  (2025-03-07T17:42:30Z)
• Soft Dice Confidence: A Near-Optimal Confidence Estimator for Selective Prediction in Semantic Segmentation [1.2903829793534267]
  This paper tackles the problem by focusing on image-level abstention, which involves producing a single confidence estimate for the entire image.<n>We derive the optimal confidence estimator, which is observed to be intractable for typical image sizes.<n>Then, an approximation computable in linear time, named Soft Dice Confidence (SDC), is proposed and proven to be tightly bounded to the optimal estimator.
  arXiv  Detail & Related papers  (2024-02-16T13:14:12Z)
• Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting [133.55037976429088]
  We investigate the adversarial robustness of vision transformers equipped with BERT pretraining (e.g., BEiT, MAE) A surprising observation is that MAE has significantly worse adversarial robustness than other BERT pretraining methods. We propose a simple yet effective way to boost the adversarial robustness of MAE.
  arXiv  Detail & Related papers  (2023-08-20T16:27:17Z)
• Towards Better Certified Segmentation via Diffusion Models [62.21617614504225]
  segmentation models can be vulnerable to adversarial perturbations, which hinders their use in critical-decision systems like healthcare or autonomous driving. Recently, randomized smoothing has been proposed to certify segmentation predictions by adding Gaussian noise to the input to obtain theoretical guarantees. In this paper, we address the problem of certifying segmentation prediction using a combination of randomized smoothing and diffusion models.
  arXiv  Detail & Related papers  (2023-06-16T16:30:39Z)
• ConfMix: Unsupervised Domain Adaptation for Object Detection via Confidence-based Mixing [32.679280923208715]
  Unsupervised Domain Adaptation (UDA) for object detection aims to adapt a model trained on a source domain to detect instances from a new target domain for which annotations are not available. We propose ConfMix, the first method that introduces a sample mixing strategy based on region-level detection confidence for adaptive object detector learning.
  arXiv  Detail & Related papers  (2022-10-20T19:16:39Z)
• DOMINO: Domain-aware Model Calibration in Medical Image Segmentation [51.346121016559024]
  Modern deep neural networks are poorly calibrated, compromising trustworthiness and reliability. We propose DOMINO, a domain-aware model calibration method that leverages the semantic confusability and hierarchical similarity between class labels. Our results show that DOMINO-calibrated deep neural networks outperform non-calibrated models and state-of-the-art morphometric methods in head image segmentation.
  arXiv  Detail & Related papers  (2022-09-13T15:31:52Z)
• TBraTS: Trusted Brain Tumor Segmentation [32.51443933646828]
  We propose a trusted brain tumor segmentation network which can generate robust segmentation results and reliable uncertainty estimations. In our method, uncertainty is modeled explicitly using subjective logic theory. Our unified trusted segmentation framework endows the model with reliability and robustness to out-of-distribution samples.
  arXiv  Detail & Related papers  (2022-06-19T02:26:30Z)
• Towards Semi-Supervised Deep Facial Expression Recognition with An Adaptive Confidence Margin [92.76372026435858]
  We learn an Adaptive Confidence Margin (Ada-CM) to fully leverage all unlabeled data for semi-supervised deep facial expression recognition. All unlabeled samples are partitioned into two subsets by comparing their confidence scores with the adaptively learned confidence margin. Our method achieves state-of-the-art performance, especially surpassing fully-supervised baselines in a semi-supervised manner.
  arXiv  Detail & Related papers  (2022-03-23T11:43:29Z)
• Trustworthy Medical Segmentation with Uncertainty Estimation [0.7829352305480285]
  This paper introduces a new Bayesian deep learning framework for uncertainty quantification in segmentation neural networks. We evaluate the proposed framework on medical image segmentation data from Magnetic Resonances Imaging and Computed Tomography scans. Our experiments on multiple benchmark datasets demonstrate that the proposed framework is more robust to noise and adversarial attacks as compared to state-of-the-art segmentation models.
  arXiv  Detail & Related papers  (2021-11-10T22:46:05Z)
• Privacy Preserving Recalibration under Domain Shift [119.21243107946555]
  We introduce a framework that abstracts out the properties of recalibration problems under differential privacy constraints. We also design a novel recalibration algorithm, accuracy temperature scaling, that outperforms prior work on private datasets.
  arXiv  Detail & Related papers  (2020-08-21T18:43:37Z)
• Unlabelled Data Improves Bayesian Uncertainty Calibration under Covariate Shift [100.52588638477862]
  We develop an approximate Bayesian inference scheme based on posterior regularisation. We demonstrate the utility of our method in the context of transferring prognostic models of prostate cancer across globally diverse populations.
  arXiv  Detail & Related papers  (2020-06-26T13:50:19Z)
• Calibrated neighborhood aware confidence measure for deep metric learning [0.0]
  Deep metric learning has been successfully applied to problems in few-shot learning, image retrieval, and open-set classifications. measuring the confidence of a deep metric learning model and identifying unreliable predictions is still an open challenge. This paper focuses on defining a calibrated and interpretable confidence metric that closely reflects its classification accuracy.
  arXiv  Detail & Related papers  (2020-06-08T21:05:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.