Propagation and Attribution of Uncertainty in Medical Imaging Pipelines

• URL: http://arxiv.org/abs/2309.16831v1
• Date: Thu, 28 Sep 2023 20:23:25 GMT
• Title: Propagation and Attribution of Uncertainty in Medical Imaging Pipelines
• Authors: Leonhard F. Feiner, Martin J. Menten, Kerstin Hammernik, Paul Hager, Wenqi Huang, Daniel Rueckert, Rickmer F. Braren, and Georgios Kaissis
• Abstract summary: Uncertainty estimation provides a means of building explainable neural networks for medical imaging applications. We propose a method to propagate uncertainty through cascades of deep learning models in medical imaging pipelines.
• Score: 11.65442828043714
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Uncertainty estimation, which provides a means of building explainable neural networks for medical imaging applications, have mostly been studied for single deep learning models that focus on a specific task. In this paper, we propose a method to propagate uncertainty through cascades of deep learning models in medical imaging pipelines. This allows us to aggregate the uncertainty in later stages of the pipeline and to obtain a joint uncertainty measure for the predictions of later models. Additionally, we can separately report contributions of the aleatoric, data-based, uncertainty of every component in the pipeline. We demonstrate the utility of our method on a realistic imaging pipeline that reconstructs undersampled brain and knee magnetic resonance (MR) images and subsequently predicts quantitative information from the images, such as the brain volume, or knee side or patient's sex. We quantitatively show that the propagated uncertainty is correlated with input uncertainty and compare the proportions of contributions of pipeline stages to the joint uncertainty measure.

Related papers

• Hierarchical uncertainty estimation for learning-based registration in neuroimaging [10.964653898591413]
  We propose a principled way to propagate uncertainties (epistemic or aleatoric) estimated at the level of spatial location. Experiments show that uncertainty-aware fitting of transformations improves the registration accuracy of brain MRI scans.
  arXiv  Detail & Related papers  (2024-10-11T23:12:16Z)
• Disentangled Uncertainty and Out of Distribution Detection in Medical Generative Models [7.6146285961466]
  We study disentangled uncertainties in image to image translation tasks in the medical domain. We use CycleGAN to convert T1-weighted brain MRI scans to T2-weighted brain MRI scans.
  arXiv  Detail & Related papers  (2022-11-11T14:45:16Z)
• NUQ: Nonparametric Uncertainty Quantification for Deterministic Neural Networks [151.03112356092575]
  We show the principled way to measure the uncertainty of predictions for a classifier based on Nadaraya-Watson's nonparametric estimate of the conditional label distribution. We demonstrate the strong performance of the method in uncertainty estimation tasks on a variety of real-world image datasets.
  arXiv  Detail & Related papers  (2022-02-07T12:30:45Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction [63.202627467245584]
  We introduce a Bayesian variational framework to quantify the model-immanent (epistemic) uncertainty. We demonstrate that our approach yields competitive results for undersampled MRI reconstruction.
  arXiv  Detail & Related papers  (2021-02-12T18:08:14Z)
• Learning Accurate Dense Correspondences and When to Trust Them [161.76275845530964]
  We aim to estimate a dense flow field relating two images, coupled with a robust pixel-wise confidence map. We develop a flexible probabilistic approach that jointly learns the flow prediction and its uncertainty. Our approach obtains state-of-the-art results on challenging geometric matching and optical flow datasets.
  arXiv  Detail & Related papers  (2021-01-05T18:54:11Z)
• The Hidden Uncertainty in a Neural Networks Activations [105.4223982696279]
  The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution correlates with a model's epistemic uncertainty, thus indicating its ability to generalise to novel inputs.
  arXiv  Detail & Related papers  (2020-12-05T17:30:35Z)
• Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Prior [2.0303656145222857]
  Uncertainty in inverse medical imaging tasks with deep learning has received little attention. Deep models trained on large data sets tend to hallucinate and create artifacts in the reconstructed output that are not present. We use a randomly convolutional network as parameterization of the reconstructed image and perform gradient descent to match the observation, which is known as deep image prior.
  arXiv  Detail & Related papers  (2020-08-20T08:34:51Z)
• Integrating uncertainty in deep neural networks for MRI based stroke analysis [0.0]
  We present a Bayesian Convolutional Neural Network (CNN) yielding a probability for a stroke lesion on 2D Magnetic Resonance (MR) images. In a cohort of 511 patients, our CNN achieved an accuracy of 95.33% at the image-level representing a significant improvement of 2% over a non-Bayesian counterpart.
  arXiv  Detail & Related papers  (2020-08-13T09:50:17Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Quantifying and Leveraging Predictive Uncertainty for Medical Image Assessment [13.330243305948278]
  We propose a system that learns not only the probabilistic estimate for classification, but also an explicit uncertainty measure. We argue that this approach is essential to account for the inherent ambiguity characteristic of medical images from different radiologic exams. In our experiments we demonstrate that sample rejection based on the predicted uncertainty can significantly improve the ROC-AUC for various tasks.
  arXiv  Detail & Related papers  (2020-07-08T16:47:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.