Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning

• URL: http://arxiv.org/abs/2407.02653v1
• Date: Tue, 2 Jul 2024 20:35:58 GMT
• Title: Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning
• Authors: Ruibo Shang, Geoffrey P. Luke, Matthew O'Donnell,
• Abstract summary: We propose a hybrid Bayesian convolutional neural network (Hybrid-BCNN) to jointly predict PA image and segmentation with error (uncertainty) predictions. The results show that accurate PA segmentations and images are obtained, and error predictions are highly statistically correlated to actual errors.
• Score: 1.119697400073873
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep learning has been used to improve photoacoustic (PA) image reconstruction. One major challenge is that errors cannot be quantified to validate predictions when ground truth is unknown. Validation is key to quantitative applications, especially using limited-bandwidth ultrasonic linear detector arrays. Here, we propose a hybrid Bayesian convolutional neural network (Hybrid-BCNN) to jointly predict PA image and segmentation with error (uncertainty) predictions. Each output pixel represents a probability distribution where error can be quantified. The Hybrid-BCNN was trained with simulated PA data and applied to both simulations and experiments. Due to the sparsity of PA images, segmentation focuses Hybrid-BCNN on minimizing the loss function in regions with PA signals for better predictions. The results show that accurate PA segmentations and images are obtained, and error predictions are highly statistically correlated to actual errors. To leverage error predictions, confidence processing created PA images above a specific confidence level.

Related papers

• Certified Adversarial Robustness via Partition-based Randomized Smoothing [9.054540533394926]
  We propose the Pixel Partitioning-based Randomized Smoothing (PPRS) methodology to boost the neural net's confidence score. We demonstrate that the proposed PPRS algorithm improves the visibility of the images under additive Gaussian noise.
  arXiv  Detail & Related papers  (2024-09-20T14:41:47Z)
• Predictive Accuracy-Based Active Learning for Medical Image Segmentation [5.25147264940975]
  We propose an efficient Predictive Accuracy-based Active Learning (PAAL) method for medical image segmentation. PAAL consists of an Accuracy Predictor (AP) and a Weighted Polling Strategy (WPS) Experiment results on multiple datasets demonstrate the superiority of PAAL.
  arXiv  Detail & Related papers  (2024-05-01T11:12:08Z)
• Uncertainty Quantification via Neural Posterior Principal Components [26.26693707762823]
  Uncertainty quantification is crucial for the deployment of image restoration models in safety-critical domains. We present a method for predicting the PCs of the posterior distribution for any input image, in a single forward pass of a neural network. Our method reliably conveys instance-adaptive uncertainty directions, achieving uncertainty quantification comparable with posterior samplers.
  arXiv  Detail & Related papers  (2023-09-27T09:51:29Z)
• Improving Adversarial Robustness of Masked Autoencoders via Test-time Frequency-domain Prompting [133.55037976429088]
  We investigate the adversarial robustness of vision transformers equipped with BERT pretraining (e.g., BEiT, MAE) A surprising observation is that MAE has significantly worse adversarial robustness than other BERT pretraining methods. We propose a simple yet effective way to boost the adversarial robustness of MAE.
  arXiv  Detail & Related papers  (2023-08-20T16:27:17Z)
• NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic Segmentation [87.50830107535533]
  Semi-supervised semantic segmentation involves assigning pixel-wise labels to unlabeled images at training time. Current approaches to semi-supervised semantic segmentation work by predicting pseudo-labels for each pixel from a class-wise probability distribution output by a model. In this work, we move one step forward by adapting NPs to semi-supervised semantic segmentation, resulting in a new model called NP-SemiSeg.
  arXiv  Detail & Related papers  (2023-08-05T12:42:15Z)
• Improved post-hoc probability calibration for out-of-domain MRI segmentation [18.089067656236125]
  Well-calibrated probabilities allow radiologists to identify regions where model-predicted segmentations are unreliable. These unreliable predictions often occur to out-of-domain (OOD) images that are caused by imaging artifacts or unseen imaging protocols. We propose a novel post-hoc calibration model to reduce the calibration error when confronted with OOD images.
  arXiv  Detail & Related papers  (2022-08-04T20:13:19Z)
• PDC-Net+: Enhanced Probabilistic Dense Correspondence Network [161.76275845530964]
  Enhanced Probabilistic Dense Correspondence Network, PDC-Net+, capable of estimating accurate dense correspondences. We develop an architecture and an enhanced training strategy tailored for robust and generalizable uncertainty prediction. Our approach obtains state-of-the-art results on multiple challenging geometric matching and optical flow datasets.
  arXiv  Detail & Related papers  (2021-09-28T17:56:41Z)
• Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation [0.0]
  Single-pixel imaging (SPI) has the advantages of high-speed acquisition over a broad wavelength range and system compactness. Deep learning (DL) is an emerging and powerful tool in computational imaging for many applications. We propose the use of the Bayesian convolutional neural network (BCNN) to approximate the uncertainty of DL predictions in SPI.
  arXiv  Detail & Related papers  (2021-07-24T20:01:38Z)
• Learning Accurate Dense Correspondences and When to Trust Them [161.76275845530964]
  We aim to estimate a dense flow field relating two images, coupled with a robust pixel-wise confidence map. We develop a flexible probabilistic approach that jointly learns the flow prediction and its uncertainty. Our approach obtains state-of-the-art results on challenging geometric matching and optical flow datasets.
  arXiv  Detail & Related papers  (2021-01-05T18:54:11Z)
• Collaborative Boundary-aware Context Encoding Networks for Error Map Prediction [65.44752447868626]
  We propose collaborative boundaryaware context encoding networks called AEP-Net for error prediction task. Specifically, we propose a collaborative feature transformation branch for better feature fusion between images and masks, and precise localization of error regions. The AEP-Net achieves an average DSC of 0.8358, 0.8164 for error prediction task, and shows a high Pearson correlation coefficient of 0.9873.
  arXiv  Detail & Related papers  (2020-06-25T12:42:01Z)
• RAIN: A Simple Approach for Robust and Accurate Image Classification Networks [156.09526491791772]
  It has been shown that the majority of existing adversarial defense methods achieve robustness at the cost of sacrificing prediction accuracy. This paper proposes a novel preprocessing framework, which we term Robust and Accurate Image classificatioN(RAIN) RAIN applies randomization over inputs to break the ties between the model forward prediction path and the backward gradient path, thus improving the model robustness. We conduct extensive experiments on the STL10 and ImageNet datasets to verify the effectiveness of RAIN against various types of adversarial attacks.
  arXiv  Detail & Related papers  (2020-04-24T02:03:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.