Can ultrasound confidence maps predict sonographers' labeling
variability?
- URL: http://arxiv.org/abs/2308.09433v1
- Date: Fri, 18 Aug 2023 10:07:17 GMT
- Title: Can ultrasound confidence maps predict sonographers' labeling
variability?
- Authors: Vanessa Gonzalez Duque, Leonhard Zirus, Yordanka Velikova, Nassir
Navab, and Diana Mateus
- Abstract summary: This work proposes a novel approach that guides ultrasound segmentation networks to account for sonographers' uncertainties.
We show that there is a correlation between low values in the confidence maps and expert's label uncertainty.
Our results show ultrasound CMs increase the Dice score, improve the Hausdorff and Average Surface Distances, and decrease the number of isolated pixel predictions.
- Score: 38.75943978900532
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Measuring cross-sectional areas in ultrasound images is a standard tool to
evaluate disease progress or treatment response. Often addressed today with
supervised deep-learning segmentation approaches, existing solutions highly
depend upon the quality of experts' annotations. However, the annotation
quality in ultrasound is anisotropic and position-variant due to the inherent
physical imaging principles, including attenuation, shadows, and missing
boundaries, commonly exacerbated with depth. This work proposes a novel
approach that guides ultrasound segmentation networks to account for
sonographers' uncertainties and generate predictions with variability similar
to the experts. We claim that realistic variability can reduce overconfident
predictions and improve physicians' acceptance of deep-learning cross-sectional
segmentation solutions. Our method provides CM's certainty for each pixel for
minimal computational overhead as it can be precalculated directly from the
image. We show that there is a correlation between low values in the confidence
maps and expert's label uncertainty. Therefore, we propose to give the
confidence maps as additional information to the networks. We study the effect
of the proposed use of ultrasound CMs in combination with four state-of-the-art
neural networks and in two configurations: as a second input channel and as
part of the loss. We evaluate our method on 3D ultrasound datasets of the
thyroid and lower limb muscles. Our results show ultrasound CMs increase the
Dice score, improve the Hausdorff and Average Surface Distances, and decrease
the number of isolated pixel predictions. Furthermore, our findings suggest
that ultrasound CMs improve the penalization of uncertain areas in the ground
truth data, thereby improving problematic interpolations. Our code and example
data will be made public at
https://github.com/IFL-CAMP/Confidence-segmentation.
Related papers
- UltraAD: Fine-Grained Ultrasound Anomaly Classification via Few-Shot CLIP Adaptation [39.48115172323913]
We propose UltraAD, a vision-language model (VLM)-based approach for anomaly localization and fine-grained classification.<n>UltraAD has been extensively evaluated on three breast US datasets, outperforming state-of-the-art methods in both lesion datasets and fine-grained medical classification.
arXiv Detail & Related papers (2025-06-24T15:00:38Z) - Intuitive Axial Augmentation Using Polar-Sine-Based Piecewise Distortion for Medical Slice-Wise Segmentation [4.471795611968146]
We revisit and acknowledge the unique characteristics of medical images apart from traditional digital images.
We propose a medical-specific augmentation algorithm that is more elastic and aligns well with radiology scan procedure.
Our method is highlighted for its intuitive design and ease of understanding for medical professionals.
arXiv Detail & Related papers (2024-12-04T14:35:06Z) - MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation [15.766686386490234]
Weakly supervised learning (WSL) based on sparse annotation has achieved encouraging performance.
This study attempts to introduce scribble-based WSL into ultrasound image segmentation tasks.
We propose leveraging predictions near decision boundaries effectively.
arXiv Detail & Related papers (2024-09-28T14:50:45Z) - WATUNet: A Deep Neural Network for Segmentation of Volumetric Sweep
Imaging Ultrasound [1.2903292694072621]
Volume sweep imaging (VSI) is an innovative approach that enables untrained operators to capture quality ultrasound images.
We present a novel segmentation model known as Wavelet_Attention_UNet (WATUNet)
In this model, we incorporate wavelet gates (WGs) and attention gates (AGs) between the encoder and decoder instead of a simple connection to overcome the limitations mentioned.
arXiv Detail & Related papers (2023-11-17T20:32:37Z) - Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network.
We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module.
Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
arXiv Detail & Related papers (2022-12-01T07:32:56Z) - PCA: Semi-supervised Segmentation with Patch Confidence Adversarial
Training [52.895952593202054]
We propose a new semi-supervised adversarial method called Patch Confidence Adrial Training (PCA) for medical image segmentation.
PCA learns the pixel structure and context information in each patch to get enough gradient feedback, which aids the discriminator in convergent to an optimal state.
Our method outperforms the state-of-the-art semi-supervised methods, which demonstrates its effectiveness for medical image segmentation.
arXiv Detail & Related papers (2022-07-24T07:45:47Z) - Trustworthy Medical Segmentation with Uncertainty Estimation [0.7829352305480285]
This paper introduces a new Bayesian deep learning framework for uncertainty quantification in segmentation neural networks.
We evaluate the proposed framework on medical image segmentation data from Magnetic Resonances Imaging and Computed Tomography scans.
Our experiments on multiple benchmark datasets demonstrate that the proposed framework is more robust to noise and adversarial attacks as compared to state-of-the-art segmentation models.
arXiv Detail & Related papers (2021-11-10T22:46:05Z) - Segmentation-Renormalized Deep Feature Modulation for Unpaired Image
Harmonization [0.43012765978447565]
Cycle-consistent Generative Adversarial Networks have been used to harmonize image sets between a source and target domain.
These methods are prone to instability, contrast inversion, intractable manipulation of pathology, and steganographic mappings which limit their reliable adoption in real-world medical imaging.
We propose a segmentation-renormalized image translation framework to reduce inter-scanner harmonization while preserving anatomical layout.
arXiv Detail & Related papers (2021-02-11T23:53:51Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z) - Weakly-supervised Learning For Catheter Segmentation in 3D Frustum
Ultrasound [74.22397862400177]
We propose a novel Frustum ultrasound based catheter segmentation method.
The proposed method achieved the state-of-the-art performance with an efficiency of 0.25 second per volume.
arXiv Detail & Related papers (2020-10-19T13:56:22Z) - Uncertainty Quantification using Variational Inference for Biomedical Image Segmentation [0.0]
We use an encoder decoder architecture based on variational inference techniques for segmenting brain tumour images.
We evaluate our work on the publicly available BRATS dataset using Dice Similarity Coefficient (DSC) and Intersection Over Union (IOU) as the evaluation metrics.
arXiv Detail & Related papers (2020-08-12T20:08:04Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.