Detecting and refurbishing ground truth errors during training of deep learning-based echocardiography segmentation models
- URL: http://arxiv.org/abs/2604.12832v1
- Date: Tue, 14 Apr 2026 14:52:00 GMT
- Title: Detecting and refurbishing ground truth errors during training of deep learning-based echocardiography segmentation models
- Abstract summary: Ground truth (GT) labels can be prone to random errors or systematic biases.<n>This study examines the robustness of deep learning models to such errors in echocardiography (echo) segmentation.<n>We propose a pseudo-labelling approach to refurbish suspected erroneous GT labels.
- Score: 1.57738603097505
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep learning-based medical image segmentation typically relies on ground truth (GT) labels obtained through manual annotation, but these can be prone to random errors or systematic biases. This study examines the robustness of deep learning models to such errors in echocardiography (echo) segmentation and evaluates a novel strategy for detecting and refurbishing erroneous labels during model training. Using the CAMUS dataset, we simulate three error types, then compare a loss-based GT label error detection method with one based on Variance of Gradients (VOG). We also propose a pseudo-labelling approach to refurbish suspected erroneous GT labels. We assess the performance of our proposed approach under varying error levels. Results show that VOG proved highly effective in flagging erroneous GT labels during training. However, a standard U-Net maintained strong performance under random label errors and moderate levels of systematic errors (up to 50%). The detection and refurbishment approach improved performance, particularly under high-error conditions.
Related papers
- A Novel Method to Evaluate Models on Unreliable, Noisy and Inconsistent Labels: Adaptive Resolution Label Aggregation (ARLA) [0.0]
"Adaptive Resolution Label Aggregation", or "ARLA", adapts the resolution of both the label and the model prediction at inference time.<n>We demonstrate how ARLA can be used to better analyse model behaviour with a practical application to a real flood prediction model.
arXiv Detail & Related papers (2026-07-13T08:07:45Z) - Adaptive Label Error Detection: A Bayesian Approach to Mislabeled Data Detection [0.5284217353503208]
We motivate and describe Adaptive Label Error Detection (ALED), a novel method of detecting mislabeling.<n>ALED has markedly increased sensitivity, without compromising precision, compared to established label error detection methods.<n>We demonstrate an example where fine-tuning a neural network on corrected data results in a 33.8% decrease in test set errors.
arXiv Detail & Related papers (2026-01-15T05:20:00Z) - Hard Samples, Bad Labels: Robust Loss Functions That Know When to Back Off [1.1582652820340928]
Incorrectly labelled training data adversely affects the performance and generalizability of models trained through supervised learning.<n>We evaluate two novel loss functions, Blurry Loss and Piecewise-zero Loss, that enhance robustness to label errors by de-weighting or disregarding difficult-to-classify samples.
arXiv Detail & Related papers (2025-11-20T16:30:55Z) - Correcting False Alarms from Unseen: Adapting Graph Anomaly Detectors at Test Time [60.341117019125214]
We propose a lightweight and plug-and-play Test-time adaptation framework for correcting Unseen Normal pattErns in graph anomaly detection (GAD)<n>To address semantic confusion, a graph aligner is employed to align the shifted data to the original one at the graph attribute level.<n>Extensive experiments on 10 real-world datasets demonstrate that TUNE significantly enhances the generalizability of pre-trained GAD models to both synthetic and real unseen normal patterns.
arXiv Detail & Related papers (2025-11-10T12:10:05Z) - Unsupervised Learning for Industrial Defect Detection: A Case Study on Shearographic Data [0.0]
This study explores unsupervised learning methods for automated anomaly detection in shearographic images.<n>Three architectures are evaluated: a fully connected autoencoder, a convolutional autoencoder, and a student-teacher model.<n>Results show that the student-teacher approach achieves superior classification and enables precise localization.
arXiv Detail & Related papers (2025-11-04T12:48:02Z) - Estimating label quality and errors in semantic segmentation data via
any model [19.84626033109009]
We study methods to score label quality, such that the images with the lowest scores are least likely to be correctly labeled.
This helps prioritize what data to review in order to ensure a high-quality training/evaluation dataset.
arXiv Detail & Related papers (2023-07-11T07:29:09Z) - All Points Matter: Entropy-Regularized Distribution Alignment for
Weakly-supervised 3D Segmentation [67.30502812804271]
Pseudo-labels are widely employed in weakly supervised 3D segmentation tasks where only sparse ground-truth labels are available for learning.
We propose a novel learning strategy to regularize the generated pseudo-labels and effectively narrow the gaps between pseudo-labels and model predictions.
arXiv Detail & Related papers (2023-05-25T08:19:31Z) - Boosting Differentiable Causal Discovery via Adaptive Sample Reweighting [62.23057729112182]
Differentiable score-based causal discovery methods learn a directed acyclic graph from observational data.
We propose a model-agnostic framework to boost causal discovery performance by dynamically learning the adaptive weights for the Reweighted Score function, ReScore.
arXiv Detail & Related papers (2023-03-06T14:49:59Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - Understanding Classifier Mistakes with Generative Models [88.20470690631372]
Deep neural networks are effective on supervised learning tasks, but have been shown to be brittle.
In this paper, we leverage generative models to identify and characterize instances where classifiers fail to generalize.
Our approach is agnostic to class labels from the training set which makes it applicable to models trained in a semi-supervised way.
arXiv Detail & Related papers (2020-10-05T22:13:21Z) - Deep Learning for Earth Image Segmentation based on Imperfect Polyline
Labels with Annotation Errors [12.547819302858045]
This paper proposes a generic learning framework based on the EM algorithm to update deep learning model parameters and infer hidden true label locations simultaneously.
Evaluations on a real-world hydrological dataset in the streamline refinement application show that the proposed framework outperforms baseline methods in classification accuracy.
arXiv Detail & Related papers (2020-10-02T02:54:06Z) - Salvage Reusable Samples from Noisy Data for Robust Learning [70.48919625304]
We propose a reusable sample selection and correction approach, termed as CRSSC, for coping with label noise in training deep FG models with web images.
Our key idea is to additionally identify and correct reusable samples, and then leverage them together with clean examples to update the networks.
arXiv Detail & Related papers (2020-08-06T02:07:21Z) - DMT: Dynamic Mutual Training for Semi-Supervised Learning [69.17919491907296]
Self-training methods usually rely on single model prediction confidence to filter low-confidence pseudo labels.
We propose mutual training between two different models by a dynamically re-weighted loss function, called Dynamic Mutual Training.
Our experiments show that DMT achieves state-of-the-art performance in both image classification and semantic segmentation.
arXiv Detail & Related papers (2020-04-18T03:12:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.