Improving Medical Image Classification with Label Noise Using
Dual-uncertainty Estimation
- URL: http://arxiv.org/abs/2103.00528v1
- Date: Sun, 28 Feb 2021 14:56:45 GMT
- Title: Improving Medical Image Classification with Label Noise Using
Dual-uncertainty Estimation
- Authors: Lie Ju, Xin Wang, Lin Wang, Dwarikanath Mahapatra, Xin Zhao, Mehrtash
Harandi, Tom Drummond, Tongliang Liu, Zongyuan Ge
- Abstract summary: We discuss and define the two common types of label noise in medical images.
We propose an uncertainty estimation-based framework to handle these two label noise amid the medical image classification task.
- Score: 72.0276067144762
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep neural networks are known to be data-driven and label noise can have a
marked impact on model performance. Recent studies have shown great robustness
to classic image recognition even under a high noisy rate. In medical
applications, learning from datasets with label noise is more challenging since
medical imaging datasets tend to have asymmetric (class-dependent) noise and
suffer from high observer variability.
In this paper, we systematically discuss and define the two common types of
label noise in medical images - disagreement label noise from inconsistency
expert opinions and single-target label noise from wrong diagnosis record. We
then propose an uncertainty estimation-based framework to handle these two
label noise amid the medical image classification task. We design a
dual-uncertainty estimation approach to measure the disagreement label noise
and single-target label noise via Direct Uncertainty Prediction and
Monte-Carlo-Dropout.
A boosting-based curriculum training procedure is later introduced for robust
learning. We demonstrate the effectiveness of our method by conducting
extensive experiments on three different diseases: skin lesions, prostate
cancer, and retinal diseases. We also release a large re-engineered database
that consists of annotations from more than ten ophthalmologists with an
unbiased golden standard dataset for evaluation and benchmarking.
Related papers
- Active Label Refinement for Robust Training of Imbalanced Medical Image Classification Tasks in the Presence of High Label Noise [10.232537737211098]
We propose a two-phase approach that combines Learning with Noisy Labels (LNL) and active learning.
We demonstrate that our proposed technique is superior to its predecessors at handling class imbalance by not misidentifying clean samples from minority classes as mostly noisy samples.
arXiv Detail & Related papers (2024-07-08T14:16:05Z) - Contrastive-Based Deep Embeddings for Label Noise-Resilient Histopathology Image Classification [0.0]
noisy labels represent a critical challenge in histopathology image classification.
Deep neural networks can easily overfit label noise, leading to severe degradations in model performance.
We exhibit the label noise resilience property of embeddings extracted from foundation models trained in a self-supervised contrastive manner.
arXiv Detail & Related papers (2024-04-11T09:47:52Z) - Investigating the Robustness of Vision Transformers against Label Noise
in Medical Image Classification [8.578500152567164]
Label noise in medical image classification datasets hampers the training of supervised deep learning methods.
We show that pretraining is crucial for ensuring ViT's improved robustness against label noise in supervised training.
arXiv Detail & Related papers (2024-02-26T16:53:23Z) - The role of noise in denoising models for anomaly detection in medical
images [62.0532151156057]
Pathological brain lesions exhibit diverse appearance in brain images.
Unsupervised anomaly detection approaches have been proposed using only normal data for training.
We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
arXiv Detail & Related papers (2023-01-19T21:39:38Z) - Robust Medical Image Classification from Noisy Labeled Data with Global
and Local Representation Guided Co-training [73.60883490436956]
We propose a novel collaborative training paradigm with global and local representation learning for robust medical image classification.
We employ the self-ensemble model with a noisy label filter to efficiently select the clean and noisy samples.
We also design a novel global and local representation learning scheme to implicitly regularize the networks to utilize noisy samples.
arXiv Detail & Related papers (2022-05-10T07:50:08Z) - Co-Correcting: Noise-tolerant Medical Image Classification via mutual
Label Correction [5.994566233473544]
This paper proposes a noise-tolerant medical image classification framework named Co-Correcting.
It significantly improves classification accuracy and obtains more accurate labels through dual-network mutual learning, label probability estimation, and curriculum label correcting.
Experiments show that Co-Correcting achieves the best accuracy and generalization under different noise ratios in various tasks.
arXiv Detail & Related papers (2021-09-11T02:09:52Z) - A Second-Order Approach to Learning with Instance-Dependent Label Noise [58.555527517928596]
The presence of label noise often misleads the training of deep neural networks.
We show that the errors in human-annotated labels are more likely to be dependent on the difficulty levels of tasks.
arXiv Detail & Related papers (2020-12-22T06:36:58Z) - Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis [102.40869566439514]
We seek to exploit rich labeled data from relevant domains to help the learning in the target task via Unsupervised Domain Adaptation (UDA)
Unlike most UDA methods that rely on clean labeled data or assume samples are equally transferable, we innovatively propose a Collaborative Unsupervised Domain Adaptation algorithm.
We theoretically analyze the generalization performance of the proposed method, and also empirically evaluate it on both medical and general images.
arXiv Detail & Related papers (2020-07-05T11:49:17Z) - Semi-supervised Medical Image Classification with Relation-driven
Self-ensembling Model [71.80319052891817]
We present a relation-driven semi-supervised framework for medical image classification.
It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations.
Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
arXiv Detail & Related papers (2020-05-15T06:57:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.