Deep Interpretable Classification and Weakly-Supervised Segmentation of
Histology Images via Max-Min Uncertainty
- URL: http://arxiv.org/abs/2011.07221v3
- Date: Sat, 9 Oct 2021 00:59:44 GMT
- Title: Deep Interpretable Classification and Weakly-Supervised Segmentation of
Histology Images via Max-Min Uncertainty
- Abstract summary: Weakly-supervised learning (WSL) has recently triggered substantial interest as it mitigates the lack of pixel-wise annotations.
We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions.
Our loss integrates: (i) a cross-entropy seeking a foreground, where model confidence about class prediction is high; (ii) a KL regularizer seeking a background, where model uncertainty is high; and (iii) log-barrier terms discouraging unbalanced segmentations.
- Score: 25.429124017422385
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Weakly-supervised learning (WSL) has recently triggered substantial interest
as it mitigates the lack of pixel-wise annotations. Given global image labels,
WSL methods yield pixel-level predictions (segmentations), which enable to
interpret class predictions. Despite their recent success, mostly with natural
images, such methods can face important challenges when the foreground and
background regions have similar visual cues, yielding high false-positive rates
in segmentations, as is the case in challenging histology images. WSL training
is commonly driven by standard classification losses, which implicitly maximize
model confidence, and locate the discriminative regions linked to
classification decisions. Therefore, they lack mechanisms for modeling
explicitly non-discriminative regions and reducing false-positive rates. We
propose novel regularization terms, which enable the model to seek both
non-discriminative and discriminative regions, while discouraging unbalanced
segmentations. We introduce high uncertainty as a criterion to localize
non-discriminative regions that do not affect classifier decision, and describe
it with original Kullback-Leibler (KL) divergence losses evaluating the
deviation of posterior predictions from the uniform distribution. Our KL terms
encourage high uncertainty of the model when the latter inputs the latent
non-discriminative regions. Our loss integrates: (i) a cross-entropy seeking a
foreground, where model confidence about class prediction is high; (ii) a KL
regularizer seeking a background, where model uncertainty is high; and (iii)
log-barrier terms discouraging unbalanced segmentations. Comprehensive
experiments and ablation studies over the public GlaS colon cancer data and a
Camelyon16 patch-based benchmark for breast cancer show substantial
improvements over state-of-the-art WSL methods, and confirm the effect of our
new regularizers.
Related papers
- Did Models Sufficient Learn? Attribution-Guided Training via Subset-Selected Counterfactual Augmentation [61.248535801314375]
Subset-Selected Counterfactual Augmentation (SS-CA)<n>We develop Counterfactual LIMA to identify minimal spatial region sets whose removal can selectively alter model predictions.<n>Experiments show that SS-CA improves generalization on in-distribution (ID) test data and achieves superior performance on out-of-distribution (OOD) benchmarks.
arXiv Detail & Related papers (2025-11-15T08:39:22Z) - When Confidence Fails: Revisiting Pseudo-Label Selection in Semi-supervised Semantic Segmentation [15.149171763610662]
We present Confidence Separable Learning (CSL) as a convex optimization problem within the confidence distribution feature space.<n>CSL formulates pseudo-label selection as a convex optimization problem within the confidence distribution feature space.<n>We show that CSL performs favorably against state-of-the-art methods.
arXiv Detail & Related papers (2025-09-20T14:23:09Z) - FARCLUSS: Fuzzy Adaptive Rebalancing and Contrastive Uncertainty Learning for Semi-Supervised Semantic Segmentation [26.585985828583304]
Semi-supervised semantic segmentation (SSSS) faces persistent challenges in effectively leveraging unlabeled data.<n>Current approaches often discard uncertain regions through strict thresholding favouring dominant classes.<n>We introduce a holistic framework that transforms uncertainty into a learning asset through four principal components.
arXiv Detail & Related papers (2025-06-11T03:47:08Z) - Bidirectional Uncertainty-Aware Region Learning for Semi-Supervised Medical Image Segmentation [1.6229760224067287]
In semi-supervised medical image segmentation, the poor quality of unlabeled data and the uncertainty in the model's predictions lead to erroneous pseudo-labels.
We found that these erroneous pseudo-labels are typically concentrated in high-uncertainty regions.
To alleviate this problem, we propose a bidirectional uncertainty-aware region learning strategy.
arXiv Detail & Related papers (2025-02-11T11:03:09Z) - Tendency-driven Mutual Exclusivity for Weakly Supervised Incremental Semantic Segmentation [56.1776710527814]
Weakly Incremental Learning for Semantic (WILSS) leverages a pre-trained segmentation model to segment new classes using cost-effective and readily available image-level labels.
A prevailing way to solve WILSS is the generation of seed areas for each new class, serving as a form of pixel-level supervision.
We propose an innovative, tendency-driven relationship of mutual exclusivity, meticulously tailored to govern the behavior of the seed areas.
arXiv Detail & Related papers (2024-04-18T08:23:24Z) - Do not trust what you trust: Miscalibration in Semi-supervised Learning [21.20806568508201]
State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples.
We show that SSL methods based on pseudo-labels are significantly miscalibrated, and formally demonstrate the minimization of the min-entropy.
We integrate a simple penalty term, which enforces the logit of the predictions on unlabeled samples to remain low, preventing the network predictions to become overconfident.
arXiv Detail & Related papers (2024-03-22T18:43:46Z) - Progressive Feature Self-reinforcement for Weakly Supervised Semantic
Segmentation [55.69128107473125]
We propose a single-stage approach for Weakly Supervised Semantic (WSSS) with image-level labels.
We adaptively partition the image content into deterministic regions (e.g., confident foreground and background) and uncertain regions (e.g., object boundaries and misclassified categories) for separate processing.
Building upon this, we introduce a complementary self-enhancement method that constrains the semantic consistency between these confident regions and an augmented image with the same class labels.
arXiv Detail & Related papers (2023-12-14T13:21:52Z) - Uncertainty-guided Boundary Learning for Imbalanced Social Event
Detection [64.4350027428928]
We propose a novel uncertainty-guided class imbalance learning framework for imbalanced social event detection tasks.
Our model significantly improves social event representation and classification tasks in almost all classes, especially those uncertain ones.
arXiv Detail & Related papers (2023-10-30T03:32:04Z) - Towards Better Certified Segmentation via Diffusion Models [62.21617614504225]
segmentation models can be vulnerable to adversarial perturbations, which hinders their use in critical-decision systems like healthcare or autonomous driving.
Recently, randomized smoothing has been proposed to certify segmentation predictions by adding Gaussian noise to the input to obtain theoretical guarantees.
In this paper, we address the problem of certifying segmentation prediction using a combination of randomized smoothing and diffusion models.
arXiv Detail & Related papers (2023-06-16T16:30:39Z) - Benchmarking common uncertainty estimation methods with
histopathological images under domain shift and label noise [62.997667081978825]
In high-risk environments, deep learning models need to be able to judge their uncertainty and reject inputs when there is a significant chance of misclassification.
We conduct a rigorous evaluation of the most commonly used uncertainty and robustness methods for the classification of Whole Slide Images.
We observe that ensembles of methods generally lead to better uncertainty estimates as well as an increased robustness towards domain shifts and label noise.
arXiv Detail & Related papers (2023-01-03T11:34:36Z) - Poisson Reweighted Laplacian Uncertainty Sampling for Graph-based Active
Learning [1.6752182911522522]
We show that uncertainty sampling is sufficient to achieve exploration versus exploitation in graph-based active learning.
In particular, we use a recently developed algorithm, Poisson ReWeighted Laplace Learning (PWLL) for the classifier.
We present experimental results on a number of graph-based image classification problems.
arXiv Detail & Related papers (2022-10-27T22:07:53Z) - Leveraging Uncertainty for Deep Interpretable Classification and
Weakly-Supervised Segmentation of Histology Images [25.429124017422385]
Deep weakly supervised methods allow image classification and ROI segmentation for interpretability.
These methods lack mechanisms for modeling explicitly non-discriminative regions which raises false-positive rates.
We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions.
arXiv Detail & Related papers (2022-05-12T02:18:23Z) - Unsupervised Embedding Learning from Uncertainty Momentum Modeling [37.674449317054716]
We propose a novel solution to explicitly model and explore the uncertainty of the given unlabeled learning samples.
We leverage such uncertainty modeling momentum to the learning which is helpful to tackle the outliers.
arXiv Detail & Related papers (2021-07-19T14:06:19Z) - Entropy-Based Uncertainty Calibration for Generalized Zero-Shot Learning [49.04790688256481]
The goal of generalized zero-shot learning (GZSL) is to recognise both seen and unseen classes.
Most GZSL methods typically learn to synthesise visual representations from semantic information on the unseen classes.
We propose a novel framework that leverages dual variational autoencoders with a triplet loss to learn discriminative latent features.
arXiv Detail & Related papers (2021-01-09T05:21:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.