Adaptive Domain Generalization for Digital Pathology Images
- URL: http://arxiv.org/abs/2305.05100v1
- Date: Tue, 9 May 2023 00:11:00 GMT
- Title: Adaptive Domain Generalization for Digital Pathology Images
- Authors: Andrew Walker
- Abstract summary: In AI-based histopathology, domain shifts are common and well-studied.
We introduce techniques that react to domain shifts rather than requiring a prediction of them in advance.
We investigate test time training, a technique for domain generalization that adapts model parameters at test-time.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In AI-based histopathology, domain shifts are common and well-studied.
However, this research focuses on stain and scanner variations, which do not
show the full picture -- shifts may be combinations of other shifts, or
"invisible" shifts that are not obvious but still damage performance of machine
learning models. Furthermore, it is important for models to generalize to these
shifts without expensive or scarce annotations, especially in the
histopathology space and if wanting to deploy models on a larger scale. Thus,
there is a need for "reactive" domain generalization techniques: ones that
adapt to domain shifts at test-time rather than requiring predictions of or
examples of the shifts at training time. We conduct a literature review and
introduce techniques that react to domain shifts rather than requiring a
prediction of them in advance. We investigate test time training, a technique
for domain generalization that adapts model parameters at test-time through
optimization of a secondary self-supervised task.
Related papers
- Neural Network Reprogrammability: A Unified Theme on Model Reprogramming, Prompt Tuning, and Prompt Instruction [55.914891182214475]
We introduce neural network reprogrammability as a unifying framework for model adaptation.<n>We present a taxonomy that categorizes such information manipulation approaches across four key dimensions.<n>We also analyze remaining technical challenges and ethical considerations.
arXiv Detail & Related papers (2025-06-05T05:42:27Z) - HyDA: Hypernetworks for Test Time Domain Adaptation in Medical Imaging Analysis [4.450536872346658]
We introduce HyDA, a novel hypernetwork framework that leverages domain characteristics rather than suppressing them.
Specifically, HyDA learns implicit domain representations and uses them to adjust model parameters on-the-fly.
We validate HyDA on two clinically relevant applications - MRI brain age prediction and chest X-ray pathology classification.
arXiv Detail & Related papers (2025-03-06T21:17:40Z) - Generalize or Detect? Towards Robust Semantic Segmentation Under Multiple Distribution Shifts [56.57141696245328]
In open-world scenarios, where both novel classes and domains may exist, an ideal segmentation model should detect anomaly classes for safety.
Existing methods often struggle to distinguish between domain-level and semantic-level distribution shifts.
arXiv Detail & Related papers (2024-11-06T11:03:02Z) - Disentangling Masked Autoencoders for Unsupervised Domain Generalization [57.56744870106124]
Unsupervised domain generalization is fast gaining attention but is still far from well-studied.
Disentangled Masked Auto (DisMAE) aims to discover the disentangled representations that faithfully reveal intrinsic features.
DisMAE co-trains the asymmetric dual-branch architecture with semantic and lightweight variation encoders.
arXiv Detail & Related papers (2024-07-10T11:11:36Z) - A Systematic Review of Generalization Research in Medical Image Classification [36.29204574056283]
This paper aims to explore existing domain generalization methods for Deep Learning (DL)-based classification models.
It proposes a taxonomy based on the shift type they aim to solve.
The results of this paper show that learning based methods are emerging, for both shift types.
arXiv Detail & Related papers (2024-03-18T18:35:32Z) - Domain adaptation using optimal transport for invariant learning using
histopathology datasets [13.133231212085988]
Histopathology is critical for the diagnosis of many diseases, including cancer.
computational techniques are limited by batch effects, where technical factors like differences in preparation protocol or scanners can alter the appearance of slides.
Here, we propose a domain adaptation method that improves the generalization of histological models to data from unseen institutions.
arXiv Detail & Related papers (2023-03-03T22:19:19Z) - Single-domain Generalization in Medical Image Segmentation via Test-time
Adaptation from Shape Dictionary [64.5632303184502]
Domain generalization typically requires data from multiple source domains for model learning.
This paper studies the important yet challenging single domain generalization problem, in which a model is learned under the worst-case scenario with only one source domain to directly generalize to different unseen target domains.
We present a novel approach to address this problem in medical image segmentation, which extracts and integrates the semantic shape prior information of segmentation that are invariant across domains.
arXiv Detail & Related papers (2022-06-29T08:46:27Z) - Improving Diversity with Adversarially Learned Transformations for
Domain Generalization [81.26960899663601]
We present a novel framework that uses adversarially learned transformations (ALT) using a neural network to model plausible, yet hard image transformations.
We show that ALT can naturally work with existing diversity modules to produce highly distinct, and large transformations of the source domain leading to state-of-the-art performance.
arXiv Detail & Related papers (2022-06-15T18:05:24Z) - Augmentation based unsupervised domain adaptation [2.304713283039168]
Deep learning models trained on small and unrepresentative data tend to outperform when deployed in data that differs from the one used for training.
Our approach takes advantage of the properties of adversarial domain adaptation and consistency training to achieve more robust adaptation.
arXiv Detail & Related papers (2022-02-23T13:06:07Z) - Adaptive Risk Minimization: Learning to Adapt to Domain Shift [109.87561509436016]
A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution.
In this work, we consider the problem setting of domain generalization, where the training data are structured into domains and there may be multiple test time shifts.
We introduce the framework of adaptive risk minimization (ARM), in which models are directly optimized for effective adaptation to shift by learning to adapt on the training domains.
arXiv Detail & Related papers (2020-07-06T17:59:30Z) - Shape-aware Meta-learning for Generalizing Prostate MRI Segmentation to
Unseen Domains [68.73614619875814]
We present a novel shape-aware meta-learning scheme to improve the model generalization in prostate MRI segmentation.
Experimental results show that our approach outperforms many state-of-the-art generalization methods consistently across all six settings of unseen domains.
arXiv Detail & Related papers (2020-07-04T07:56:02Z) - Adversarial-Prediction Guided Multi-task Adaptation for Semantic
Segmentation of Electron Microscopy Images [5.027571997864707]
We introduce an adversarial-prediction guided multi-task network to learn the adaptation of a well-trained model for use on a novel unlabeled target domain.
Since no label is available on target domain, we learn an encoding representation not only for the supervised segmentation on source domain but also for unsupervised reconstruction of the target data.
arXiv Detail & Related papers (2020-04-05T09:18:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.