Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptation
- URL: http://arxiv.org/abs/2307.03157v2
- Date: Tue, 16 Apr 2024 02:12:11 GMT
- Title: Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptation
- Authors: Janet Wang, Yunbei Zhang, Zhengming Ding, Jihun Hamm,
- Abstract summary: Unsupervised domain adaptation (UDA) can integrate large external datasets for developing reliable classifiers.
UDA can effectively mitigate bias against minority groups and enhance fairness in diagnostic systems.
- Score: 43.1078084014722
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The development of reliable and fair diagnostic systems is often constrained by the scarcity of labeled data. To address this challenge, our work explores the feasibility of unsupervised domain adaptation (UDA) to integrate large external datasets for developing reliable classifiers. The adoption of UDA with multiple sources can simultaneously enrich the training set and bridge the domain gap between different skin lesion datasets, which vary due to distinct acquisition protocols. Particularly, UDA shows practical promise for improving diagnostic reliability when training with a custom skin lesion dataset, where only limited labeled data are available from the target domain. In this study, we investigate three UDA training schemes based on source data utilization: single-source, combined-source, and multi-source UDA. Our findings demonstrate the effectiveness of applying UDA on multiple sources for binary and multi-class classification. A strong correlation between test error and label shift in multi-class tasks has been observed in the experiment. Crucially, our study shows that UDA can effectively mitigate bias against minority groups and enhance fairness in diagnostic systems, while maintaining superior classification performance. This is achieved even without directly implementing fairness-focused techniques. This success is potentially attributed to the increased and well-adapted demographic information obtained from multiple sources.
Related papers
- UDA-Bench: Revisiting Common Assumptions in Unsupervised Domain Adaptation Using a Standardized Framework [59.428668614618914]
We take a deeper look into the diverse factors that influence the efficacy of modern unsupervised domain adaptation (UDA) methods.
To facilitate our analysis, we first develop UDA-Bench, a novel PyTorch framework that standardizes training and evaluation for domain adaptation.
arXiv Detail & Related papers (2024-09-23T17:57:07Z) - Unsupervised Domain Adaptation for Brain Vessel Segmentation through
Transwarp Contrastive Learning [46.248404274124546]
Unsupervised domain adaptation (UDA) aims to align the labelled source distribution with the unlabelled target distribution to obtain domain-invariant predictive models.
This paper proposes a simple yet potent contrastive learning framework for UDA to narrow the inter-domain gap between labelled source and unlabelled target distribution.
arXiv Detail & Related papers (2024-02-23T10:01:22Z) - Multi-source-free Domain Adaptation via Uncertainty-aware Adaptive
Distillation [8.791916654073088]
Source-free domain adaptation (SFDA) alleviates the domain discrepancy among data obtained from domains without accessing the data for the awareness of data privacy.
We propose Uncertainty-aware Adaptive Distillation (UAD) for the multi-source-free unsupervised domain adaptation setting.
arXiv Detail & Related papers (2024-02-09T06:48:04Z) - Calibrated Adaptive Teacher for Domain Adaptive Intelligent Fault
Diagnosis [7.88657961743755]
Unsupervised domain adaptation (UDA) deals with the scenario where labeled data are available in a source domain, and only unlabeled data are available in a target domain.
We propose a novel UDA method called Calibrated Adaptive Teacher (CAT), where we propose to calibrate the predictions of the teacher network throughout the self-training process.
arXiv Detail & Related papers (2023-12-05T15:19:29Z) - Weighted Joint Maximum Mean Discrepancy Enabled
Multi-Source-Multi-Target Unsupervised Domain Adaptation Fault Diagnosis [15.56929064706769]
We propose a weighted joint maximum mean discrepancy enabled multi-source-multi-target unsupervised domain adaptation (WJMMD-MDA)
The proposed method extracts sufficient information from multiple labeled source domains and achieves domain alignment between source and target domains.
The performance of the proposed method is evaluated in comprehensive comparative experiments on three datasets.
arXiv Detail & Related papers (2023-10-20T16:53:31Z) - Source-Free Domain Adaptation for Medical Image Segmentation via
Prototype-Anchored Feature Alignment and Contrastive Learning [57.43322536718131]
We present a two-stage source-free domain adaptation (SFDA) framework for medical image segmentation.
In the prototype-anchored feature alignment stage, we first utilize the weights of the pre-trained pixel-wise classifier as source prototypes.
Then, we introduce the bi-directional transport to align the target features with class prototypes by minimizing its expected cost.
arXiv Detail & Related papers (2023-07-19T06:07:12Z) - Source-free Domain Adaptation Requires Penalized Diversity [60.04618512479438]
Source-free domain adaptation (SFDA) was introduced to address knowledge transfer between different domains in the absence of source data.
In unsupervised SFDA, the diversity is limited to learning a single hypothesis on the source or learning multiple hypotheses with a shared feature extractor.
We propose a novel unsupervised SFDA algorithm that promotes representational diversity through the use of separate feature extractors.
arXiv Detail & Related papers (2023-04-06T00:20:19Z) - UMAD: Universal Model Adaptation under Domain and Category Shift [138.12678159620248]
Universal Model ADaptation (UMAD) framework handles both UDA scenarios without access to source data.
We develop an informative consistency score to help distinguish unknown samples from known samples.
Experiments on open-set and open-partial-set UDA scenarios demonstrate that UMAD exhibits comparable, if not superior, performance to state-of-the-art data-dependent methods.
arXiv Detail & Related papers (2021-12-16T01:22:59Z) - My Health Sensor, my Classifier: Adapting a Trained Classifier to
Unlabeled End-User Data [0.5091527753265949]
In this work, we present an approach for unsupervised domain adaptation (DA) with the constraint, that the labeled source data are not directly available.
Our solution, iteratively labels only high confidence sub-regions of the target data distribution, based on the belief of the classifier.
The goal is to apply the proposed approach on DA for the task of sleep apnea detection and achieve personalization based on the needs of the patient.
arXiv Detail & Related papers (2020-09-22T20:27:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.