Federated Contrastive Learning for Dermatological Disease Diagnosis via
On-device Learning
- URL: http://arxiv.org/abs/2202.07470v1
- Date: Mon, 14 Feb 2022 01:11:44 GMT
- Title: Federated Contrastive Learning for Dermatological Disease Diagnosis via
On-device Learning
- Authors: Yawen Wu, Dewen Zeng, Zhepeng Wang, Yi Sheng, Lei Yang, Alaina J.
James, Yiyu Shi, Jingtong Hu
- Abstract summary: We propose an on-device framework for dermatological disease diagnosis with limited labels.
The proposed framework effectively improves the recall and precision of dermatological disease diagnosis compared with state-of-the-art methods.
- Score: 15.862924197017264
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep learning models have been deployed in an increasing number of edge and
mobile devices to provide healthcare. These models rely on training with a
tremendous amount of labeled data to achieve high accuracy. However, for
medical applications such as dermatological disease diagnosis, the private data
collected by mobile dermatology assistants exist on distributed mobile devices
of patients, and each device only has a limited amount of data. Directly
learning from limited data greatly deteriorates the performance of learned
models. Federated learning (FL) can train models by using data distributed on
devices while keeping the data local for privacy. Existing works on FL assume
all the data have ground-truth labels. However, medical data often comes
without any accompanying labels since labeling requires expertise and results
in prohibitively high labor costs. The recently developed self-supervised
learning approach, contrastive learning (CL), can leverage the unlabeled data
to pre-train a model, after which the model is fine-tuned on limited labeled
data for dermatological disease diagnosis. However, simply combining CL with FL
as federated contrastive learning (FCL) will result in ineffective learning
since CL requires diverse data for learning but each device only has limited
data. In this work, we propose an on-device FCL framework for dermatological
disease diagnosis with limited labels. Features are shared in the FCL
pre-training process to provide diverse and accurate contrastive information.
After that, the pre-trained model is fine-tuned with local labeled data
independently on each device or collaboratively with supervised federated
learning on all devices. Experiments on dermatological disease datasets show
that the proposed framework effectively improves the recall and precision of
dermatological disease diagnosis compared with state-of-the-art methods.
Related papers
- FedCVD: The First Real-World Federated Learning Benchmark on Cardiovascular Disease Data [52.55123685248105]
Cardiovascular diseases (CVDs) are currently the leading cause of death worldwide, highlighting the critical need for early diagnosis and treatment.
Machine learning (ML) methods can help diagnose CVDs early, but their performance relies on access to substantial data with high quality.
This paper presents the first real-world FL benchmark for cardiovascular disease detection, named FedCVD.
arXiv Detail & Related papers (2024-10-28T02:24:01Z) - Federated Learning on Transcriptomic Data: Model Quality and Performance
Trade-Offs [0.0]
Machine learning on large-scale genomic or transcriptomic data is important for many novel health applications.
Due to privacy and regulatory reasons, it is also problematic to aggregate all data at a trusted third party.
Federated learning is a promising solution because it enables decentralized, collaborative machine learning without exchanging raw data.
arXiv Detail & Related papers (2024-02-22T13:21:26Z) - DOCTOR: A Multi-Disease Detection Continual Learning Framework Based on Wearable Medical Sensors [3.088223994180069]
We propose DOCTOR, a multi-disease detection continual learning framework based on wearable medical sensors (WMSs)
It employs a multi-headed deep neural network (DNN) and a replay-style CL algorithm.
It achieves 1.43 times better average test accuracy, 1.25 times better F1-score, and 0.41 higher backward transfer than the naive fine-tuning framework.
arXiv Detail & Related papers (2023-05-09T19:33:17Z) - Federated Self-Supervised Contrastive Learning and Masked Autoencoder
for Dermatological Disease Diagnosis [15.20791611477636]
In dermatological disease diagnosis, the private data collected by mobile dermatology assistants exist on distributed mobile devices of patients.
We propose two federated self-supervised learning frameworks for dermatological disease diagnosis with limited labels.
Experiments on dermatological disease datasets show superior accuracy of the proposed frameworks over state-of-the-arts.
arXiv Detail & Related papers (2022-08-24T02:49:35Z) - Federated Contrastive Learning for Volumetric Medical Image Segmentation [16.3860181959878]
Federated learning (FL) can help in this regard by learning a shared model while keeping training data local for privacy.
Traditional FL requires fully-labeled data for training, which is inconvenient or sometimes infeasible to obtain.
In this work, we propose an FCL framework for volumetric medical image segmentation with limited annotations.
arXiv Detail & Related papers (2022-04-23T03:47:23Z) - When Accuracy Meets Privacy: Two-Stage Federated Transfer Learning
Framework in Classification of Medical Images on Limited Data: A COVID-19
Case Study [77.34726150561087]
COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources.
CNN has been widely utilized and verified in analyzing medical images.
arXiv Detail & Related papers (2022-03-24T02:09:41Z) - Federated Cycling (FedCy): Semi-supervised Federated Learning of
Surgical Phases [57.90226879210227]
FedCy is a semi-supervised learning (FSSL) method that combines FL and self-supervised learning to exploit a decentralized dataset of both labeled and unlabeled videos.
We demonstrate significant performance gains over state-of-the-art FSSL methods on the task of automatic recognition of surgical phases.
arXiv Detail & Related papers (2022-03-14T17:44:53Z) - Relational Subsets Knowledge Distillation for Long-tailed Retinal
Diseases Recognition [65.77962788209103]
We propose class subset learning by dividing the long-tailed data into multiple class subsets according to prior knowledge.
It enforces the model to focus on learning the subset-specific knowledge.
The proposed framework proved to be effective for the long-tailed retinal diseases recognition task.
arXiv Detail & Related papers (2021-04-22T13:39:33Z) - FLOP: Federated Learning on Medical Datasets using Partial Networks [84.54663831520853]
COVID-19 Disease due to the novel coronavirus has caused a shortage of medical resources.
Different data-driven deep learning models have been developed to mitigate the diagnosis of COVID-19.
The data itself is still scarce due to patient privacy concerns.
We propose a simple yet effective algorithm, named textbfFederated textbfL textbfon Medical datasets using textbfPartial Networks (FLOP)
arXiv Detail & Related papers (2021-02-10T01:56:58Z) - Real-World Multi-Domain Data Applications for Generalizations to
Clinical Settings [1.508558791031741]
Deep learning models perform well when trained on standardized datasets from artificial settings, such as clinical trials.
We show that by employing a self-supervised approach with transfer learning on a multi-domain real-world dataset, we can achieve 16% relative improvement on a standardized dataset.
arXiv Detail & Related papers (2020-07-24T17:41:23Z) - Self-Training with Improved Regularization for Sample-Efficient Chest
X-Ray Classification [80.00316465793702]
We present a deep learning framework that enables robust modeling in challenging scenarios.
Our results show that using 85% lesser labeled data, we can build predictive models that match the performance of classifiers trained in a large-scale data setting.
arXiv Detail & Related papers (2020-05-03T02:36:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.