Generative Data Augmentation for Non-IID Problem in Decentralized Clinical Machine Learning

• URL: http://arxiv.org/abs/2212.01109v1
• Date: Fri, 2 Dec 2022 11:46:09 GMT
• Title: Generative Data Augmentation for Non-IID Problem in Decentralized Clinical Machine Learning
• Abstract summary: We propose a generative augmentation framework in swarm learning called SL-GAN. SL-GAN augments the non-IID data by generating the synthetic data from participants. We show that SLGAN outperforms state-of-art methods on three clinical datasets including Tuberculosis, Leukemia, COVID-19.
• Score: 8.24935363381541
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Swarm learning (SL) is an emerging promising decentralized machine learning paradigm and has achieved high performance in clinical applications. SL solves the problem of a central structure in federated learning by combining edge computing and blockchain-based peer-to-peer network. While there are promising results in the assumption of the independent and identically distributed (IID) data across participants, SL suffers from performance degradation as the degree of the non-IID data increases. To address this problem, we propose a generative augmentation framework in swarm learning called SL-GAN, which augments the non-IID data by generating the synthetic data from participants. SL-GAN trains generators and discriminators locally, and periodically aggregation via a randomly elected coordinator in SL network. Under the standard assumptions, we theoretically prove the convergence of SL-GAN using stochastic approximations. Experimental results demonstrate that SL-GAN outperforms state-of-art methods on three real world clinical datasets including Tuberculosis, Leukemia, COVID-19.

Related papers

• Recognition of Dysarthria in Amyotrophic Lateral Sclerosis patients using Hypernetworks [7.182245711235296]
  We present the first study incorporating hypernetworks for recognizing dysarthria. Specifically, we use audio files, convert them into log-Mel spectrogram, delta, and delta-delta, and pass the resulting image through a pretrained modified AlexNet model. Results showed that the proposed approach reaches Accuracy up to 82.66% outperforming strong baselines.
  arXiv  Detail & Related papers  (2025-02-27T15:57:37Z)
• Wound Tissue Segmentation in Diabetic Foot Ulcer Images Using Deep Learning: A Pilot Study [5.397013836968946]
  We have created a DFUTissue dataset for the research community to evaluate wound tissue segmentation algorithms. The dataset contains 110 images with tissues labeled by wound experts and 600 unlabeled images. Due to the limited amount of annotated data, our framework consists of both supervised learning (SL) and semi-supervised learning (SSL) phases.
  arXiv  Detail & Related papers  (2024-06-23T05:01:51Z)
• On Pretraining Data Diversity for Self-Supervised Learning [57.91495006862553]
  We explore the impact of training with more diverse datasets on the performance of self-supervised learning (SSL) under a fixed computational budget. Our findings consistently demonstrate that increasing pretraining data diversity enhances SSL performance, albeit only when the distribution distance to the downstream data is minimal.
  arXiv  Detail & Related papers  (2024-03-20T17:59:58Z)
• Multi-omics Sampling-based Graph Transformer for Synthetic Lethality Prediction [20.363977976628792]
  Synthetic lethality (SL) prediction is used to identify if the co-mutation of two genes results in cell death. graph neural networks (GNNs) suffer from limitations in their message passing mechanisms. We propose a new multi-omics sampling-based graph transformer for SL prediction (MSGT-SL)
  arXiv  Detail & Related papers  (2023-10-17T09:06:41Z)
• Self-Supervision for Tackling Unsupervised Anomaly Detection: Pitfalls and Opportunities [50.231837687221685]
  Self-supervised learning (SSL) has transformed machine learning and its many real world applications. Unsupervised anomaly detection (AD) has also capitalized on SSL, by self-generating pseudo-anomalies.
  arXiv  Detail & Related papers  (2023-08-28T07:55:01Z)
• Convergence Analysis of Sequential Split Learning on Heterogeneous Data [6.937859054591121]
  Split Learning (SL) and Federated Averaging (Fed) are two popular paradigms distributed machine learning. We derive convergence guarantees of SL/general SL/non-Avg on heterogeneous data. We validate the counterintuitive analysis result empirically on extremely heterogeneous data.
  arXiv  Detail & Related papers  (2023-02-03T10:04:44Z)
• Does Decentralized Learning with Non-IID Unlabeled Data Benefit from Self Supervision? [51.00034621304361]
  We study decentralized learning with unlabeled data through the lens of self-supervised learning (SSL) We study the effectiveness of contrastive learning algorithms under decentralized learning settings.
  arXiv  Detail & Related papers  (2022-10-20T01:32:41Z)
• Collaborative Intelligence Orchestration: Inconsistency-Based Fusion of Semi-Supervised Learning and Active Learning [60.26659373318915]
  Active learning (AL) and semi-supervised learning (SSL) are two effective, but often isolated, means to alleviate the data-hungry problem. We propose an innovative Inconsistency-based virtual aDvErial algorithm to further investigate SSL-AL's potential superiority. Two real-world case studies visualize the practical industrial value of applying and deploying the proposed data sampling algorithm.
  arXiv  Detail & Related papers  (2022-06-07T13:28:43Z)
• On the Fairness of Swarm Learning in Skin Lesion Classification [22.896631007125244]
  Distributed and collaborative learning is an approach to involve training models in massive, heterogeneous, and distributed data sources. We present an empirical study by comparing the fairness among single (node) training, SL, centralized training. Experiments demonstrate that SL does not exacerbate the fairness problem compared to centralized training.
  arXiv  Detail & Related papers  (2021-09-24T20:20:24Z)
• Uncovering the structure of clinical EEG signals with self-supervised learning [64.4754948595556]
  Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG) By extracting information from unlabeled data, it might be possible to reach competitive performance with deep neural networks.
  arXiv  Detail & Related papers  (2020-07-31T14:34:47Z)
• Continual Learning in Recurrent Neural Networks [67.05499844830231]
  We evaluate the effectiveness of continual learning methods for processing sequential data with recurrent neural networks (RNNs) We shed light on the particularities that arise when applying weight-importance methods, such as elastic weight consolidation, to RNNs. We show that the performance of weight-importance methods is not directly affected by the length of the processed sequences, but rather by high working memory requirements.
  arXiv  Detail & Related papers  (2020-06-22T10:05:12Z)
• Semi-supervised Medical Image Classification with Global Latent Mixing [8.330337646455957]
  Computer-aided diagnosis via deep learning relies on large-scale annotated data sets. Semi-supervised learning mitigates this challenge by leveraging unlabeled data. We present a novel SSL approach that trains the neural network on linear mixing of labeled and unlabeled data.
  arXiv  Detail & Related papers  (2020-05-22T14:49:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.