CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging

• URL: http://arxiv.org/abs/2407.11652v7
• Date: Fri, 9 Aug 2024 05:56:23 GMT
• Title: CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging
• Abstract summary: Federated Learning (FL) offers a privacy-preserving approach to train models on decentralized data. Cross-Client Variations Adaptive Federated Learning (CCVA-FL) aims to minimize cross-client variations by transforming images into a common feature space. Our results demonstrate that CCVA-FL outperforms Vanilla Federated Averaging by effectively addressing data distribution differences across clients without compromising privacy.
• Score: 3.004632712148892
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Federated Learning (FL) offers a privacy-preserving approach to train models on decentralized data. Its potential in healthcare is significant, but challenges arise due to cross-client variations in medical image data, exacerbated by limited annotations. This paper introduces Cross-Client Variations Adaptive Federated Learning (CCVA-FL) to address these issues. CCVA-FL aims to minimize cross-client variations by transforming images into a common feature space. It involves expert annotation of a subset of images from each client, followed by the selection of a client with the least data complexity as the target. Synthetic medical images are then generated using Scalable Diffusion Models with Transformers (DiT) based on the target client's annotated images. These synthetic images, capturing diversity and representing the original data, are shared with other clients. Each client then translates its local images into the target image space using image-to-image translation. The translated images are subsequently used in a federated learning setting to develop a server model. Our results demonstrate that CCVA-FL outperforms Vanilla Federated Averaging by effectively addressing data distribution differences across clients without compromising privacy.

Related papers

• Personalized Feature Translation for Expression Recognition: An Efficient Source-Free Domain Adaptation Method [64.05966759056122]
  Facial expression recognition (FER) models are employed in many video-based affective computing applications, such as human-computer interaction and healthcare monitoring.<n>Deep FER models often struggle with subtle expressions and high inter-subject variability, limiting their performance in real-world applications.<n>This paper addresses a challenging scenario where source data is unavailable for adaptation, and only unlabeled target data consisting solely of neutral expressions is available.<n>By translating in the latent space, PFT avoids the complexity and noise of face expression generation, producing discriminative embeddings optimized for classification.
  arXiv  Detail & Related papers  (2025-08-08T20:13:50Z)
• Federated Client-tailored Adapter for Medical Image Segmentation [21.964553228831427]
  We propose a novel Federated Client-tailored Adapter (FCA) framework for medical image segmentation. FCA achieves stable and client-tailored adaptive segmentation without sharing sensitive local data. We develop two client-tailored federated updating strategies that adaptively decompose the adapter into common and individual components.
  arXiv  Detail & Related papers  (2025-04-25T02:20:25Z)
• FedCAR: Cross-client Adaptive Re-weighting for Generative Models in Federated Learning [3.7088276910640365]
  Federated learning is a privacy-preserving solution for training distributed datasets across data centers. We propose a novel algorithm aimed at improving the performance of generative models within FL. Experimental results on three public chest X-ray datasets show superior performance in medical image generation.
  arXiv  Detail & Related papers  (2024-12-16T05:43:14Z)
• Gen-SIS: Generative Self-augmentation Improves Self-supervised Learning [52.170253590364545]
  Gen-SIS is a diffusion-based augmentation technique trained exclusively on unlabeled image data. We show that these self-augmentations', i.e. generative augmentations based on the vanilla SSL encoder embeddings, facilitate the training of a stronger SSL encoder.
  arXiv  Detail & Related papers  (2024-12-02T16:20:59Z)
• FACMIC: Federated Adaptative CLIP Model for Medical Image Classification [12.166024140377337]
  We introduce a federated adaptive Contrastive Language Image Pretraining CLIP model for classification tasks. We employ a light-weight and efficient feature attention module for CLIP that selects suitable features for each client's data. We propose a domain adaptation technique to reduce differences in data distribution between clients.
  arXiv  Detail & Related papers  (2024-10-08T13:24:10Z)
• Federated Face Forgery Detection Learning with Personalized Representation [63.90408023506508]
  Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat. Traditional forgery detection methods directly centralized training on data. The paper proposes a novel federated face forgery detection learning with personalized representation.
  arXiv  Detail & Related papers  (2024-06-17T02:20:30Z)
• Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency [10.16245019262119]
  Federated learning aims to train a shared model of isolated clients without local data exchange. In this work, we propose a novel federated semi-supervised learning framework for medical image segmentation.
  arXiv  Detail & Related papers  (2024-03-19T12:52:38Z)
• CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition [73.51329037954866]
  We propose a robust global representation method with cross-image correlation awareness for visual place recognition. Our method uses the attention mechanism to correlate multiple images within a batch. Our method outperforms state-of-the-art methods by a large margin with significantly less training time.
  arXiv  Detail & Related papers  (2024-02-29T15:05:11Z)
• Learned representation-guided diffusion models for large-image generation [58.192263311786824]
  We introduce a novel approach that trains diffusion models conditioned on embeddings from self-supervised learning (SSL) Our diffusion models successfully project these features back to high-quality histopathology and remote sensing images. Augmenting real data by generating variations of real images improves downstream accuracy for patch-level and larger, image-scale classification tasks.
  arXiv  Detail & Related papers  (2023-12-12T14:45:45Z)
• Towards Instance-adaptive Inference for Federated Learning [80.38701896056828]
  Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. In this paper, we present a novel FL algorithm, i.e., FedIns, to handle intra-client data heterogeneity by enabling instance-adaptive inference in the FL framework. Our experiments show that our FedIns outperforms state-of-the-art FL algorithms, e.g., a 6.64% improvement against the top-performing method with less than 15% communication cost on Tiny-ImageNet.
  arXiv  Detail & Related papers  (2023-08-11T09:58:47Z)
• Diffusion Visual Counterfactual Explanations [51.077318228247925]
  Visual Counterfactual Explanations (VCEs) are an important tool to understand the decisions of an image. Current approaches for the generation of VCEs are restricted to adversarially robust models and often contain non-realistic artefacts. In this paper, we overcome this by generating Visual Diffusion Counterfactual Explanations (DVCEs) for arbitrary ImageNet classifiers.
  arXiv  Detail & Related papers  (2022-10-21T09:35:47Z)
• ST-FL: Style Transfer Preprocessing in Federated Learning for COVID-19 Segmentation [1.6799377888527687]
  We propose a GAN-augmented federated learning model, dubbed ST-FL (Style Transfer Federated Learning), for COVID-19 image segmentation. We demonstrate that the widely varying data quality on FL client nodes leads to a sub-optimal centralised FL model for COVID-19 chest CT image segmentation.
  arXiv  Detail & Related papers  (2022-03-25T14:33:02Z)
• Feature transforms for image data augmentation [74.12025519234153]
  In image classification, many augmentation approaches utilize simple image manipulation algorithms. In this work, we build ensembles on the data level by adding images generated by combining fourteen augmentation approaches. Pretrained ResNet50 networks are finetuned on training sets that include images derived from each augmentation method.
  arXiv  Detail & Related papers  (2022-01-24T14:12:29Z)
• Federated CycleGAN for Privacy-Preserving Image-to-Image Translation [35.89078991794261]
  Unsupervised image-to-image translation methods such as CycleGAN learn to convert images from one domain to another using unpaired training data sets from different domains. These approaches still require centrally collected unpaired records, potentially violating privacy and security issues. We propose a novel federated CycleGAN architecture that can learn image translation in an unsupervised manner while maintaining the data privacy.
  arXiv  Detail & Related papers  (2021-06-17T05:01:59Z)
• Auto-FedAvg: Learnable Federated Averaging for Multi-Institutional Medical Image Segmentation [7.009650174262515]
  Federated learning (FL) enables collaborative model training while preserving each participant's privacy. FedAvg is a standard algorithm that uses fixed weights, often originating from the dataset sizes at each client, to aggregate the distributed learned models on a server during the FL process. In this work, we design a new data-driven approach, namely Auto-FedAvg, where aggregation weights are dynamically adjusted.
  arXiv  Detail & Related papers  (2021-04-20T18:29:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.