Free-Rider and Conflict Aware Collaboration Formation for Cross-Silo Federated Learning

• URL: http://arxiv.org/abs/2410.19321v2
• Date: Mon, 28 Oct 2024 02:06:31 GMT
• Title: Free-Rider and Conflict Aware Collaboration Formation for Cross-Silo Federated Learning
• Authors: Mengmeng Chen, Xiaohu Wu, Xiaoli Tang, Tiantian He, Yew-Soon Ong, Qiqi Liu, Qicheng Lao, Han Yu,
• Abstract summary: Federated learning (FL) is a machine learning paradigm that allows multiple FL participants to collaborate on training models without sharing private data. We propose an optimal FL collaboration formation strategy -- FedEgoists -- which ensures that a FL-PT can benefit from FL if and only if it benefits the FL ecosystem. We theoretically prove that the FL-PT coalitions formed are optimal since no coalitions can collaborate together to improve the utility of any of their members.
• Score: 32.35705737668307
• License:
• Abstract: Federated learning (FL) is a machine learning paradigm that allows multiple FL participants (FL-PTs) to collaborate on training models without sharing private data. Due to data heterogeneity, negative transfer may occur in the FL training process. This necessitates FL-PT selection based on their data complementarity. In cross-silo FL, organizations that engage in business activities are key sources of FL-PTs. The resulting FL ecosystem has two features: (i) self-interest, and (ii) competition among FL-PTs. This requires the desirable FL-PT selection strategy to simultaneously mitigate the problems of free riders and conflicts of interest among competitors. To this end, we propose an optimal FL collaboration formation strategy -- FedEgoists -- which ensures that: (1) a FL-PT can benefit from FL if and only if it benefits the FL ecosystem, and (2) a FL-PT will not contribute to its competitors or their supporters. It provides an efficient clustering solution to group FL-PTs into coalitions, ensuring that within each coalition, FL-PTs share the same interest. We theoretically prove that the FL-PT coalitions formed are optimal since no coalitions can collaborate together to improve the utility of any of their members. Extensive experiments on widely adopted benchmark datasets demonstrate the effectiveness of FedEgoists compared to nine state-of-the-art baseline methods, and its ability to establish efficient collaborative networks in cross-silos FL with FL-PTs that engage in business activities.

Related papers

• Cooperation and Personalization on a Seesaw: Choice-based FL for Safe Cooperation in Wireless Networks [8.064072834606456]
  Federated learning (FL) is an innovative distributed artificial intelligence technique. We first overview benefits and concerns when applying FL to wireless networks. We discuss the possibility of tuning the cooperation level with a choice-based approach.
  arXiv  Detail & Related papers  (2024-11-06T14:09:47Z)
• Real-World Federated Learning in Radiology: Hurdles to overcome and Benefits to gain [2.8048919658768523]
  Federated Learning (FL) enables collaborative model training while keeping data locally. Currently, most FL studies in radiology are conducted in simulated environments. Few existing real-world FL initiatives rarely communicate specific measures taken to overcome these hurdles.
  arXiv  Detail & Related papers  (2024-05-15T15:04:27Z)
• A Survey on Efficient Federated Learning Methods for Foundation Model Training [62.473245910234304]
  Federated Learning (FL) has become an established technique to facilitate privacy-preserving collaborative training across a multitude of clients. In the wake of Foundation Models (FM), the reality is different for many deep learning applications. We discuss the benefits and drawbacks of parameter-efficient fine-tuning (PEFT) for FL applications.
  arXiv  Detail & Related papers  (2024-01-09T10:22:23Z)
• Harnessing the Power of Federated Learning in Federated Contextual Bandits [20.835106310302876]
  Federated contextual bandits (FCB) are a pivotal integration of FL and sequential decision-making. FCB approaches have largely employed their tailored FL components, often deviating from the canonical FL framework. In particular, a novel FCB design, termed FedIGW, is proposed to leverage a regression-based CB algorithm.
  arXiv  Detail & Related papers  (2023-12-26T21:44:09Z)
• FedCompetitors: Harmonious Collaboration in Federated Learning with Competing Participants [41.070716405671206]
  Federated learning (FL) provides a privacy-preserving approach for collaborative training of machine learning models. It is crucial to select appropriate collaborators for each FL participant based on data complementarity. It is imperative to consider the inter-individual relationships among FL-PTs where some FL-PTs engage in competition.
  arXiv  Detail & Related papers  (2023-12-18T17:53:01Z)
• Bayesian Federated Learning: A Survey [54.40136267717288]
  Federated learning (FL) demonstrates its advantages in integrating distributed infrastructure, communication, computing and learning in a privacy-preserving manner. The robustness and capabilities of existing FL methods are challenged by limited and dynamic data and conditions. BFL has emerged as a promising approach to address these issues.
  arXiv  Detail & Related papers  (2023-04-26T03:41:17Z)
• Towards Verifiable Federated Learning [15.758657927386263]
  Federated learning (FL) is an emerging paradigm of collaborative machine learning that preserves user privacy while building powerful models. Due to the nature of open participation by self-interested entities, FL needs to guard against potential misbehaviours by legitimate FL participants. Verifiable federated learning has become an emerging topic of research that has attracted significant interest from the academia and the industry alike.
  arXiv  Detail & Related papers  (2022-02-15T09:52:25Z)
• FedComm: Federated Learning as a Medium for Covert Communication [56.376997104843355]
  Federated Learning (FL) is a solution to mitigate the privacy implications related to the adoption of deep learning. This paper thoroughly investigates the communication capabilities of an FL scheme. We introduce FedComm, a novel multi-system covert-communication technique.
  arXiv  Detail & Related papers  (2022-01-21T17:05:56Z)
• A Contract Theory based Incentive Mechanism for Federated Learning [52.24418084256517]
  Federated learning (FL) serves as a data privacy-preserved machine learning paradigm, and realizes the collaborative model trained by distributed clients. To accomplish an FL task, the task publisher needs to pay financial incentives to the FL server and FL server offloads the task to the contributing FL clients. It is challenging to design proper incentives for the FL clients due to the fact that the task is privately trained by the clients.
  arXiv  Detail & Related papers  (2021-08-12T07:30:42Z)
• Convergence Time Optimization for Federated Learning over Wireless Networks [160.82696473996566]
  A wireless network is considered in which wireless users transmit their local FL models (trained using their locally collected data) to a base station (BS) The BS, acting as a central controller, generates a global FL model using the received local FL models and broadcasts it back to all users. Due to the limited number of resource blocks (RBs) in a wireless network, only a subset of users can be selected to transmit their local FL model parameters to the BS. Since each user has unique training data samples, the BS prefers to include all local user FL models to generate a converged global FL model.
  arXiv  Detail & Related papers  (2020-01-22T01:55:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.