CommunityAI: Towards Community-based Federated Learning

• URL: http://arxiv.org/abs/2311.17958v1
• Date: Wed, 29 Nov 2023 09:31:52 GMT
• Title: CommunityAI: Towards Community-based Federated Learning
• Authors: Ilir Murturi, Praveen Kumar Donta, Schahram Dustdar
• Abstract summary: We present a novel framework for Community-based Federated Learning called CommunityAI. CommunityAI enables participants to be organized into communities based on their shared interests, expertise, or data characteristics. We discuss the conceptual architecture, system requirements, processes, and future challenges that must be solved.
• Score: 6.535815174238974
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Federated Learning (FL) has emerged as a promising paradigm to train machine learning models collaboratively while preserving data privacy. However, its widespread adoption faces several challenges, including scalability, heterogeneous data and devices, resource constraints, and security concerns. Despite its promise, FL has not been specifically adapted for community domains, primarily due to the wide-ranging differences in data types and context, devices and operational conditions, environmental factors, and stakeholders. In response to these challenges, we present a novel framework for Community-based Federated Learning called CommunityAI. CommunityAI enables participants to be organized into communities based on their shared interests, expertise, or data characteristics. Community participants collectively contribute to training and refining learning models while maintaining data and participant privacy within their respective groups. Within this paper, we discuss the conceptual architecture, system requirements, processes, and future challenges that must be solved. Finally, our goal within this paper is to present our vision regarding enabling a collaborative learning process within various communities.

Related papers

• Ten Challenging Problems in Federated Foundation Models [55.343738234307544]
  Federated Foundation Models (FedFMs) represent a distributed learning paradigm that fuses general competences of foundation models as well as privacy-preserving capabilities of federated learning. This paper provides a comprehensive summary of the ten challenging problems inherent in FedFMs, encompassing foundational theory, utilization of private data, continual learning, unlearning, Non-IID and graph data, bidirectional knowledge transfer, incentive mechanism design, game mechanism design, model watermarking, and efficiency.
  arXiv  Detail & Related papers  (2025-02-14T04:01:15Z)
• Collaborative Imputation of Urban Time Series through Cross-city Meta-learning [54.438991949772145]
  We propose a novel collaborative imputation paradigm leveraging meta-learned implicit neural representations (INRs) We then introduce a cross-city collaborative learning scheme through model-agnostic meta learning. Experiments on a diverse urban dataset from 20 global cities demonstrate our model's superior imputation performance and generalizability.
  arXiv  Detail & Related papers  (2025-01-20T07:12:40Z)
• A study on performance limitations in Federated Learning [0.05439020425819]
  This project focuses on the communication bottleneck and data Non IID-ness, and its effect on the performance of the models. Google introduced Federated Learning in 2016. This project will be focusing on the communication bottleneck and data Non IID-ness, and its effect on the performance of the models.
  arXiv  Detail & Related papers  (2025-01-07T02:35:41Z)
• Large Language Model Federated Learning with Blockchain and Unlearning for Cross-Organizational Collaboration [18.837908762300493]
  Large language models (LLMs) have transformed the way computers understand and process human language, but using them effectively across different organizations remains difficult. We propose a hybrid blockchain-based federated learning framework that combines public and private blockchain architectures with multi-agent reinforcement learning. Our framework enables transparent sharing of model update through the public blockchain while protecting sensitive computations in private chains.
  arXiv  Detail & Related papers  (2024-12-18T06:56:09Z)
• Federated Large Language Models: Current Progress and Future Directions [63.68614548512534]
  This paper surveys Federated learning for LLMs (FedLLM), highlighting recent advances and future directions. We focus on two key aspects: fine-tuning and prompt learning in a federated setting, discussing existing work and associated research challenges.
  arXiv  Detail & Related papers  (2024-09-24T04:14:33Z)
• Privacy in Federated Learning [0.0]
  Federated Learning (FL) represents a significant advancement in distributed machine learning. This chapter delves into the core privacy concerns within FL, including the risks of data reconstruction, model inversion attacks, and membership inference. It examines the trade-offs between model accuracy and privacy, emphasizing the importance of balancing these factors in practical implementations.
  arXiv  Detail & Related papers  (2024-08-12T18:41:58Z)
• Advances in Robust Federated Learning: Heterogeneity Considerations [25.261572089655264]
  Key challenge is to efficiently train models across multiple clients with different data distributions, model structures, task objectives, computational capabilities, and communication resources. In this paper, we first outline the basic concepts of heterogeneous federated learning. We then summarize the research challenges in federated learning in terms of five aspects: data, model, task, device, and communication.
  arXiv  Detail & Related papers  (2024-05-16T06:35:42Z)
• Private Knowledge Sharing in Distributed Learning: A Survey [50.51431815732716]
  The rise of Artificial Intelligence has revolutionized numerous industries and transformed the way society operates. It is crucial to utilize information in learning processes that are either distributed or owned by different entities. Modern data-driven services have been developed to integrate distributed knowledge entities into their outcomes.
  arXiv  Detail & Related papers  (2024-02-08T07:18:23Z)
• Exploring Federated Unlearning: Analysis, Comparison, and Insights [101.64910079905566]
  federated unlearning enables the selective removal of data from models trained in federated systems. This paper examines existing federated unlearning approaches, examining their algorithmic efficiency, impact on model accuracy, and effectiveness in preserving privacy. We propose the OpenFederatedUnlearning framework, a unified benchmark for evaluating federated unlearning methods.
  arXiv  Detail & Related papers  (2023-10-30T01:34:33Z)
• Towards Explainable Multi-Party Learning: A Contrastive Knowledge Sharing Framework [23.475874929905192]
  We propose a novel contrastive multi-party learning framework for knowledge refinement and sharing. The proposed scheme achieves significant improvement in model performance in a variety of scenarios.
  arXiv  Detail & Related papers  (2021-04-14T07:33:48Z)
• Federated Learning: A Signal Processing Perspective [144.63726413692876]
  Federated learning is an emerging machine learning paradigm for training models across multiple edge devices holding local datasets, without explicitly exchanging the data. This article provides a unified systematic framework for federated learning in a manner that encapsulates and highlights the main challenges that are natural to treat using signal processing tools.
  arXiv  Detail & Related papers  (2021-03-31T15:14:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.