A Framework for Exploring Federated Community Detection
- URL: http://arxiv.org/abs/2312.09023v1
- Date: Thu, 14 Dec 2023 15:13:04 GMT
- Title: A Framework for Exploring Federated Community Detection
- Authors: William Leeney and Ryan McConville
- Abstract summary: Federated Learning is machine learning in the context of a network of clients whilst maintaining data residency and/or privacy constraints.
Community detection is the unsupervised discovery of clusters of nodes within graph-structured data.
We conduct initial experiments across a range of existing datasets that showcase the gap in performance introduced by the distributed data.
- Score: 4.358468367889626
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Federated Learning is machine learning in the context of a network of clients
whilst maintaining data residency and/or privacy constraints. Community
detection is the unsupervised discovery of clusters of nodes within
graph-structured data. The intersection of these two fields uncovers much
opportunity, but also challenge. For example, it adds complexity due to missing
connectivity information between privately held graphs. In this work, we
explore the potential of federated community detection by conducting initial
experiments across a range of existing datasets that showcase the gap in
performance introduced by the distributed data. We demonstrate that isolated
models would benefit from collaboration establishing a framework for
investigating challenges within this domain. The intricacies of these research
frontiers are discussed alongside proposed solutions to these issues.
Related papers
- A Survey on Group Fairness in Federated Learning: Challenges, Taxonomy of Solutions and Directions for Future Research [5.08731160761218]
Group fairness in machine learning is a critical area of research focused on achieving equitable outcomes across different groups.
Federated learning amplifies the need for fairness due to the heterogeneous data distributions across clients.
No dedicated survey has focused comprehensively on group fairness in federated learning.
We create a novel taxonomy of these approaches based on key criteria such as data partitioning, location, and applied strategies.
arXiv Detail & Related papers (2024-10-04T18:39:28Z) - Capture the Flag: Uncovering Data Insights with Large Language Models [90.47038584812925]
This study explores the potential of using Large Language Models (LLMs) to automate the discovery of insights in data.
We propose a new evaluation methodology based on a "capture the flag" principle, measuring the ability of such models to recognize meaningful and pertinent information (flags) in a dataset.
arXiv Detail & Related papers (2023-12-21T14:20:06Z) - Over-Squashing in Graph Neural Networks: A Comprehensive survey [0.0]
This survey delves into the challenge of over-squashing in Graph Neural Networks (GNNs)
It comprehensively explores the causes, consequences, and mitigation strategies for over-squashing.
Various methodologies are reviewed, including graph rewiring, novel normalization, spectral analysis, and curvature-based strategies.
The survey also discusses the interplay between over-squashing and other GNN limitations, such as over-smoothing.
arXiv Detail & Related papers (2023-08-29T18:46:15Z) - Collaborative Mean Estimation over Intermittently Connected Networks
with Peer-To-Peer Privacy [86.61829236732744]
This work considers the problem of Distributed Mean Estimation (DME) over networks with intermittent connectivity.
The goal is to learn a global statistic over the data samples localized across distributed nodes with the help of a central server.
We study the tradeoff between collaborative relaying and privacy leakage due to the additional data sharing among nodes.
arXiv Detail & Related papers (2023-02-28T19:17:03Z) - META-CODE: Community Detection via Exploratory Learning in Topologically
Unknown Networks [5.299515147443958]
META-CODE is an end-to-end solution for detecting overlapping communities in networks with unknown topology.
It consists of three steps: 1) initial network inference, 2) node-level community-affiliation embedding based on graph neural networks (GNNs) trained by our new reconstruction loss, and 3) network exploration via community-affiliation-based node queries.
arXiv Detail & Related papers (2022-08-23T15:02:48Z) - Building Inspection Toolkit: Unified Evaluation and Strong Baselines for
Damage Recognition [0.0]
We introduce the building inspection toolkit -- bikit -- which acts as a simple to use data hub containing relevant open-source datasets in the field of damage recognition.
The datasets are enriched with evaluation splits and predefined metrics, suiting the specific task and their data distribution.
For the sake of compatibility and to motivate researchers in this domain, we also provide a leaderboard and the possibility to share model weights with the community.
arXiv Detail & Related papers (2022-02-14T20:05:59Z) - TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain
Gait Recognition [77.77786072373942]
This paper proposes a Transferable Neighborhood Discovery (TraND) framework to bridge the domain gap for unsupervised cross-domain gait recognition.
We design an end-to-end trainable approach to automatically discover the confident neighborhoods of unlabeled samples in the latent space.
Our method achieves state-of-the-art results on two public datasets, i.e., CASIA-B and OU-LP.
arXiv Detail & Related papers (2021-02-09T03:07:07Z) - A Survey of Community Detection Approaches: From Statistical Modeling to
Deep Learning [95.27249880156256]
We develop and present a unified architecture of network community-finding methods.
We introduce a new taxonomy that divides the existing methods into two categories, namely probabilistic graphical model and deep learning.
We conclude with discussions of the challenges of the field and suggestions of possible directions for future research.
arXiv Detail & Related papers (2021-01-03T02:32:45Z) - Joint Inference of Diffusion and Structure in Partially Observed Social
Networks Using Coupled Matrix Factorization [3.399624105745357]
In this paper, a model is learned from partially observed data to infer unobserved diffusion and structure networks.
The interrelations among links of nodes and cascade processes are utilized in the proposed method via learning and low-dimensional latent factors.
Experiments on these synthetic and real-world datasets show that the proposed method successfully detects invisible social behaviors, predicts links, and identifies latent features.
arXiv Detail & Related papers (2020-10-03T17:48:57Z) - Deep Learning for Community Detection: Progress, Challenges and
Opportunities [79.26787486888549]
Article summarizes the contributions of the various frameworks, models, and algorithms in deep neural networks.
This article summarizes the contributions of the various frameworks, models, and algorithms in deep neural networks.
arXiv Detail & Related papers (2020-05-17T11:22:11Z) - Survey of Network Intrusion Detection Methods from the Perspective of
the Knowledge Discovery in Databases Process [63.75363908696257]
We review the methods that have been applied to network data with the purpose of developing an intrusion detector.
We discuss the techniques used for the capture, preparation and transformation of the data, as well as, the data mining and evaluation methods.
As a result of this literature review, we investigate some open issues which will need to be considered for further research in the area of network security.
arXiv Detail & Related papers (2020-01-27T11:21:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.