Federated Heterogeneous Graph Neural Network for Privacy-preserving
Recommendation
- URL: http://arxiv.org/abs/2310.11730v4
- Date: Wed, 28 Feb 2024 05:04:34 GMT
- Title: Federated Heterogeneous Graph Neural Network for Privacy-preserving
Recommendation
- Authors: Bo Yan, Yang Cao, Haoyu Wang, Wenchuan Yang, Junping Du, Chuan Shi
- Abstract summary: heterogeneous information network (HIN) is a potent tool for mitigating data sparsity in recommender systems.
In this paper, we suggest the HIN is partitioned into private HINs stored on the client side and shared HINs on the server.
We formalize the privacy definition for HIN-based federated recommendation (FedRec) in the light of differential privacy.
- Score: 45.39171059168941
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The heterogeneous information network (HIN), which contains rich semantics
depicted by meta-paths, has emerged as a potent tool for mitigating data
sparsity in recommender systems. Existing HIN-based recommender systems operate
under the assumption of centralized storage and model training. However,
real-world data is often distributed due to privacy concerns, leading to the
semantic broken issue within HINs and consequent failures in centralized
HIN-based recommendations. In this paper, we suggest the HIN is partitioned
into private HINs stored on the client side and shared HINs on the server.
Following this setting, we propose a federated heterogeneous graph neural
network (FedHGNN) based framework, which facilitates collaborative training of
a recommendation model using distributed HINs while protecting user privacy.
Specifically, we first formalize the privacy definition for HIN-based federated
recommendation (FedRec) in the light of differential privacy, with the goal of
protecting user-item interactions within private HIN as well as users'
high-order patterns from shared HINs. To recover the broken meta-path based
semantics and ensure proposed privacy measures, we elaborately design a
semantic-preserving user interactions publishing method, which locally perturbs
user's high-order patterns and related user-item interactions for publishing.
Subsequently, we introduce an HGNN model for recommendation, which conducts
node- and semantic-level aggregations to capture recovered semantics. Extensive
experiments on four datasets demonstrate that our model outperforms existing
methods by a substantial margin (up to 34% in HR@10 and 42% in NDCG@10) under a
reasonable privacy budget.
Related papers
- Federated Face Forgery Detection Learning with Personalized Representation [63.90408023506508]
Deep generator technology can produce high-quality fake videos that are indistinguishable, posing a serious social threat.
Traditional forgery detection methods directly centralized training on data.
The paper proposes a novel federated face forgery detection learning with personalized representation.
arXiv Detail & Related papers (2024-06-17T02:20:30Z) - FedRKG: A Privacy-preserving Federated Recommendation Framework via
Knowledge Graph Enhancement [20.214339212091012]
Federated Learning (FL) has emerged as a promising approach for preserving data privacy in recommendation systems by training models locally.
Recent Graph Neural Networks (GNN) have gained popularity in recommendation tasks due to their ability to capture high-order interactions between users and items.
We propose FedRKG, a novel federated recommendation system, where a global knowledge graph (KG) is constructed and maintained on the server using publicly available item information.
arXiv Detail & Related papers (2024-01-20T02:38:21Z) - Decentralized Graph Neural Network for Privacy-Preserving Recommendation [21.37022040905403]
This paper proposes DGREC, a novel decentralized GNN for privacy-preserving recommendations.
It includes three stages, i.e., graph construction, local gradient calculation, and global gradient passing.
We conduct extensive experiments on three public datasets to validate the consistent superiority of our framework.
arXiv Detail & Related papers (2023-08-15T23:56:44Z) - Semi-decentralized Federated Ego Graph Learning for Recommendation [58.21409625065663]
We propose a semi-decentralized federated ego graph learning framework for on-device recommendations, named SemiDFEGL.
The proposed framework is model-agnostic, meaning that it could be seamlessly integrated with existing graph neural network-based recommendation methods and privacy protection techniques.
arXiv Detail & Related papers (2023-02-10T03:57:45Z) - Heterogeneous Graph Neural Network for Privacy-Preserving Recommendation [25.95411320126426]
Social networks are considered to be heterogeneous graph neural networks (HGNNs) with deep learning technological advances.
We propose a novel heterogeneous graph neural network privacy-preserving method based on a differential privacy mechanism named HeteDP.
arXiv Detail & Related papers (2022-10-02T14:41:02Z) - Ordinal Graph Gamma Belief Network for Social Recommender Systems [54.9487910312535]
We develop a hierarchical Bayesian model termed ordinal graph factor analysis (OGFA), which jointly models user-item and user-user interactions.
OGFA not only achieves good recommendation performance, but also extracts interpretable latent factors corresponding to representative user preferences.
We extend OGFA to ordinal graph gamma belief network, which is a multi-stochastic-layer deep probabilistic model.
arXiv Detail & Related papers (2022-09-12T09:19:22Z) - Cross-Network Social User Embedding with Hybrid Differential Privacy
Guarantees [81.6471440778355]
We propose a Cross-network Social User Embedding framework, namely DP-CroSUE, to learn the comprehensive representations of users in a privacy-preserving way.
In particular, for each heterogeneous social network, we first introduce a hybrid differential privacy notion to capture the variation of privacy expectations for heterogeneous data types.
To further enhance user embeddings, a novel cross-network GCN embedding model is designed to transfer knowledge across networks through those aligned users.
arXiv Detail & Related papers (2022-09-04T06:22:37Z) - Federated Social Recommendation with Graph Neural Network [69.36135187771929]
We propose fusing social information with user-item interactions to alleviate it, which is the social recommendation problem.
We devise a novel framework textbfFedrated textbfSocial recommendation with textbfGraph neural network (FeSoG)
arXiv Detail & Related papers (2021-11-21T09:41:39Z) - Federating Recommendations Using Differentially Private Prototypes [16.29544153550663]
We propose a new federated approach to learning global and local private models for recommendation without collecting raw data.
By requiring only two rounds of communication, we both reduce the communication costs and avoid the excessive privacy loss.
We show local adaptation of the global model allows our method to outperform centralized matrix-factorization-based recommender system models.
arXiv Detail & Related papers (2020-03-01T22:21:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.