Towards Personalized Federated Multi-Scenario Multi-Task Recommendation

• URL: http://arxiv.org/abs/2406.18938v2
• Date: Tue, 20 Aug 2024 03:47:41 GMT
• Title: Towards Personalized Federated Multi-Scenario Multi-Task Recommendation
• Authors: Yue Ding, Yanbiao Ji, Xun Cai, Xin Xin, Yuxiang Lu, Suizhi Huang, Chang Liu, Xiaofeng Gao, Tsuyoshi Murata, Hongtao Lu,
• Abstract summary: PF-MSMTrec is a novel framework for personalized federated multi-scenario multi-task recommendation. We introduce a bottom-up joint learning mechanism to address the unique challenges of multiple optimization conflicts. Our proposed method outperforms state-of-the-art approaches.
• Score: 22.095138650857436
• License:
• Abstract: In modern recommender systems, especially in e-commerce, predicting multiple targets such as click-through rate (CTR) and post-view conversion rate (CTCVR) is common. Multi-task recommender systems are increasingly popular in both research and practice, as they leverage shared knowledge across diverse business scenarios to enhance performance. However, emerging real-world scenarios and data privacy concerns complicate the development of a unified multi-task recommendation model. In this paper, we propose PF-MSMTrec, a novel framework for personalized federated multi-scenario multi-task recommendation. In this framework, each scenario is assigned to a dedicated client utilizing the Multi-gate Mixture-of-Experts (MMoE) structure. To address the unique challenges of multiple optimization conflicts, we introduce a bottom-up joint learning mechanism. First, we design a parameter template to decouple the expert network parameters, distinguishing scenario-specific parameters as shared knowledge for federated parameter aggregation. Second, we implement personalized federated learning for each expert network during a federated communication round, using three modules: federated batch normalization, conflict coordination, and personalized aggregation. Finally, we conduct an additional round of personalized federated parameter aggregation on the task tower network to obtain prediction results for multiple tasks. Extensive experiments on two public datasets demonstrate that our proposed method outperforms state-of-the-art approaches. The source code and datasets will be released as open-source for public access.

Related papers

• A Unified Search and Recommendation Framework Based on Multi-Scenario Learning for Ranking in E-commerce [13.991015845541257]
  We propose an effective and universal framework for Unified Search and Recommendation (USR) USR can be applied to various multi-scenario models and significantly improve their performance. USR has been successfully deployed in the 7Fresh App.
  arXiv  Detail & Related papers  (2024-05-17T14:57:52Z)
• Learn What You Need in Personalized Federated Learning [53.83081622573734]
  $textitLearn2pFed$ is a novel algorithm-unrolling-based personalized federated learning framework. We show that $textitLearn2pFed$ significantly outperforms previous personalized federated learning methods.
  arXiv  Detail & Related papers  (2024-01-16T12:45:15Z)
• Prototype Helps Federated Learning: Towards Faster Convergence [38.517903009319994]
  Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. In this paper, a prototype-based federated learning framework is proposed, which can achieve better inference performance with only a few changes to the last global iteration of the typical federated learning process.
  arXiv  Detail & Related papers  (2023-03-22T04:06:29Z)
• HiNet: Novel Multi-Scenario & Multi-Task Learning with Hierarchical Information Extraction [50.40732146978222]
  Multi-scenario & multi-task learning has been widely applied to many recommendation systems in industrial applications. We propose a Hierarchical information extraction Network (HiNet) for multi-scenario and multi-task recommendation. HiNet achieves a new state-of-the-art performance and significantly outperforms existing solutions.
  arXiv  Detail & Related papers  (2023-03-10T17:24:41Z)
• Dual Personalization on Federated Recommendation [50.4115315992418]
  Federated recommendation is a new Internet service architecture that aims to provide privacy-preserving recommendation services in federated settings. This paper proposes a novel Personalized Federated Recommendation (PFedRec) framework to learn many user-specific lightweight models. We also propose a new dual personalization mechanism to effectively learn fine-grained personalization on both users and items.
  arXiv  Detail & Related papers  (2023-01-16T05:26:07Z)
• Federated Adaptive Prompt Tuning for Multi-Domain Collaborative Learning [44.604485649167216]
  Federated learning (FL) enables multiple clients to collaboratively train a global model without disclosing their data. We propose a federated adaptive prompt tuning algorithm, FedAPT, for multi-domain collaborative image classification.
  arXiv  Detail & Related papers  (2022-11-15T03:10:05Z)
• Automatic Expert Selection for Multi-Scenario and Multi-Task Search [41.47107282896807]
  We propose a novel Automatic Expert Selection framework for Multi-scenario and Multi-task search, named AESM2. Experiments over two real-world large-scale datasets demonstrate the effectiveness of AESM2 over a battery of strong baselines. Online A/B test also shows substantial performance gain on multiple metrics.
  arXiv  Detail & Related papers  (2022-05-28T03:41:25Z)
• Federated Multi-Target Domain Adaptation [99.93375364579484]
  Federated learning methods enable us to train machine learning models on distributed user data while preserving its privacy. We consider a more practical scenario where the distributed client data is unlabeled, and a centralized labeled dataset is available on the server. We propose an effective DualAdapt method to address the new challenges.
  arXiv  Detail & Related papers  (2021-08-17T17:53:05Z)
• Scenario-aware and Mutual-based approach for Multi-scenario Recommendation in E-Commerce [12.794276204716642]
  How to make accurate recommendations for users in heterogeneous e-commerce scenarios is still a continuous research topic. We propose a novel recommendation model named Scenario-aware Mutual Learning (SAML) that leverages the differences and similarities between multiple scenarios.
  arXiv  Detail & Related papers  (2020-12-16T13:52:14Z)
• Joint predictions of multi-modal ride-hailing demands: a deep multi-task multigraph learning-based approach [64.18639899347822]
  We propose a deep multi-task multi-graph learning approach, which combines multiple multi-graph convolutional (MGC) networks for predicting demands for different service modes. We show that our propose approach outperforms the benchmark algorithms in prediction accuracy for different ride-hailing modes.
  arXiv  Detail & Related papers  (2020-11-11T07:10:50Z)
• Federated Multi-view Matrix Factorization for Personalized Recommendations [53.74747022749739]
  We introduce the federated multi-view matrix factorization method that extends the federated learning framework to matrix factorization with multiple data sources. Our method is able to learn the multi-view model without transferring the user's personal data to a central server.
  arXiv  Detail & Related papers  (2020-04-08T21:07:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.