A Self-Supervised Mixture-of-Experts Framework for Multi-behavior Recommendation

• URL: http://arxiv.org/abs/2508.19507v2
• Date: Thu, 28 Aug 2025 01:05:32 GMT
• Title: A Self-Supervised Mixture-of-Experts Framework for Multi-behavior Recommendation
• Authors: Kyungho Kim, Sunwoo Kim, Geon Lee, Kijung Shin,
• Abstract summary: We propose a novel multi-behavior recommender system for e-commerce.<n>It employs a mixture-of-experts framework, with experts designed to recommend the two item types, respectively.<n>It achieves up to 65.46% performance gain over the best competitor in terms of Hit Ratio@20.
• Score: 40.823640493268634
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In e-commerce, where users face a vast array of possible item choices, recommender systems are vital for helping them discover suitable items they might otherwise overlook. While many recommender systems primarily rely on a user's purchase history, recent multi-behavior recommender systems incorporate various auxiliary user behaviors, such as item clicks and cart additions, to enhance recommendations. Despite their overall performance gains, their effectiveness varies considerably between visited items (i.e., those a user has interacted with through auxiliary behaviors) and unvisited items (i.e., those with which the user has had no such interactions). Specifically, our analysis reveals that (1) existing multi-behavior recommender systems exhibit a significant gap in recommendation quality between the two item types (visited and unvisited items) and (2) achieving strong performance on both types with a single model architecture remains challenging. To tackle these issues, we propose a novel multi-behavior recommender system, MEMBER. It employs a mixture-of-experts framework, with experts designed to recommend the two item types, respectively. Each expert is trained using a self-supervised method specialized for its design goal. In our comprehensive experiments, we show the effectiveness of MEMBER across both item types, achieving up to 65.46% performance gain over the best competitor in terms of Hit Ratio@20.

Related papers

• Multi-Interest Recommendation: A Survey [67.28277752101006]
  Multi-interest recommendation addresses the challenge of extracting multiple interest representations from users' historical interactions.<n>It has drawn broad interest in recommendation research.<n>We systematically review the progress, solutions, challenges, and future directions of multi-interest recommendation.
  arXiv  Detail & Related papers  (2025-06-18T09:05:32Z)
• Multi-Behavior Recommender Systems: A Survey [30.22869600008911]
  Multi-behavior recommender systems leverage diverse interactions to enhance recommendation quality.<n>We systematically categorize existing multi-behavior recommender systems based on the commonalities and differences in their approaches.<n>We discuss promising future directions for advancing multi-behavior recommender systems.
  arXiv  Detail & Related papers  (2025-03-10T06:22:37Z)
• Why Not Together? A Multiple-Round Recommender System for Queries and Items [37.709748983831034]
  A fundamental technique of recommender systems involves modeling user preferences, where queries and items are widely used as symbolic representations of user interests.<n>We propose a novel approach named Multiple-round Auto Guess-and-Update System (MAGUS) that capitalizes on the synergies between both types.
  arXiv  Detail & Related papers  (2024-12-14T10:49:00Z)
• Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations [15.143224593682012]
  We propose a novel recommendation strategy that combines relevance and diversity by a copula function. We use diversity as a surrogate of the amount of knowledge obtained by the user while interacting with the system. Our strategy outperforms several state-of-the-art competitors.
  arXiv  Detail & Related papers  (2024-08-07T13:48:24Z)
• User-Creator Feature Polarization in Recommender Systems with Dual Influence [19.506536850645343]
  recommender systems serve the dual purpose of presenting relevant content to users and helping content creators reach their target audience. We define a model, called user-creator feature dynamics, to capture the dual influence of recommender systems. We investigate, both theoretically and empirically, approaches for mitigating polarization and promoting diversity in recommender systems.
  arXiv  Detail & Related papers  (2024-07-19T07:58:26Z)
• Knowledge Enhancement for Multi-Behavior Contrastive Recommendation [39.50243004656453]
  We propose a Knowledge Enhancement Multi-Behavior Contrastive Learning Recommendation (KMCLR) framework. In this work, we design the multi-behavior learning module to extract users' personalized behavior information for user-embedding enhancement. In the optimization stage, we model the coarse-grained commonalities and the fine-grained differences between multi-behavior of users to further improve the recommendation effect.
  arXiv  Detail & Related papers  (2023-01-13T06:24:33Z)
• ItemSage: Learning Product Embeddings for Shopping Recommendations at Pinterest [60.841761065439414]
  At Pinterest, we build a single set of product embeddings called ItemSage to provide relevant recommendations in all shopping use cases. This approach has led to significant improvements in engagement and conversion metrics, while reducing both infrastructure and maintenance cost.
  arXiv  Detail & Related papers  (2022-05-24T02:28:58Z)
• A Review on Pushing the Limits of Baseline Recommendation Systems with the integration of Opinion Mining & Information Retrieval Techniques [0.0]
  Recommendation Systems allow users to identify trending items among a community while being timely and relevant to the user's expectations. Deep Learning methods have been brought forward to achieve better quality recommendations. Researchers have tried to expand on the capabilities of standard recommendation systems to provide the most effective recommendations.
  arXiv  Detail & Related papers  (2022-05-03T22:13:33Z)
• Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation [56.12499090935242]
  This work proposes a Knowledge-Enhanced Hierarchical Graph Transformer Network (KHGT) to investigate multi-typed interactive patterns between users and items in recommender systems. KHGT is built upon a graph-structured neural architecture to capture type-specific behavior characteristics. We show that KHGT consistently outperforms many state-of-the-art recommendation methods across various evaluation settings.
  arXiv  Detail & Related papers  (2021-10-08T09:44:00Z)
• On component interactions in two-stage recommender systems [82.38014314502861]
  Two-stage recommenders are used by many online platforms, including YouTube, LinkedIn, and Pinterest. We show that interactions between the ranker and the nominators substantially affect the overall performance. In particular, using a Mixture-of-Experts approach, we train the nominators to specialize on different subsets of the item pool.
  arXiv  Detail & Related papers  (2021-06-28T20:53:23Z)
• Controllable Multi-Interest Framework for Recommendation [64.30030600415654]
  We formalize the recommender system as a sequential recommendation problem. We propose a novel controllable multi-interest framework for the sequential recommendation, called ComiRec. Our framework has been successfully deployed on the offline Alibaba distributed cloud platform.
  arXiv  Detail & Related papers  (2020-05-19T10:18:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.