Towards a Theoretical Understanding of Two-Stage Recommender Systems
- URL: http://arxiv.org/abs/2403.00802v1
- Date: Fri, 23 Feb 2024 21:11:55 GMT
- Title: Towards a Theoretical Understanding of Two-Stage Recommender Systems
- Authors: Amit Kumar Jaiswal
- Abstract summary: Production-grade recommender systems rely heavily on a large-scale corpus used by online media services, including Netflix, Pinterest, and Amazon.
We study the behaviors of the two-stage recommender that entail a strong convergence to the optimal recommender system.
We show numerically that the two-stage recommender enables encapsulating the impacts of items' and users' attributes on ratings.
- Score: 0.5439020425819
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Production-grade recommender systems rely heavily on a large-scale corpus
used by online media services, including Netflix, Pinterest, and Amazon. These
systems enrich recommendations by learning users' and items' embeddings
projected in a low-dimensional space with two-stage models (two deep neural
networks), which facilitate their embedding constructs to predict users'
feedback associated with items. Despite its popularity for recommendations, its
theoretical behaviors remain comprehensively unexplored. We study the
asymptotic behaviors of the two-stage recommender that entail a strong
convergence to the optimal recommender system. We establish certain theoretical
properties and statistical assurance of the two-stage recommender. In addition
to asymptotic behaviors, we demonstrate that the two-stage recommender system
attains faster convergence by relying on the intrinsic dimensions of the input
features. Finally, we show numerically that the two-stage recommender enables
encapsulating the impacts of items' and users' attributes on ratings, resulting
in better performance compared to existing methods conducted using synthetic
and real-world data experiments.
Related papers
- A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems [67.52782366565658]
State-of-the-art recommender systems (RSs) depend on categorical features, which ecoded by embedding vectors, resulting in excessively large embedding tables.
Despite the prosperity of lightweight embedding-based RSs, a wide diversity is seen in evaluation protocols.
This study investigates various LERS' performance, efficiency, and cross-task transferability via a thorough benchmarking process.
arXiv Detail & Related papers (2024-06-25T07:45:00Z) - Understanding or Manipulation: Rethinking Online Performance Gains of
Modern Recommender Systems [38.75457258877731]
We present a framework for benchmarking the degree of manipulations of recommendation algorithms.
We find that a high online click-through rate does not necessarily mean a better understanding of user initial preference.
We advocate that future recommendation algorithm studies should be treated as an optimization problem with constrained user preference manipulations.
arXiv Detail & Related papers (2022-10-11T17:56:55Z) - D2RLIR : an improved and diversified ranking function in interactive
recommendation systems based on deep reinforcement learning [0.3058685580689604]
This paper proposes a deep reinforcement learning based recommendation system by utilizing Actor-Critic architecture.
The proposed model is able to generate a diverse while relevance recommendation list based on the user's preferences.
arXiv Detail & Related papers (2021-10-28T13:11:29Z) - Recommendation Fairness: From Static to Dynamic [12.080824433982993]
We discuss how fairness could be baked into reinforcement learning techniques for recommendation.
We argue that in order to make further progress in recommendation fairness, we may want to consider multi-agent (game-theoretic) optimization, multi-objective (Pareto) optimization.
arXiv Detail & Related papers (2021-09-05T21:38:05Z) - On component interactions in two-stage recommender systems [82.38014314502861]
Two-stage recommenders are used by many online platforms, including YouTube, LinkedIn, and Pinterest.
We show that interactions between the ranker and the nominators substantially affect the overall performance.
In particular, using a Mixture-of-Experts approach, we train the nominators to specialize on different subsets of the item pool.
arXiv Detail & Related papers (2021-06-28T20:53:23Z) - A Survey on Neural Recommendation: From Collaborative Filtering to
Content and Context Enriched Recommendation [70.69134448863483]
Research in recommendation has shifted to inventing new recommender models based on neural networks.
In recent years, we have witnessed significant progress in developing neural recommender models.
arXiv Detail & Related papers (2021-04-27T08:03:52Z) - Exploration in two-stage recommender systems [79.50534282841618]
Two-stage recommender systems are widely adopted in industry due to their scalability and maintainability.
A key challenge of this setup is that optimal performance of each stage in isolation does not imply optimal global performance.
We propose a method of synchronising the exploration strategies between the ranker and the nominators.
arXiv Detail & Related papers (2020-09-01T16:52:51Z) - Counterfactual Evaluation of Slate Recommendations with Sequential
Reward Interactions [18.90946044396516]
Music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner.
Providing and evaluating good sequences of recommendations is therefore a central problem for these services.
We propose a new counterfactual estimator that allows for sequential interactions in the rewards with lower variance in anally unbiased manner.
arXiv Detail & Related papers (2020-07-25T17:58:01Z) - Convolutional Gaussian Embeddings for Personalized Recommendation with
Uncertainty [17.258674767363345]
Most existing embedding based recommendation models use embeddings corresponding to a single fixed point in low-dimensional space.
We propose a unified deep recommendation framework employing Gaussian embeddings, which are proven adaptive to uncertain preferences.
Our framework adopts Monte-Carlo sampling and convolutional neural networks to compute the correlation between the objective user and the candidate item.
arXiv Detail & Related papers (2020-06-19T02:10:38Z) - Self-Supervised Reinforcement Learning for Recommender Systems [77.38665506495553]
We propose self-supervised reinforcement learning for sequential recommendation tasks.
Our approach augments standard recommendation models with two output layers: one for self-supervised learning and the other for RL.
Based on such an approach, we propose two frameworks namely Self-Supervised Q-learning(SQN) and Self-Supervised Actor-Critic(SAC)
arXiv Detail & Related papers (2020-06-10T11:18:57Z) - Sequential Recommendation with Self-Attentive Multi-Adversarial Network [101.25533520688654]
We present a Multi-Factor Generative Adversarial Network (MFGAN) for explicitly modeling the effect of context information on sequential recommendation.
Our framework is flexible to incorporate multiple kinds of factor information, and is able to trace how each factor contributes to the recommendation decision over time.
arXiv Detail & Related papers (2020-05-21T12:28:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.