PIE: Personalized Interest Exploration for Large-Scale Recommender
Systems
- URL: http://arxiv.org/abs/2304.06844v1
- Date: Thu, 13 Apr 2023 22:25:09 GMT
- Title: PIE: Personalized Interest Exploration for Large-Scale Recommender
Systems
- Authors: Khushhall Chandra Mahajan, Amey Porobo Dharwadker, Romil Shah, Simeng
Qu, Gaurav Bang, Brad Schumitsch
- Abstract summary: We present a framework for exploration in large-scale recommender systems to address these challenges.
Our methodology can be easily integrated into an existing large-scale recommender system with minimal modifications.
Our work has been deployed in production on Facebook Watch, a popular video discovery and sharing platform serving billions of users.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Recommender systems are increasingly successful in recommending personalized
content to users. However, these systems often capitalize on popular content.
There is also a continuous evolution of user interests that need to be
captured, but there is no direct way to systematically explore users'
interests. This also tends to affect the overall quality of the recommendation
pipeline as training data is generated from the candidates presented to the
user. In this paper, we present a framework for exploration in large-scale
recommender systems to address these challenges. It consists of three parts,
first the user-creator exploration which focuses on identifying the best
creators that users are interested in, second the online exploration framework
and third a feed composition mechanism that balances explore and exploit to
ensure optimal prevalence of exploratory videos. Our methodology can be easily
integrated into an existing large-scale recommender system with minimal
modifications. We also analyze the value of exploration by defining relevant
metrics around user-creator connections and understanding how this helps the
overall recommendation pipeline with strong online gains in creator and
ecosystem value. In contrast to the regression on user engagement metrics
generally seen while exploring, our method is able to achieve significant
improvements of 3.50% in strong creator connections and 0.85% increase in novel
creator connections. Moreover, our work has been deployed in production on
Facebook Watch, a popular video discovery and sharing platform serving billions
of users.
Related papers
- System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes [80.97898201876592]
We propose a generative model in which past content interactions impact the arrival rates of users based on a self-exciting Hawkes process.
We show analytically that given samples it is possible to disentangle System-1 and System-2 and allow content optimization based on user utility.
arXiv Detail & Related papers (2024-05-29T18:19:37Z) - Embedding in Recommender Systems: A Survey [67.67966158305603]
A crucial aspect is embedding techniques that covert the high-dimensional discrete features, such as user and item IDs, into low-dimensional continuous vectors.
Applying embedding techniques captures complex entity relationships and has spurred substantial research.
This survey covers embedding methods like collaborative filtering, self-supervised learning, and graph-based techniques.
arXiv Detail & Related papers (2023-10-28T06:31:06Z) - Graph Exploration Matters: Improving both individual-level and
system-level diversity in WeChat Feed Recommender [21.0013026365164]
Individual-level diversity and system-level diversity are both important for industrial recommender systems.
We implement and deploy the combined system in WeChat App's Top Stories used by hundreds of millions of users.
arXiv Detail & Related papers (2023-05-29T19:25:32Z) - Incentive-Aware Recommender Systems in Two-Sided Markets [49.692453629365204]
We propose a novel recommender system that aligns with agents' incentives while achieving myopically optimal performance.
Our framework models this incentive-aware system as a multi-agent bandit problem in two-sided markets.
Both algorithms satisfy an ex-post fairness criterion, which protects agents from over-exploitation.
arXiv Detail & Related papers (2022-11-23T22:20:12Z) - Personalizing Intervened Network for Long-tailed Sequential User
Behavior Modeling [66.02953670238647]
Tail users suffer from significantly lower-quality recommendation than the head users after joint training.
A model trained on tail users separately still achieve inferior results due to limited data.
We propose a novel approach that significantly improves the recommendation performance of the tail users.
arXiv Detail & Related papers (2022-08-19T02:50:19Z) - Improving Rating and Relevance with Point-of-Interest Recommender System [0.0]
We develop a deep neural network architecture to model query-item relevance in the presence of both collaborative and content information.
The application of these learned representations to a large-scale dataset resulted in significant improvements.
arXiv Detail & Related papers (2022-02-17T16:43:17Z) - An Empirical analysis on Transparent Algorithmic Exploration in
Recommender Systems [17.91522677924348]
We propose a new approach for feedback elicitation without any deception and compare our approach to the conventional mix-in approach for evaluation.
Our results indicated that users left significantly more feedback on items chosen for exploration with our interface.
arXiv Detail & Related papers (2021-07-31T05:08:29Z) - PURS: Personalized Unexpected Recommender System for Improving User
Satisfaction [76.98616102965023]
We describe a novel Personalized Unexpected Recommender System (PURS) model that incorporates unexpectedness into the recommendation process.
Extensive offline experiments on three real-world datasets illustrate that the proposed PURS model significantly outperforms the state-of-the-art baseline approaches.
arXiv Detail & Related papers (2021-06-05T01:33:21Z) - Incentivizing Exploration in Linear Bandits under Information Gap [50.220743323750035]
We study the problem of incentivizing exploration for myopic users in linear bandits.
In order to maximize the long-term reward, the system offers compensation to incentivize the users to pull the exploratory arms.
arXiv Detail & Related papers (2021-04-08T16:01:56Z) - Exploration-Exploitation Motivated Variational Auto-Encoder for
Recommender Systems [1.52292571922932]
We introduce an exploitation-exploration motivated variational auto-encoder (XploVAE) to collaborative filtering.
To facilitate personalized recommendations, we construct user-specific subgraphs, which contain the first-order proximity capturing observed user-item interactions.
A hierarchical latent space model is utilized to learn the personalized item embedding for a given user, along with the population distribution of all user subgraphs.
arXiv Detail & Related papers (2020-06-05T17:37:46Z) - Recommendation system using a deep learning and graph analysis approach [1.2183405753834562]
We propose a novel recommendation method based on Matrix Factorization and graph analysis methods.
In addition, we leverage deep Autoencoders to initialize users and items latent factors, and deep embedding method gathers users' latent factors from the user trust graph.
arXiv Detail & Related papers (2020-04-17T08:05:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.