Deep Page-Level Interest Network in Reinforcement Learning for Ads
Allocation
- URL: http://arxiv.org/abs/2204.00377v1
- Date: Fri, 1 Apr 2022 11:58:00 GMT
- Title: Deep Page-Level Interest Network in Reinforcement Learning for Ads
Allocation
- Authors: Guogang Liao, Xiaowen Shi, Ze Wang, Xiaoxu Wu, Chuheng Zhang, Yongkang
Wang, Xingxing Wang, Dong Wang
- Abstract summary: We propose Deep Page-level Interest Network (DPIN) to model the page-level user preference and exploit multiple types of feedback.
Specifically, we introduce four different types of page-level feedback as input, and capture user preference for item arrangement under different receptive fields.
- Score: 14.9065245548275
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: A mixed list of ads and organic items is usually displayed in feed and how to
allocate the limited slots to maximize the overall revenue is a key problem.
Meanwhile, modeling user preference with historical behavior is essential in
recommendation and advertising (e.g., CTR prediction and ads allocation). Most
previous works for user behavior modeling only model user's historical
point-level positive feedback (i.e., click), which neglect the page-level
information of feedback and other types of feedback. To this end, we propose
Deep Page-level Interest Network (DPIN) to model the page-level user preference
and exploit multiple types of feedback. Specifically, we introduce four
different types of page-level feedback as input, and capture user preference
for item arrangement under different receptive fields through the multi-channel
interaction module. Through extensive offline and online experiments on Meituan
food delivery platform, we demonstrate that DPIN can effectively model the
page-level user preference and increase the revenue for the platform.
Related papers
- Modeling Domain and Feedback Transitions for Cross-Domain Sequential Recommendation [60.09293734134179]
$textTransition2$ is a novel method to model transitions across both domains and types of user feedback.
We introduce a transition-aware graph encoder based on user history, assigning different weights to edges according to the feedback type.
We encode the user history using a cross-transition multi-head self-attention, incorporating various masks to distinguish different types of transitions.
arXiv Detail & Related papers (2024-08-15T15:18:55Z) - MMGRec: Multimodal Generative Recommendation with Transformer Model [81.61896141495144]
MMGRec aims to introduce a generative paradigm into multimodal recommendation.
We first devise a hierarchical quantization method Graph CF-RQVAE to assign Rec-ID for each item from its multimodal information.
We then train a Transformer-based recommender to generate the Rec-IDs of user-preferred items based on historical interaction sequences.
arXiv Detail & Related papers (2024-04-25T12:11:27Z) - Latent User Intent Modeling for Sequential Recommenders [92.66888409973495]
Sequential recommender models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform.
Most sequential recommenders however lack a higher-level understanding of user intents, which often drive user behaviors online.
Intent modeling is thus critical for understanding users and optimizing long-term user experience.
arXiv Detail & Related papers (2022-11-17T19:00:24Z) - An F-shape Click Model for Information Retrieval on Multi-block Mobile
Pages [39.63441649184412]
We develop a novel F-shape Click Model to model user behaviors on multi-block mobile pages.
We conduct a user eye-tracking study, and identify users' sequential browsing, block skip and comparison patterns on F-shape pages.
Experiments on a large-scale real-world dataset validate the effectiveness of FSCM on user behavior predictions.
arXiv Detail & Related papers (2022-06-17T07:59:46Z) - Diverse Preference Augmentation with Multiple Domains for Cold-start
Recommendations [92.47380209981348]
We propose a Diverse Preference Augmentation framework with multiple source domains based on meta-learning.
We generate diverse ratings in a new domain of interest to handle overfitting on the case of sparse interactions.
These ratings are introduced into the meta-training procedure to learn a preference meta-learner, which produces good generalization ability.
arXiv Detail & Related papers (2022-04-01T10:10:50Z) - Modeling Users' Contextualized Page-wise Feedback for Click-Through Rate
Prediction in E-commerce Search [29.661232361168956]
We propose a new perspective for context-aware users' behavior modeling by including the whole page-wisely exposed products.
The intra-page context information and inter-page interest evolution can be captured to learn more specific user preference.
arXiv Detail & Related papers (2022-03-29T13:26:55Z) - Knowledge-Enhanced Hierarchical Graph Transformer Network for
Multi-Behavior Recommendation [56.12499090935242]
This work proposes a Knowledge-Enhanced Hierarchical Graph Transformer Network (KHGT) to investigate multi-typed interactive patterns between users and items in recommender systems.
KHGT is built upon a graph-structured neural architecture to capture type-specific behavior characteristics.
We show that KHGT consistently outperforms many state-of-the-art recommendation methods across various evaluation settings.
arXiv Detail & Related papers (2021-10-08T09:44:00Z) - Cross DQN: Cross Deep Q Network for Ads Allocation in Feed [11.752703912138944]
E-commerce platforms usually display a mixed list of ads and organic items in feed.
We propose Cross Deep Q Network to extract the arrangement signal by crossing the embeddings of different items.
Our model results in higher revenue and better user experience than state-of-the-art baselines in offline experiments.
arXiv Detail & Related papers (2021-09-09T15:44:13Z) - Mixture of Virtual-Kernel Experts for Multi-Objective User Profile
Modeling [9.639497198579257]
deep learning is widely used to mine expressive tags to describe users' preferences from their historical actions.
Traditional solutions usually introduce multiple independent Two-Tower models to mine tags from different actions.
This paper introduces a novel multi-task model called Mixture of Virtual- Kernel Experts (MVKE) to learn multiple topic-related user preferences.
arXiv Detail & Related papers (2021-06-04T07:52:52Z) - Modeling High-order Interactions across Multi-interests for Micro-video
Reommendation [65.16624625748068]
We propose a Self-over-Co Attention module to enhance user's interest representation.
In particular, we first use co-attention to model correlation patterns across different levels and then use self-attention to model correlation patterns within a specific level.
arXiv Detail & Related papers (2021-04-01T07:20:15Z) - Multi-Channel Sequential Behavior Networks for User Modeling in Online
Advertising [4.964012641964141]
This paper presents Multi-Channel Sequential Behavior Network (MC-SBN), a deep learning approach for embedding users and ads in a semantic space.
Our proposed user encoder architecture summarizes user activities from multiple input channels--such as previous search queries, visited pages, or clicked ads--into a user vector.
The results demonstrate that MC-SBN can improve the ranking of relevant ads and boost the performance of both click prediction and conversion prediction.
arXiv Detail & Related papers (2020-12-27T06:13:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.