Click-Conversion Multi-Task Model with Position Bias Mitigation for
Sponsored Search in eCommerce
- URL: http://arxiv.org/abs/2307.16060v1
- Date: Sat, 29 Jul 2023 19:41:16 GMT
- Title: Click-Conversion Multi-Task Model with Position Bias Mitigation for
Sponsored Search in eCommerce
- Authors: Yibo Wang, Yanbing Xue, Bo Liu, Musen Wen, Wenting Zhao, Stephen Guo,
Philip S. Yu
- Abstract summary: We propose two position-bias-free prediction models: Position-Aware Click-Conversion (PACC) and PACC via Position Embedding (PACC-PE)
Experiments on the E-commerce sponsored product search dataset show that our proposed models have better ranking effectiveness and can greatly alleviate position bias in both CTR and CVR prediction.
- Score: 51.211924408864355
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Position bias, the phenomenon whereby users tend to focus on higher-ranked
items of the search result list regardless of the actual relevance to queries,
is prevailing in many ranking systems. Position bias in training data biases
the ranking model, leading to increasingly unfair item rankings,
click-through-rate (CTR), and conversion rate (CVR) predictions. To jointly
mitigate position bias in both item CTR and CVR prediction, we propose two
position-bias-free CTR and CVR prediction models: Position-Aware
Click-Conversion (PACC) and PACC via Position Embedding (PACC-PE). PACC is
built upon probability decomposition and models position information as a
probability. PACC-PE utilizes neural networks to model product-specific
position information as embedding. Experiments on the E-commerce sponsored
product search dataset show that our proposed models have better ranking
effectiveness and can greatly alleviate position bias in both CTR and CVR
prediction.
Related papers
- Eliminating Position Bias of Language Models: A Mechanistic Approach [119.34143323054143]
Position bias has proven to be a prevalent issue of modern language models (LMs)
Our mechanistic analysis attributes the position bias to two components employed in nearly all state-of-the-art LMs: causal attention and relative positional encodings.
By eliminating position bias, models achieve better performance and reliability in downstream tasks, including LM-as-a-judge, retrieval-augmented QA, molecule generation, and math reasoning.
arXiv Detail & Related papers (2024-07-01T09:06:57Z) - Investigating the Robustness of Counterfactual Learning to Rank Models: A Reproducibility Study [61.64685376882383]
Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models.
This paper investigates the robustness of existing CLTR models in complex and diverse situations.
We find that the DLA models and IPS-DCM show better robustness under various simulation settings than IPS-PBM and PRS with offline propensity estimation.
arXiv Detail & Related papers (2024-04-04T10:54:38Z) - Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian
Eigenvalue Regularization [22.964109377128523]
Click-Through Rate (CTR) prediction holds paramount significance in online advertising and recommendation scenarios.
Despite the proliferation of recent CTR prediction models, the improvements in performance have remained limited.
arXiv Detail & Related papers (2024-02-23T15:00:46Z) - Rank-DETR for High Quality Object Detection [52.82810762221516]
A highly performant object detector requires accurate ranking for the bounding box predictions.
In this work, we introduce a simple and highly performant DETR-based object detector by proposing a series of rank-oriented designs.
arXiv Detail & Related papers (2023-10-13T04:48:32Z) - CSPM: A Contrastive Spatiotemporal Preference Model for CTR Prediction
in On-Demand Food Delivery Services [17.46228008447778]
This paper introduces Contrasttemporal representation learning (CSRL),temporal representation extractor (CSRPE), andtemporal information filter (StIF)
StIF incorporates SAR into a gating network to automatically capture important features with latenttemporal effects.
CSPM has been successfully deployed in Alibaba's online OFD platform Ele.me, resulting in a 0.88% lift in CTR, which has substantial business implications.
arXiv Detail & Related papers (2023-08-10T19:53:30Z) - Confidence Ranking for CTR Prediction [11.071444869776725]
We propose a novel framework, named Confidence Ranking, which designs the optimization objective as a ranking function.
Our experiments show that the introduction of confidence ranking loss can outperform all baselines on the CTR prediction tasks of public and industrial datasets.
This framework has been deployed in the advertisement system of JD.com to serve the main traffic in the fine-rank stage.
arXiv Detail & Related papers (2023-06-28T07:31:00Z) - Meta-Wrapper: Differentiable Wrapping Operator for User Interest
Selection in CTR Prediction [97.99938802797377]
Click-through rate (CTR) prediction, whose goal is to predict the probability of the user to click on an item, has become increasingly significant in recommender systems.
Recent deep learning models with the ability to automatically extract the user interest from his/her behaviors have achieved great success.
We propose a novel approach under the framework of the wrapper method, which is named Meta-Wrapper.
arXiv Detail & Related papers (2022-06-28T03:28:15Z) - Cross Pairwise Ranking for Unbiased Item Recommendation [57.71258289870123]
We develop a new learning paradigm named Cross Pairwise Ranking (CPR)
CPR achieves unbiased recommendation without knowing the exposure mechanism.
We prove in theory that this way offsets the influence of user/item propensity on the learning.
arXiv Detail & Related papers (2022-04-26T09:20:27Z) - Rethinking Position Bias Modeling with Knowledge Distillation for CTR
Prediction [8.414183573280779]
This work proposes a knowledge distillation framework to alleviate the impact of position bias and leverage position information to improve CTR prediction.
The proposed method has been deployed in the real world online ads systems, serving main traffic on one of the world's largest e-commercial platforms.
arXiv Detail & Related papers (2022-04-01T07:58:38Z) - Doubly Robust Off-Policy Evaluation for Ranking Policies under the
Cascade Behavior Model [11.101369123145588]
Off-policy evaluation for ranking policies enables performance estimation of new ranking policies using only logged data.
Previous studies introduce some assumptions on user behavior to make the item space tractable.
We propose the Cascade Doubly Robust estimator, which assumes that a user interacts with items sequentially from the top position in a ranking.
arXiv Detail & Related papers (2022-02-03T12:42:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.