Meta-Wrapper: Differentiable Wrapping Operator for User Interest
Selection in CTR Prediction
- URL: http://arxiv.org/abs/2206.14647v1
- Date: Tue, 28 Jun 2022 03:28:15 GMT
- Title: Meta-Wrapper: Differentiable Wrapping Operator for User Interest
Selection in CTR Prediction
- Authors: Tianwei Cao, Qianqian Xu, Zhiyong Yang, and Qingming Huang
- Abstract summary: Click-through rate (CTR) prediction, whose goal is to predict the probability of the user to click on an item, has become increasingly significant in recommender systems.
Recent deep learning models with the ability to automatically extract the user interest from his/her behaviors have achieved great success.
We propose a novel approach under the framework of the wrapper method, which is named Meta-Wrapper.
- Score: 97.99938802797377
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Click-through rate (CTR) prediction, whose goal is to predict the probability
of the user to click on an item, has become increasingly significant in the
recommender systems. Recently, some deep learning models with the ability to
automatically extract the user interest from his/her behaviors have achieved
great success. In these work, the attention mechanism is used to select the
user interested items in historical behaviors, improving the performance of the
CTR predictor. Normally, these attentive modules can be jointly trained with
the base predictor by using gradient descents. In this paper, we regard user
interest modeling as a feature selection problem, which we call user interest
selection. For such a problem, we propose a novel approach under the framework
of the wrapper method, which is named Meta-Wrapper. More specifically, we use a
differentiable module as our wrapping operator and then recast its learning
problem as a continuous bilevel optimization. Moreover, we use a meta-learning
algorithm to solve the optimization and theoretically prove its convergence.
Meanwhile, we also provide theoretical analysis to show that our proposed
method 1) efficiencies the wrapper-based feature selection, and 2) achieves
better resistance to overfitting. Finally, extensive experiments on three
public datasets manifest the superiority of our method in boosting the
performance of CTR prediction.
Related papers
- Incorporating Group Prior into Variational Inference for Tail-User Behavior Modeling in CTR Prediction [8.213386595519928]
We propose a novel variational inference approach, namely Group Prior Sampler Variational Inference (GPSVI)
GPSVI introduces group preferences as priors to refine latent user interests for tail users.
Rigorous analysis and extensive experiments demonstrate that GPSVI consistently improves the performance of tail users.
arXiv Detail & Related papers (2024-10-19T13:15:36Z) - Sample Complexity of Preference-Based Nonparametric Off-Policy
Evaluation with Deep Networks [58.469818546042696]
We study the sample efficiency of OPE with human preference and establish a statistical guarantee for it.
By appropriately selecting the size of a ReLU network, we show that one can leverage any low-dimensional manifold structure in the Markov decision process.
arXiv Detail & Related papers (2023-10-16T16:27:06Z) - RESUS: Warm-Up Cold Users via Meta-Learning Residual User Preferences in
CTR Prediction [14.807495564177252]
Click-Through Rate (CTR) prediction on cold users is a challenging task in recommender systems.
We propose a novel and efficient approach named RESUS, which decouples the learning of global preference knowledge contributed by collective users from the learning of residual preferences for individual users.
Our approach is efficient and effective in improving CTR prediction accuracy on cold users, compared with various state-of-the-art methods.
arXiv Detail & Related papers (2022-10-28T11:57:58Z) - HyperImpute: Generalized Iterative Imputation with Automatic Model
Selection [77.86861638371926]
We propose a generalized iterative imputation framework for adaptively and automatically configuring column-wise models.
We provide a concrete implementation with out-of-the-box learners, simulators, and interfaces.
arXiv Detail & Related papers (2022-06-15T19:10:35Z) - A High-Performance Customer Churn Prediction System based on
Self-Attention [9.83578821760002]
This work conducts experiments on publicly available dataset related to commercial bank customers.
A novel algorithm, a hybrid neural network with self-attention enhancement (HNNSAE), is proposed in this paper.
arXiv Detail & Related papers (2022-06-03T12:16:24Z) - Learning to Learn a Cold-start Sequential Recommender [70.5692886883067]
The cold-start recommendation is an urgent problem in contemporary online applications.
We propose a meta-learning based cold-start sequential recommendation framework called metaCSR.
metaCSR holds the ability to learn the common patterns from regular users' behaviors.
arXiv Detail & Related papers (2021-10-18T08:11:24Z) - Memorize, Factorize, or be Na\"ive: Learning Optimal Feature Interaction
Methods for CTR Prediction [29.343267933348372]
We propose a framework called OptInter which finds the most suitable modelling method for each feature interaction.
Our experiments show that OptInter improves the best performed state-of-the-art baseline deep CTR models by up to 2.21%.
arXiv Detail & Related papers (2021-08-03T03:03:34Z) - Adversarial Feature Augmentation and Normalization for Visual
Recognition [109.6834687220478]
Recent advances in computer vision take advantage of adversarial data augmentation to ameliorate the generalization ability of classification models.
Here, we present an effective and efficient alternative that advocates adversarial augmentation on intermediate feature embeddings.
We validate the proposed approach across diverse visual recognition tasks with representative backbone networks.
arXiv Detail & Related papers (2021-03-22T20:36:34Z) - Towards Open-World Recommendation: An Inductive Model-based
Collaborative Filtering Approach [115.76667128325361]
Recommendation models can effectively estimate underlying user interests and predict one's future behaviors.
We propose an inductive collaborative filtering framework that contains two representation models.
Our model achieves promising results for recommendation on few-shot users with limited training ratings and new unseen users.
arXiv Detail & Related papers (2020-07-09T14:31:25Z) - Outlier Detection Ensemble with Embedded Feature Selection [42.8338013000469]
We propose an outlier detection ensemble framework with embedded feature selection (ODEFS)
For each random sub-sampling based learning component, ODEFS unifies feature selection and outlier detection into a pairwise ranking formulation.
We adopt the thresholded self-paced learning to simultaneously optimize feature selection and example selection.
arXiv Detail & Related papers (2020-01-15T13:14:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.