A Nonparametric Bayes Approach to Online Activity Prediction
- URL: http://arxiv.org/abs/2401.14722v1
- Date: Fri, 26 Jan 2024 09:11:42 GMT
- Title: A Nonparametric Bayes Approach to Online Activity Prediction
- Authors: Mario Beraha, Lorenzo Masoero, Stefano Favaro, Thomas S. Richardson
- Abstract summary: We propose a novel approach to predict the number of users that will be active in a given time period.
We derive closed-form expressions for the number of new users expected in a given period, and a simple Monte Carlo algorithm targeting the posterior distribution of the number of days needed to attain a desired number of users.
- Score: 11.934335703226404
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurately predicting the onset of specific activities within defined
timeframes holds significant importance in several applied contexts. In
particular, accurate prediction of the number of future users that will be
exposed to an intervention is an important piece of information for
experimenters running online experiments (A/B tests). In this work, we propose
a novel approach to predict the number of users that will be active in a given
time period, as well as the temporal trajectory needed to attain a desired user
participation threshold. We model user activity using a Bayesian nonparametric
approach which allows us to capture the underlying heterogeneity in user
engagement. We derive closed-form expressions for the number of new users
expected in a given period, and a simple Monte Carlo algorithm targeting the
posterior distribution of the number of days needed to attain a desired number
of users; the latter is important for experimental planning. We illustrate the
performance of our approach via several experiments on synthetic and real world
data, in which we show that our novel method outperforms existing competitors.
Related papers
- New User Event Prediction Through the Lens of Causal Inference [20.676353189313737]
We propose a novel discrete event prediction framework for new users.
Our method offers an unbiased prediction for new users without needing to know their categories.
We demonstrate the superior performance of the proposed framework with a numerical simulation study and two real-world applications.
arXiv Detail & Related papers (2024-07-08T05:35:54Z) - Improved prediction of future user activity in online A/B testing [9.824661943331119]
In online randomized experiments or A/B tests, accurate predictions of participant inclusion rates are of paramount importance.
We present a novel, straightforward, and scalable Bayesian nonparametric approach for predicting the rate at which individuals will be exposed to interventions.
arXiv Detail & Related papers (2024-02-05T17:44:21Z) - Improving Event Time Prediction by Learning to Partition the Event Time
Space [13.5391816206237]
Recently developed survival analysis methods improve upon existing approaches by predicting the probability of event occurrence in each of a number pre-specified (discrete) time intervals.
In clinical settings with limited available data, it is often preferable to judiciously partition the event time space into a limited number of intervals well suited to the prediction task at hand.
We show that in two simulated datasets, we are able to recover intervals that match the underlying generative model.
We then demonstrate improved prediction performance on three real-world observational datasets, including a large, newly harmonized stroke risk prediction dataset.
arXiv Detail & Related papers (2023-10-24T14:11:40Z) - ASPEST: Bridging the Gap Between Active Learning and Selective
Prediction [56.001808843574395]
Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain.
Active learning aims to lower the overall labeling effort, and hence human dependence, by querying the most informative examples.
In this work, we introduce a new learning paradigm, active selective prediction, which aims to query more informative samples from the shifted target domain.
arXiv Detail & Related papers (2023-04-07T23:51:07Z) - Towards Out-of-Distribution Sequential Event Prediction: A Causal
Treatment [72.50906475214457]
The goal of sequential event prediction is to estimate the next event based on a sequence of historical events.
In practice, the next-event prediction models are trained with sequential data collected at one time.
We propose a framework with hierarchical branching structures for learning context-specific representations.
arXiv Detail & Related papers (2022-10-24T07:54:13Z) - Personalizing Intervened Network for Long-tailed Sequential User
Behavior Modeling [66.02953670238647]
Tail users suffer from significantly lower-quality recommendation than the head users after joint training.
A model trained on tail users separately still achieve inferior results due to limited data.
We propose a novel approach that significantly improves the recommendation performance of the tail users.
arXiv Detail & Related papers (2022-08-19T02:50:19Z) - PinnerFormer: Sequence Modeling for User Representation at Pinterest [60.335384724891746]
We introduce PinnerFormer, a user representation trained to predict a user's future long-term engagement.
Unlike prior approaches, we adapt our modeling to a batch infrastructure via our new dense all-action loss.
We show that by doing so, we significantly close the gap between batch user embeddings that are generated once a day and realtime user embeddings generated whenever a user takes an action.
arXiv Detail & Related papers (2022-05-09T18:26:51Z) - Sequential Search with Off-Policy Reinforcement Learning [48.88165680363482]
We propose a highly scalable hybrid learning model that consists of an RNN learning framework and an attention model.
As a novel optimization step, we fit multiple short user sequences in a single RNN pass within a training batch, by solving a greedy knapsack problem on the fly.
We also explore the use of off-policy reinforcement learning in multi-session personalized search ranking.
arXiv Detail & Related papers (2022-02-01T06:52:40Z) - Bayesian Sample Size Prediction for Online Activity [5.685803049176655]
It is useful to predict the number of individuals in some population who will initiate a particular activity during a given period.
We present a simple but novel Bayesian method for predicting the number of additional individuals who will subsequently participate during a subsequent period.
arXiv Detail & Related papers (2021-11-23T21:16:17Z) - Dynamic Embeddings for Interaction Prediction [2.5758502140236024]
In recommender systems (RSs), predicting the next item that a user interacts with is critical for user retention.
Recent studies have shown the effectiveness of modeling the mutual interactions between users and items using separate user and item embeddings.
We propose a novel method called DeePRed that addresses some of their limitations.
arXiv Detail & Related papers (2020-11-10T16:04:46Z) - A Multi-Channel Neural Graphical Event Model with Negative Evidence [76.51278722190607]
Event datasets are sequences of events of various types occurring irregularly over the time-line.
We propose a non-parametric deep neural network approach in order to estimate the underlying intensity functions.
arXiv Detail & Related papers (2020-02-21T23:10:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.