Diffusion-aware Censored Gaussian Processes for Demand Modelling
- URL: http://arxiv.org/abs/2501.12354v1
- Date: Tue, 21 Jan 2025 18:33:08 GMT
- Title: Diffusion-aware Censored Gaussian Processes for Demand Modelling
- Authors: Filipe Rodrigues,
- Abstract summary: This paper proposes Diffusion-aware Censored Demand Models.
It is based on both simulated and real-world data for modeling sales, bike-sharing demand, and EV charging demand.
- Score: 4.287761102353978
- License:
- Abstract: Inferring the true demand for a product or a service from aggregate data is often challenging due to the limited available supply, thus resulting in observations that are censored and correspond to the realized demand, thereby not accounting for the unsatisfied demand. Censored regression models are able to account for the effect of censoring due to the limited supply, but they don't consider the effect of substitutions, which may cause the demand for similar alternative products or services to increase. This paper proposes Diffusion-aware Censored Demand Models, which combine a Tobit likelihood with a graph diffusion process in order to model the latent process of transfer of unsatisfied demand between similar products or services. We instantiate this new class of models under the framework of GPs and, based on both simulated and real-world data for modeling sales, bike-sharing demand, and EV charging demand, demonstrate its ability to better recover the true demand and produce more accurate out-of-sample predictions.
Related papers
- Refusal Tokens: A Simple Way to Calibrate Refusals in Large Language Models [67.6909704128702]
A key component of building safe and reliable language models is enabling the models to appropriately refuse to answer certain questions.
We propose refusal tokens, one such token for each refusal category or a single refusal token, which are prepended to the model's responses during training.
arXiv Detail & Related papers (2024-12-09T18:40:44Z) - LLMForecaster: Improving Seasonal Event Forecasts with Unstructured Textual Data [63.777637042161544]
This paper introduces a novel forecast post-processor that fine-tunes large language models to incorporate unstructured semantic and contextual information and historical data.
In an industry-scale retail application, we demonstrate that our technique yields statistically significantly forecast improvements across several sets of products subject to holiday-driven demand surges.
arXiv Detail & Related papers (2024-12-03T16:18:42Z) - On conditional diffusion models for PDE simulations [53.01911265639582]
We study score-based diffusion models for forecasting and assimilation of sparse observations.
We propose an autoregressive sampling approach that significantly improves performance in forecasting.
We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
arXiv Detail & Related papers (2024-10-21T18:31:04Z) - Mind the Gap: Modelling Difference Between Censored and Uncensored
Electric Vehicle Charging Demand [7.992550355579791]
We study how occupied charging stations and competing services censor demand using GPS trajectories from cars in Copenhagen, Denmark.
We find that censorship occurs up to $61%$ of the time in some areas of the city.
We use the observed charging demand from our study to estimate the true demand and find that censorship-aware models provide better prediction and uncertainty estimation of actual demand.
arXiv Detail & Related papers (2023-01-16T13:19:18Z) - A Generative Approach for Production-Aware Industrial Network Traffic
Modeling [70.46446906513677]
We investigate the network traffic data generated from a laser cutting machine deployed in a Trumpf factory in Germany.
We analyze the traffic statistics, capture the dependencies between the internal states of the machine, and model the network traffic as a production state dependent process.
We compare the performance of various generative models including variational autoencoder (VAE), conditional variational autoencoder (CVAE), and generative adversarial network (GAN)
arXiv Detail & Related papers (2022-11-11T09:46:58Z) - End-to-End Demand Response Model Identification and Baseline Estimation
with Deep Learning [3.553493344868414]
This paper proposes a novel end-to-end deep learning framework that simultaneously identifies demand baselines and the incentive-based agent demand response model.
We demonstrate the effectiveness of our approach through computation experiments with synthetic demand response traces and a large-scale real world demand response dataset.
arXiv Detail & Related papers (2021-09-02T06:43:37Z) - Modeling Censored Mobility Demand through Quantile Regression Neural
Networks [21.528321119061694]
We show that CQRNN can estimate the intended distributions better than both censorship-unaware models and parametric censored models.
Results show that CQRNN can estimate the intended distributions better than both censorship-unaware models and parametric censored models.
arXiv Detail & Related papers (2021-04-02T19:24:15Z) - Reframing demand forecasting: a two-fold approach for lumpy and
intermittent demand [0.9137554315375922]
We show that competitive demand forecasts can be obtained through two models: predicting the demand occurrence and estimating the demand size.
Our research shows that global classification models are the best choice when predicting demand event occurrence.
We tested our approach on real-world data consisting of 516 three-year-long time series corresponding to European automotive original equipment manufacturers' daily demand.
arXiv Detail & Related papers (2021-03-23T17:57:40Z) - Autoregressive Score Matching [113.4502004812927]
We propose autoregressive conditional score models (AR-CSM) where we parameterize the joint distribution in terms of the derivatives of univariable log-conditionals (scores)
For AR-CSM models, this divergence between data and model distributions can be computed and optimized efficiently, requiring no expensive sampling or adversarial training.
We show with extensive experimental results that it can be applied to density estimation on synthetic data, image generation, image denoising, and training latent variable models with implicit encoders.
arXiv Detail & Related papers (2020-10-24T07:01:24Z) - Exposing Shallow Heuristics of Relation Extraction Models with Challenge
Data [49.378860065474875]
We identify failure modes of SOTA relation extraction (RE) models trained on TACRED.
By adding some of the challenge data as training examples, the performance of the model improves.
arXiv Detail & Related papers (2020-10-07T21:17:25Z) - Estimating Latent Demand of Shared Mobility through Censored Gaussian
Processes [11.695095006311176]
Transport demand is highly dependent on supply, especially for shared transport services where availability is often limited.
As observed demand cannot be higher than available supply, historical transport data typically represents a biased, or censored, version of the true underlying demand pattern.
We propose a general method for censorship-aware demand modeling, for which we devise a censored likelihood function.
arXiv Detail & Related papers (2020-01-21T09:26:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.