Hierarchical Forecasting at Scale
- URL: http://arxiv.org/abs/2310.12809v2
- Date: Mon, 26 Feb 2024 09:06:16 GMT
- Title: Hierarchical Forecasting at Scale
- Authors: Olivier Sprangers, Wander Wadman, Sebastian Schelter, Maarten de Rijke
- Abstract summary: Existing hierarchical forecasting techniques scale poorly when the number of time series increases.
We propose to learn a coherent forecast for millions of time series with a single bottom-level forecast model.
We implement our sparse hierarchical loss function within an existing forecasting model at bol, a large European e-commerce platform.
- Score: 55.658563862299495
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Existing hierarchical forecasting techniques scale poorly when the number of
time series increases. We propose to learn a coherent forecast for millions of
time series with a single bottom-level forecast model by using a sparse loss
function that directly optimizes the hierarchical product and/or temporal
structure. The benefit of our sparse hierarchical loss function is that it
provides practitioners a method of producing bottom-level forecasts that are
coherent to any chosen cross-sectional or temporal hierarchy. In addition,
removing the need for a post-processing step as required in traditional
hierarchical forecasting techniques reduces the computational cost of the
prediction phase in the forecasting pipeline. On the public M5 dataset, our
sparse hierarchical loss function performs up to 10% (RMSE) better compared to
the baseline loss function. We implement our sparse hierarchical loss function
within an existing forecasting model at bol, a large European e-commerce
platform, resulting in an improved forecasting performance of 2% at the product
level. Finally, we found an increase in forecasting performance of about 5-10%
when evaluating the forecasting performance across the cross-sectional
hierarchies that we defined. These results demonstrate the usefulness of our
sparse hierarchical loss applied to a production forecasting system at a major
e-commerce platform.
Related papers
- F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm.
By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases.
Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
arXiv Detail & Related papers (2024-06-23T21:28:50Z) - Loss Shaping Constraints for Long-Term Time Series Forecasting [79.3533114027664]
We present a Constrained Learning approach for long-term time series forecasting that respects a user-defined upper bound on the loss at each time-step.
We propose a practical Primal-Dual algorithm to tackle it, and aims to demonstrate that it exhibits competitive average performance in time series benchmarks, while shaping the errors across the predicted window.
arXiv Detail & Related papers (2024-02-14T18:20:44Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2023-10-17T20:30:16Z) - Forecast reconciliation for vaccine supply chain optimization [61.13962963550403]
Vaccine supply chain optimization can benefit from hierarchical time series forecasting.
Forecasts of different hierarchy levels become incoherent when higher levels do not match the sum of the lower levels forecasts.
We tackle the vaccine sale forecasting problem by modeling sales data from GSK between 2010 and 2021 as a hierarchical time series.
arXiv Detail & Related papers (2023-05-02T14:34:34Z) - A Meta-Learning Approach to Predicting Performance and Data Requirements [163.4412093478316]
We propose an approach to estimate the number of samples required for a model to reach a target performance.
We find that the power law, the de facto principle to estimate model performance, leads to large error when using a small dataset.
We introduce a novel piecewise power law (PPL) that handles the two data differently.
arXiv Detail & Related papers (2023-03-02T21:48:22Z) - Long Range Probabilistic Forecasting in Time-Series using High Order
Statistics [19.12411040726229]
We present a novel probabilistic forecasting method that produces forecasts coherent in terms of base level and predicted aggregate statistics.
We show that our method improves forecast performance across both base level and unseen aggregates post inference on real datasets ranging three diverse domains.
arXiv Detail & Related papers (2021-11-05T11:10:35Z) - Forecasting reconciliation with a top-down alignment of independent
level forecasts [3.600932575533886]
The overall forecasting performance is heavily affected by the forecasting accuracy of intermittent time series at bottom levels.
We present a forecasting reconciliation approach that treats the bottom level forecast as latent to ensure higher forecasting accuracy on the upper levels of the hierarchy.
arXiv Detail & Related papers (2021-03-15T10:00:23Z) - A Multi-Phase Approach for Product Hierarchy Forecasting in Supply Chain
Management: Application to MonarchFx Inc [9.290757451344673]
We propose a novel multi-phase hierarchical (MPH) approach to improve forecasts in a hierarchical supply chain.
Our results demonstrate an 82-90% improvement in forecast accuracy using the proposed approach.
arXiv Detail & Related papers (2020-06-16T05:26:11Z) - Hierarchical robust aggregation of sales forecasts at aggregated levels
in e-commerce, based on exponential smoothing and Holt's linear trend method [0.0]
We consider ensemble forecasts, given by several instances of classical techniques tuned with different (sets of) parameters.
We apply this methodology to a hierarchical data set of sales provided by the e-commerce company Cdiscount.
The performance is better than what would be obtained by optimally tuning the classical techniques on a train set.
arXiv Detail & Related papers (2020-06-05T11:20:25Z) - A machine learning approach for forecasting hierarchical time series [4.157415305926584]
We propose a machine learning approach for forecasting hierarchical time series.
Forecast reconciliation is the process of adjusting forecasts to make them coherent across the hierarchy.
We exploit the ability of a deep neural network to extract information capturing the structure of the hierarchy.
arXiv Detail & Related papers (2020-05-31T22:26:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.