Forecast with Forecasts: Diversity Matters

• URL: http://arxiv.org/abs/2012.01643v2
• Date: Fri, 18 Dec 2020 12:09:43 GMT
• Title: Forecast with Forecasts: Diversity Matters
• Authors: Yanfei Kang, Wei Cao, Fotios Petropoulos, Feng Li
• Abstract summary: In recent years, the idea of using time series features to construct forecast combination model has flourished in the forecasting area. In this work, we suggest a change of focus from the historical data to the produced forecasts to extract features. We calculate the diversity of a pool of models based on the corresponding forecasts as a decisive feature and use meta-learning to construct diversity-based forecast combination models.
• Score: 9.66075743192747
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Forecast combination has been widely applied in the last few decades to improve forecast accuracy. In recent years, the idea of using time series features to construct forecast combination model has flourished in the forecasting area. Although this idea has been proved to be beneficial in several forecast competitions such as the M3 and M4 competitions, it may not be practical in many situations. For example, the task of selecting appropriate features to build forecasting models can be a big challenge for many researchers. Even if there is one acceptable way to define the features, existing features are estimated based on the historical patterns, which are doomed to change in the future, or infeasible in the case of limited historical data. In this work, we suggest a change of focus from the historical data to the produced forecasts to extract features. We calculate the diversity of a pool of models based on the corresponding forecasts as a decisive feature and use meta-learning to construct diversity-based forecast combination models. A rich set of time series are used to evaluate the performance of the proposed method. Experimental results show that our diversity-based forecast combination framework not only simplifies the modelling process but also achieves superior forecasting performance.

Related papers

• Predictive Churn with the Set of Good Models [64.05949860750235]
  We study the effect of conflicting predictions over the set of near-optimal machine learning models. We present theoretical results on the expected churn between models within the Rashomon set. We show how our approach can be used to better anticipate, reduce, and avoid churn in consumer-facing applications.
  arXiv  Detail & Related papers  (2024-02-12T16:15:25Z)
• Optimizing accuracy and diversity: a multi-task approach to forecast combinations [0.0]
  We present a multi-task optimization paradigm that focuses on solving both problems simultaneously. It incorporates an additional learning and optimization task into the standard feature-based forecasting approach. The proposed approach elicits the essential role of diversity in feature-based forecasting.
  arXiv  Detail & Related papers  (2023-10-31T15:26:33Z)
• Attention-Based Ensemble Pooling for Time Series Forecasting [55.2480439325792]
  We propose a method for pooling that performs a weighted average over candidate model forecasts. We test this method on two time-series forecasting problems: multi-step forecasting of the dynamics of the non-stationary Lorenz 63 equation, and one-step forecasting of the weekly incident deaths due to COVID-19.
  arXiv  Detail & Related papers  (2023-10-24T22:59:56Z)
• Computing the ensemble spread from deterministic weather predictions using conditional generative adversarial networks [0.0]
  We propose to use deep-learning algorithms to learn the statistical properties of an ensemble prediction system. Once trained, the costly ensemble prediction system will not be needed anymore to obtain future ensemble forecasts.
  arXiv  Detail & Related papers  (2022-05-18T19:10:38Z)
• TACTiS: Transformer-Attentional Copulas for Time Series [76.71406465526454]
  estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. We propose a versatile method that estimates joint distributions using an attention-based decoder. We show that our model produces state-of-the-art predictions on several real-world datasets.
  arXiv  Detail & Related papers  (2022-02-07T21:37:29Z)
• CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting [70.54920804222031]
  We propose a general probabilistic multi-view forecasting framework CAMul. It can learn representations and uncertainty from diverse data sources. It integrates the knowledge and uncertainty from each data view in a dynamic context-specific manner. We show that CAMul outperforms other state-of-art probabilistic forecasting models by over 25% in accuracy and calibration.
  arXiv  Detail & Related papers  (2021-09-15T17:13:47Z)
• Feature-weighted Stacking for Nonseasonal Time Series Forecasts: A Case Study of the COVID-19 Epidemic Curves [0.0]
  We investigate ensembling techniques in forecasting and examine their potential for use in nonseasonal time-series. We propose using late data fusion, using a stacked ensemble of two forecasting models and two meta-features that prove their predictive power during a preliminary forecasting stage.
  arXiv  Detail & Related papers  (2021-08-19T14:44:46Z)
• Ensembles of Randomized NNs for Pattern-based Time Series Forecasting [0.0]
  We propose an ensemble forecasting approach based on randomized neural networks. A pattern-based representation of time series makes the proposed approach suitable for forecasting time series with multiple seasonality. Case studies conducted on four real-world forecasting problems verified the effectiveness and superior performance of the proposed ensemble forecasting approach.
  arXiv  Detail & Related papers  (2021-07-08T20:13:50Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)
• A framework for probabilistic weather forecast post-processing across models and lead times using machine learning [3.1542695050861544]
  We show how to bridge the gap between sets of separate forecasts from NWP models and the 'ideal' forecast for decision support. We use Quantile Regression Forests to learn the error profile of each numerical model, and use these to apply empirically-derived probability distributions to forecasts. Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution.
  arXiv  Detail & Related papers  (2020-05-06T16:46:02Z)
• Ambiguity in Sequential Data: Predicting Uncertain Futures with Recurrent Models [110.82452096672182]
  We propose an extension of the Multiple Hypothesis Prediction (MHP) model to handle ambiguous predictions with sequential data. We also introduce a novel metric for ambiguous problems, which is better suited to account for uncertainties.
  arXiv  Detail & Related papers  (2020-03-10T09:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.