Masked Multi-Step Probabilistic Forecasting for Short-to-Mid-Term
Electricity Demand
- URL: http://arxiv.org/abs/2302.06818v1
- Date: Tue, 14 Feb 2023 04:09:03 GMT
- Title: Masked Multi-Step Probabilistic Forecasting for Short-to-Mid-Term
Electricity Demand
- Authors: Yiwei Fu, Nurali Virani, Honggang Wang
- Abstract summary: Masked Multi-Step Multi Probabilistic Forecasting (MMMPF) is a novel and general framework to train any neural network model.
It combines both the temporal information from the past and the known information about the future to make probabilistic predictions.
MMMPF can also generate desired quantiles to capture uncertainty and enable probabilistic planning for grid of the future.
- Score: 7.544120398993689
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predicting the demand for electricity with uncertainty helps in planning and
operation of the grid to provide reliable supply of power to the consumers.
Machine learning (ML)-based demand forecasting approaches can be categorized
into (1) sample-based approaches, where each forecast is made independently,
and (2) time series regression approaches, where some historical load and other
feature information is used. When making a short-to-mid-term electricity demand
forecast, some future information is available, such as the weather forecast
and calendar variables. However, in existing forecasting models this future
information is not fully incorporated. To overcome this limitation of existing
approaches, we propose Masked Multi-Step Multivariate Probabilistic Forecasting
(MMMPF), a novel and general framework to train any neural network model
capable of generating a sequence of outputs, that combines both the temporal
information from the past and the known information about the future to make
probabilistic predictions. Experiments are performed on a real-world dataset
for short-to-mid-term electricity demand forecasting for multiple regions and
compared with various ML methods. They show that the proposed MMMPF framework
outperforms not only sample-based methods but also existing time-series
forecasting models with the exact same base models. Models trainded with MMMPF
can also generate desired quantiles to capture uncertainty and enable
probabilistic planning for grid of the future.
Related papers
- F-FOMAML: GNN-Enhanced Meta-Learning for Peak Period Demand Forecasting with Proxy Data [65.6499834212641]
We formulate the demand prediction as a meta-learning problem and develop the Feature-based First-Order Model-Agnostic Meta-Learning (F-FOMAML) algorithm.
By considering domain similarities through task-specific metadata, our model improved generalization, where the excess risk decreases as the number of training tasks increases.
Compared to existing state-of-the-art models, our method demonstrates a notable improvement in demand prediction accuracy, reducing the Mean Absolute Error by 26.24% on an internal vending machine dataset and by 1.04% on the publicly accessible JD.com dataset.
arXiv Detail & Related papers (2024-06-23T21:28:50Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2023-10-17T20:30:16Z) - Masked Multi-Step Multivariate Time Series Forecasting with Future
Information [7.544120398993689]
In many real-world forecasting scenarios, some future information is known, e.g., the weather information when making a short-to-mid-term electricity demand forecast.
To overcome the limitations of existing approaches, we propose MMMF, a framework to train any neural network model capable of generating a sequence of outputs.
Experiments are performed on two real-world datasets for (1) mid-term electricity demand forecasting, and (2) two-month ahead flight departures.
arXiv Detail & Related papers (2022-09-28T20:49:11Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2022-06-16T06:13:53Z) - CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting [70.54920804222031]
We propose a general probabilistic multi-view forecasting framework CAMul.
It can learn representations and uncertainty from diverse data sources.
It integrates the knowledge and uncertainty from each data view in a dynamic context-specific manner.
We show that CAMul outperforms other state-of-art probabilistic forecasting models by over 25% in accuracy and calibration.
arXiv Detail & Related papers (2021-09-15T17:13:47Z) - Probabilistic Time Series Forecasting with Implicit Quantile Networks [0.7249731529275341]
We combine an autoregressive recurrent neural network to model temporal dynamics with Implicit Quantile Networks to learn a large class of distributions over a time-series target.
Our approach is favorable in terms of point-wise prediction accuracy as well as on estimating the underlying temporal distribution.
arXiv Detail & Related papers (2021-07-08T10:37:24Z) - Probabilistic Gradient Boosting Machines for Large-Scale Probabilistic
Regression [51.770998056563094]
Probabilistic Gradient Boosting Machines (PGBM) is a method to create probabilistic predictions with a single ensemble of decision trees.
We empirically demonstrate the advantages of PGBM compared to existing state-of-the-art methods.
arXiv Detail & Related papers (2021-06-03T08:32:13Z) - Learning Interpretable Deep State Space Model for Probabilistic Time
Series Forecasting [98.57851612518758]
Probabilistic time series forecasting involves estimating the distribution of future based on its history.
We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks.
We show in experiments that our model produces accurate and sharp probabilistic forecasts.
arXiv Detail & Related papers (2021-01-31T06:49:33Z) - Probabilistic Load Forecasting Based on Adaptive Online Learning [7.373617024876726]
This paper presents a method for probabilistic load forecasting based on the adaptive online learning of hidden Markov models.
We propose learning and forecasting techniques with theoretical guarantees, and experimentally assess their performance in multiple scenarios.
The results show that the proposed method can significantly improve the performance of existing techniques for a wide range of scenarios.
arXiv Detail & Related papers (2020-11-30T12:02:26Z) - A framework for probabilistic weather forecast post-processing across
models and lead times using machine learning [3.1542695050861544]
We show how to bridge the gap between sets of separate forecasts from NWP models and the 'ideal' forecast for decision support.
We use Quantile Regression Forests to learn the error profile of each numerical model, and use these to apply empirically-derived probability distributions to forecasts.
Second, we combine these probabilistic forecasts using quantile averaging. Third, we interpolate between the aggregate quantiles in order to generate a full predictive distribution.
arXiv Detail & Related papers (2020-05-06T16:46:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.