Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equation
- URL: http://arxiv.org/abs/2405.07359v1
- Date: Sun, 12 May 2024 18:45:30 GMT
- Title: Forecasting with an N-dimensional Langevin Equation and a Neural-Ordinary Differential Equation
- Authors: Antonio Malpica-Morales, Miguel A. Duran-Olivencia, Serafim Kalliadasis,
- Abstract summary: We develop a framework to systematically model and forecast non-stationary electricity-price time series.
Our findings reveal that the NODE nicely complements the LE, providing a comprehensive strategy to tackle both stationary and non-stationary electricity-price behavior.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate prediction of electricity day-ahead prices is essential in competitive electricity markets. Although stationary electricity-price forecasting techniques have received considerable attention, research on non-stationary methods is comparatively scarce, despite the common prevalence of non-stationary features in electricity markets. Specifically, existing non-stationary techniques will often aim to address individual non-stationary features in isolation, leaving aside the exploration of concurrent multiple non-stationary effects. Our overarching objective here is the formulation of a framework to systematically model and forecast non-stationary electricity-price time series, encompassing the broader scope of non-stationary behavior. For this purpose we develop a data-driven model that combines an N-dimensional Langevin equation (LE) with a neural-ordinary differential equation (NODE). The LE captures fine-grained details of the electricity-price behavior in stationary regimes but is inadequate for non-stationary conditions. To overcome this inherent limitation, we adopt a NODE approach to learn, and at the same time predict, the difference between the actual electricity-price time series and the simulated price trajectories generated by the LE. By learning this difference, the NODE reconstructs the non-stationary components of the time series that the LE is not able to capture. We exemplify the effectiveness of our framework using the Spanish electricity day-ahead market as a prototypical case study. Our findings reveal that the NODE nicely complements the LE, providing a comprehensive strategy to tackle both stationary and non-stationary electricity-price behavior. The framework's dependability and robustness is demonstrated through different non-stationary scenarios by comparing it against a range of basic naive methods.
Related papers
- Transfer learning for day-ahead load forecasting: a case study on
European national electricity demand time series [42.156081667752886]
Short-term load forecasting (STLF) is crucial for the daily operation of power grids.
Various forecasting approaches have been proposed for improving STLF, including neural network (NN) models.
We employ a popular and easy-to-implement NN model and perform a clustering analysis to identify similar patterns among the series.
arXiv Detail & Related papers (2023-10-24T06:54:50Z) - Probabilistic Forecasting of Day-Ahead Electricity Prices and their
Volatility with LSTMs [0.0]
We present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices.
The recurrent structure of the LSTM allows the model to adapt to trends, while the joint prediction of both mean and standard deviation enables a probabilistic prediction.
Using a physics-inspired approach - superstatistics - to derive an explanation for the statistics of prices, we show that the LSTM model faithfully reproduces both prices and their volatility.
arXiv Detail & Related papers (2023-10-05T06:47:28Z) - SaDI: A Self-adaptive Decomposed Interpretable Framework for Electric
Load Forecasting under Extreme Events [25.325870546140788]
We propose a novel forecasting framework, named Self-adaptive Decomposed Interpretable framework(SaDI)
Experiments on both Central China electric load and public energy meters from buildings show that the proposed SaDI framework achieves average 22.14% improvement.
arXiv Detail & Related papers (2023-06-14T07:11:30Z) - Multivariate Probabilistic Forecasting of Intraday Electricity Prices
using Normalizing Flows [62.997667081978825]
In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the EPEX spot markets in a distinct hourly pattern.
This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contracts.
arXiv Detail & Related papers (2022-05-27T08:38:20Z) - Wholesale Electricity Price Forecasting using Integrated Long-term
Recurrent Convolutional Network Model [0.0]
This paper proposes an integrated long-term recurrent convolutional network (ILRCN) model to predict electricity prices.
Case studies reveal that the proposed ILRCN model is accurate and efficient in electricity price forecasting.
arXiv Detail & Related papers (2021-12-23T06:45:12Z) - ARISE: ApeRIodic SEmi-parametric Process for Efficient Markets without
Periodogram and Gaussianity Assumptions [91.3755431537592]
We present the ApeRI-miodic (ARISE) process for investigating efficient markets.
The ARISE process is formulated as an infinite-sum of some known processes and employs the aperiodic spectrum estimation.
In practice, we apply the ARISE function to identify the efficiency of real-world markets.
arXiv Detail & Related papers (2021-11-08T03:36:06Z) - Validation Methods for Energy Time Series Scenarios from Deep Generative
Models [55.41644538483948]
A popular scenario generation approach uses deep generative models (DGM) that allow scenario generation without prior assumptions about the data distribution.
We provide a critical assessment of the currently used validation methods in the energy scenario generation literature.
We apply the four validation methods to both the historical and the generated data and discuss the interpretation of validation results as well as common mistakes, pitfalls, and limitations of the validation methods.
arXiv Detail & Related papers (2021-10-27T14:14:25Z) - Learning to Estimate Without Bias [57.82628598276623]
Gauss theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models.
In this paper, we take a first step towards extending this result to non linear settings via deep learning with bias constraints.
A second motivation to BCE is in applications where multiple estimates of the same unknown are averaged for improved performance.
arXiv Detail & Related papers (2021-10-24T10:23:51Z) - Advanced Statistical Learning on Short Term Load Process Forecasting [13.466565318976887]
Short Term Load Forecast (STLF) is necessary for effective scheduling, operation optimization trading, and decision-making for electricity consumers.
We propose different statistical nonlinear models to manage these challenges of hard type datasets and forecast 15-min frequency electricity load up to 2-days ahead.
arXiv Detail & Related papers (2021-10-19T12:32:40Z) - Training Generative Adversarial Networks by Solving Ordinary
Differential Equations [54.23691425062034]
We study the continuous-time dynamics induced by GAN training.
From this perspective, we hypothesise that instabilities in training GANs arise from the integration error.
We experimentally verify that well-known ODE solvers (such as Runge-Kutta) can stabilise training.
arXiv Detail & Related papers (2020-10-28T15:23:49Z) - Stochastically forced ensemble dynamic mode decomposition for
forecasting and analysis of near-periodic systems [65.44033635330604]
We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system.
We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony.
Results are presented for a test case using load data from an electrical grid.
arXiv Detail & Related papers (2020-10-08T20:25:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.