Anomaly Detection in California Electricity Price Forecasting: Enhancing Accuracy and Reliability Using Principal Component Analysis
- URL: http://arxiv.org/abs/2412.07787v1
- Date: Mon, 25 Nov 2024 20:55:25 GMT
- Title: Anomaly Detection in California Electricity Price Forecasting: Enhancing Accuracy and Reliability Using Principal Component Analysis
- Authors: Joseph Nyangon, Ruth Akintunde,
- Abstract summary: This study focuses on enhancing electricity price forecasting in California's grid.
We analyze CAISO's hourly electricity prices and demand from 2016-2021 to improve day-ahead forecasting accuracy.
- Score: 0.0
- License:
- Abstract: Accurate and reliable electricity price forecasting has significant practical implications for grid management, renewable energy integration, power system planning, and price volatility management. This study focuses on enhancing electricity price forecasting in California's grid, addressing challenges from complex generation data and heteroskedasticity. Utilizing principal component analysis (PCA), we analyze CAISO's hourly electricity prices and demand from 2016-2021 to improve day-ahead forecasting accuracy. Initially, we apply traditional outlier analysis with the interquartile range method, followed by robust PCA (RPCA) for more effective outlier elimination. This approach improves data symmetry and reduces skewness. We then construct multiple linear regression models using both raw and PCA-transformed features. The model with transformed features, refined through traditional and SAS Sparse Matrix outlier removal methods, shows superior forecasting performance. The SAS Sparse Matrix method, in particular, significantly enhances model accuracy. Our findings demonstrate that PCA-based methods are key in advancing electricity price forecasting, supporting renewable integration and grid management in day-ahead markets. Keywords: Electricity price forecasting, principal component analysis (PCA), power system planning, heteroskedasticity, renewable energy integration.
Related papers
- Conformal Prediction for Electricity Price Forecasting in the Day-Ahead and Real-Time Balancing Market [0.0]
integration of renewable energy into electricity markets poses significant challenges to price stability.
This study explores the enhancement of probabilistic price prediction using Conformal Prediction (CP) techniques.
We propose an ensemble approach that combines the efficiency of quantile regression models with the robust coverage properties of time series adapted CP techniques.
arXiv Detail & Related papers (2025-02-07T13:57:47Z) - Energy Price Modelling: A Comparative Evaluation of four Generations of Forecasting Methods [45.30624270004584]
Energy price forecasting plays an important role in supporting decision-making at various levels.
Given the evolving landscape of forecasting techniques, the literature lacks a thorough empirical comparison.
This paper provides an in-depth review of the evolution of forecasting modeling frameworks.
arXiv Detail & Related papers (2024-11-05T11:45:00Z) - Deep Analysis of Time Series Data for Smart Grid Startup Strategies: A Transformer-LSTM-PSO Model Approach [0.8702432681310401]
Transformer-LSTM-PSO model is designed to more effectively capture the complex temporal relationships in grid startup schemes.
Model achieves lower RMSE and MAE values across multiple datasets compared to existing benchmarks.
The application of the Transformer-LSTM-PSO model represents a significant advancement in smart grid predictive analytics.
arXiv Detail & Related papers (2024-08-22T04:52:02Z) - AI-Powered Dynamic Fault Detection and Performance Assessment in Photovoltaic Systems [44.99833362998488]
intermittent nature of photovoltaic (PV) solar energy leads to power losses of 10-70% and an average energy production decrease of 25%.
Current fault detection strategies are costly and often yield unreliable results due to complex data signal profiles.
This research presents a computational model using the PVlib library in Python, incorporating a dynamic loss quantification algorithm.
arXiv Detail & Related papers (2024-08-19T23:52:06Z) - On-line conformalized neural networks ensembles for probabilistic forecasting of day-ahead electricity prices [41.94295877935867]
We propose a novel approach to PEPF, extending the state of the art neural networks ensembles based methods through conformal inference based techniques.
Experiments have been conducted on multiple market regions, achieving day-ahead forecasts with improved hourly coverage and stable probabilistic scores.
arXiv Detail & Related papers (2024-04-03T13:22:47Z) - Predictive Accuracy of a Hybrid Generalized Long Memory Model for Short
Term Electricity Price Forecasting [0.0]
This study investigates the predictive performance of a new hybrid model based on the Generalized long memory autoregressive model (k-factor GARMA)
The performance of the proposed model is evaluated using data from Nord Pool Electricity markets.
arXiv Detail & Related papers (2022-04-18T12:21:25Z) - Appliance Level Short-term Load Forecasting via Recurrent Neural Network [6.351541960369854]
We present an STLF algorithm for efficiently predicting the power consumption of individual electrical appliances.
The proposed method builds upon a powerful recurrent neural network (RNN) architecture in deep learning.
arXiv Detail & Related papers (2021-11-23T16:56:37Z) - Energy Forecasting in Smart Grid Systems: A Review of the
State-of-the-art Techniques [2.3436632098950456]
This paper presents a review of state-of-the-art forecasting methods for smart grid (SG) systems.
Traditional point forecasting methods including statistical, machine learning (ML), and deep learning (DL) are extensively investigated.
A comparative case study using the Victorian electricity consumption and American electric power (AEP) is conducted.
arXiv Detail & Related papers (2020-11-25T09:17:07Z) - Supervised PCA: A Multiobjective Approach [70.99924195791532]
Methods for supervised principal component analysis (SPCA)
We propose a new method for SPCA that addresses both of these objectives jointly.
Our approach accommodates arbitrary supervised learning losses and, through a statistical reformulation, provides a novel low-rank extension of generalized linear models.
arXiv Detail & Related papers (2020-11-10T18:46:58Z) - Physics-Informed Gaussian Process Regression for Probabilistic States
Estimation and Forecasting in Power Grids [67.72249211312723]
Real-time state estimation and forecasting is critical for efficient operation of power grids.
PhI-GPR is presented and used for forecasting and estimating the phase angle, angular speed, and wind mechanical power of a three-generator power grid system.
We demonstrate that the proposed PhI-GPR method can accurately forecast and estimate both observed and unobserved states.
arXiv Detail & Related papers (2020-10-09T14:18:31Z) - Stochastically forced ensemble dynamic mode decomposition for
forecasting and analysis of near-periodic systems [65.44033635330604]
We introduce a novel load forecasting method in which observed dynamics are modeled as a forced linear system.
We show that its use of intrinsic linear dynamics offers a number of desirable properties in terms of interpretability and parsimony.
Results are presented for a test case using load data from an electrical grid.
arXiv Detail & Related papers (2020-10-08T20:25:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.