Interpretable Physics-Informed Load Forecasting for U.S. Grid Resilience: SHAP-Guided Ensemble Validation in Hybrid Deep Learning Under Extreme Weather
- URL: http://arxiv.org/abs/2604.23500v1
- Date: Sun, 26 Apr 2026 02:26:12 GMT
- Title: Interpretable Physics-Informed Load Forecasting for U.S. Grid Resilience: SHAP-Guided Ensemble Validation in Hybrid Deep Learning Under Extreme Weather
- Abstract summary: A unified, interpretable, physics-informed ensemble framework is proposed.<n>The framework achieves 713 MW MAE, 812 MW RMSE, and 1.18% MAPE on the test window.<n> SHAP analysis reveals a regime shift: temperature dominates under normal operation, whereas wind speed and precipitation become more influential during cold fronts and heatwaves.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Accurate short-term electricity load forecasting is a cornerstone of U.S. grid reliability; however, prevailing deep learning models remain opaque, limiting operator trust during extreme weather. A unified, interpretable, physics-informed ensemble framework is proposed, integrating a Convolutional Neural Network (CNN) branch for local feature extraction and a Transformer branch for long-range dependency modeling; the branches are fused through a validation-optimized weighted ensemble and regularized by a physics-informed loss derived from the piecewise parabolic temperature-demand relationship of the Electric Reliability Council of Texas (ERCOT) system. Post-hoc interpretability is provided through SHapley Additive exPlanations (SHAP) with the DeepExplainer backend, yielding global and event-level attributions. Using eight years of ERCOT hourly load data (2018-2025) fused with Automated Surface Observing System (ASOS) records from three Texas stations, the framework achieves 713 MW MAE, 812 MW RMSE, and 1.18% MAPE on the test window. For Hampel-flagged extreme events, MAPE falls by 20.7% relative to its Transformer branch and by 40.5% relative to its CNN branch; an ablation confirms that the parabolic and ramp constraints drive a 14.7% RMSE reduction. SHAP analysis reveals a regime shift: temperature dominates under normal operation, whereas wind speed and precipitation become more influential during cold fronts and heatwaves.
Related papers
- EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting [50.31500063307306]
We introduce EO-WM, a video diffusion transformer for multispectral Earth Observation forecasting.<n> EO-WM incorporates a physically informed conditioning framework that represents meteorological forcing through a climatological baseline, weather anomalies, and cumulative physical stress signals.<n>Experiments show that EO-WM reduces the error in predicted Normalized Difference Vegetation Index (NDVI) decline amplitude by a relative 5.63% and improves directional hit rate by a relative 7.80%.
arXiv Detail & Related papers (2026-06-25T16:53:30Z) - RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting [83.06074370551887]
A fixed context window is mismatched to the time-varying optimal look-back of non-stationary price processes.<n>We propose a Mixture-of-Experts framework designed to adaptively determine the temporal context for each input sample.<n> Experiments on cumulative log-return prediction (HS300, S&P500) and fund sales forecasting demonstrate that RAVEN achieves SOTA performances, improves Pearson correlation by 9.2% on HS300 and 20.2% on S&P500, and reduces MSE by 18.2% on fund sales forecasting.
arXiv Detail & Related papers (2026-06-23T02:11:04Z) - Tyan-WP: A Wind Power Foundation Model for Ultra-Short-Term Probabilistic Forecasting [34.21419135186753]
We propose textbfTyan-WP, the first wind power foundation model for ultra-short-term probabilistic forecasting.<n>Tyan-WP surpasses eight site-specific supervised TSMs on 10 in-domain sites and outperforms eleven generic LTSMs on 127 in-domain sites.<n>Results show that the wind power foundation model can achieve accurate zero-shot forecasting without target-site training.
arXiv Detail & Related papers (2026-06-07T13:50:09Z) - UTOPYA: A Multimodal Deep Learning Framework for Physics-Informed Anomaly Detection and Time-Series Prediction [42.532335022354545]
Anomaly detection in batch processes is hindered by transient dynamics, scarce fault labels, and reliance on singlemodality sensor data.<n>This work introduces UTOPYA, a multimodal framework that jointly addresses anomaly detection, time-series prediction, and phase classification in batch distillation.<n>A physics-informed regularisation scheme introduced in this work enforces temporal smoothness and thermodynamic monotonicity.
arXiv Detail & Related papers (2026-05-18T10:28:15Z) - PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow [69.40969296005794]
We propose a unified framework that integrates zero-shot soft weather perceptions with velocity-constrained rectified-flow refinement.<n>PVRF improves both fidelity and perceptual quality over state-of-the-art baselines.
arXiv Detail & Related papers (2026-05-13T19:07:14Z) - ECTO: Exogenous-Conditioned Temporal Operator for Ultra-Short-Term Wind Power Forecasting [0.06015898117103066]
We propose ECTO (Exogenous-Conditioned Temporal Operator) as a unified framework for wind power forecasting.<n>Physically-Grounded Variable Selection (PGVS) performs hierarchical, group-aware sparse selection.<n>Exogenous-Conditioned Regime Refinement (ECRR) routes the forecast through learned regime experts.
arXiv Detail & Related papers (2026-05-12T14:37:23Z) - MR-GNF: Multi-Resolution Graph Neural Forecasting on Ellipsoidal Meshes for Efficient Regional Weather Prediction [0.0]
We introduce Multi-Resolution Graph Neural Forecasting (MR-GNF), a lightweight, physics-aware model that performs short-term regional forecasts directly on an ellipsoidal, multi-scale graph of the Earth.<n>MR-GNF delivers stable +6 h to +24 h forecasts for near-surface temperature, wind, and precipitation over the UK-Ireland sector.<n>These results demonstrate that graph-based neural operators can achieve trustworthy, high-resolution weather prediction at a fraction of NWP cost.
arXiv Detail & Related papers (2026-03-13T20:04:22Z) - PSTNet: Physically-Structured Turbulence Network [0.0]
Physically-Structured Turbulence Network (PSTNet) is a lightweight architecture that embeds physics directly into its structure.<n>PSTNet achieves a mean miss-distance improvement of +2.8% with a 78% win rate and a statistically significant effect size.
arXiv Detail & Related papers (2026-03-09T04:46:46Z) - KAN-FIF: Spline-Parameterized Lightweight Physics-based Tropical Cyclone Estimation on Meteorological Satellite [22.99496587694237]
Timely monitoring of tropical cyclones is crucial for reducing loss of life and property.<n>Current physics-guided models suffer from linear feature interactions that fail to capture high-order relationships between TC attributes.<n>This study introduces the Kolmogorov-Arnold Network-based Network-based Interaction Feature Framework (KAN-FIF)
arXiv Detail & Related papers (2026-02-12T16:07:39Z) - A Lightweight DL Model for Smart Grid Power Forecasting with Feature and Resolution Mismatch [0.4999814847776097]
This paper challenges teams to predict-day power demand using real-world high-frequency data.<n>We propose a robust yet lightweight Deep Learning pipeline combining hourly downsizing, dual-mode imputation, and comprehensive normalization.<n>A sequence-to-one model achieves an average RMSE of 601.9W, MAE of 468.9W, and 84.36% accuracy.
arXiv Detail & Related papers (2025-10-19T16:12:53Z) - Automated Energy-Aware Time-Series Model Deployment on Embedded FPGAs for Resilient Combined Sewer Overflow Management [17.903318666906728]
Extreme weather events, intensified by climate change, increasingly challenge aging combined sewer systems.<n>Forecasting of sewer overflow basin filling levels can provide actionable insights for early intervention.<n>We propose an end-to-end forecasting framework that enables energy-efficient inference directly on edge devices.
arXiv Detail & Related papers (2025-08-19T15:06:04Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal
Transformer [112.12271800369741]
Wind power is attracting increasing attention around the world due to its renewable, pollution-free, and other advantages.
Accurate wind power forecasting (WPF) can effectively reduce power fluctuations in power system operations.
Existing methods are mainly designed for short-term predictions and lack effective spatial-temporal feature augmentation.
arXiv Detail & Related papers (2023-05-30T04:03:15Z) - Towards Long-Term Time-Series Forecasting: Feature, Pattern, and
Distribution [57.71199089609161]
Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning.
Transformer models have been adopted to deliver high prediction capacity because of the high computational self-attention mechanism.
We propose an efficient Transformerbased model, named Conformer, which differentiates itself from existing methods for LTTF in three aspects.
arXiv Detail & Related papers (2023-01-05T13:59:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.