Confidence-Aware Graph Neural Networks for Learning Reliability
Assessment Commitments
- URL: http://arxiv.org/abs/2211.15755v3
- Date: Sun, 11 Jun 2023 00:04:06 GMT
- Title: Confidence-Aware Graph Neural Networks for Learning Reliability
Assessment Commitments
- Authors: Seonho Park, Wenbo Chen, Dahye Han, Mathieu Tanneau, and Pascal Van
Hentenryck
- Abstract summary: Reliability Assessment Commitment (RAC) optimization is increasingly important in grid operations.
The goal of this paper is to address the computational challenges arising in extending the scope of RAC formulations.
It presents RACLearn that uses a Graph Neural Network (GNN) based architecture to predict generator commitments and active line constraints.
- Score: 13.71115322497235
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Reliability Assessment Commitment (RAC) Optimization is increasingly
important in grid operations due to larger shares of renewable generations in
the generation mix and increased prediction errors. Independent System
Operators (ISOs) also aim at using finer time granularities, longer time
horizons, and possibly stochastic formulations for additional economic and
reliability benefits. The goal of this paper is to address the computational
challenges arising in extending the scope of RAC formulations. It presents
RACLearn that (1) uses a Graph Neural Network (GNN) based architecture to
predict generator commitments and active line constraints, (2) associates a
confidence value to each commitment prediction, (3) selects a subset of the
high-confidence predictions, which are (4) repaired for feasibility, and (5)
seeds a state-of-the-art optimization algorithm with feasible predictions and
active constraints. Experimental results on exact RAC formulations used by the
Midcontinent Independent System Operator (MISO) and an actual transmission
network (8965 transmission lines, 6708 buses, 1890 generators, and 6262 load
units) show that the RACLearn framework can speed up RAC optimization by
factors ranging from 2 to 4 with negligible loss in solution quality.
Related papers
- Data-Driven Approximation of Binary-State Network Reliability Function: Algorithm Selection and Reliability Thresholds for Large-Scale Systems [0.08158530638728499]
This study evaluates 20 machine learning methods across three reliability regimes full range (0.0-1.0), high reliability (0.9-1.0), and ultra high reliability (0.99-1.0)
We demonstrate that large-scale networks with arc reliability larger than or equal to 0.9 exhibit near-unity system reliability, enabling computational simplifications.
arXiv Detail & Related papers (2025-03-16T13:51:59Z) - Global-Decision-Focused Neural ODEs for Proactive Grid Resilience Management [50.34345101758248]
We propose predict-all-then-optimize-globally (PATOG), a framework that integrates outage prediction with globally optimized interventions.
Our approach ensures spatially and temporally coherent decision-making, improving both predictive accuracy and operational efficiency.
Experiments on synthetic and real-world datasets demonstrate significant improvements in outage prediction consistency and grid resilience.
arXiv Detail & Related papers (2025-02-25T16:15:35Z) - Enhancing Trustworthiness of Graph Neural Networks with Rank-Based Conformal Training [17.120502204791407]
Conformal Prediction can produce statistically guaranteed uncertainty estimates.
We propose a Rank-based CP during training framework to GNNs (RCP-GNN) for reliable uncertainty estimates.
arXiv Detail & Related papers (2025-01-06T05:19:24Z) - The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit [46.37267466656765]
This paper presents an optimization framework that combines Retrieval-Augmented Generation (RAG) with an innovative multi-head early exit architecture.
Our experiments demonstrate how this architecture effectively decreases time without sacrificing the accuracy needed for reliable recommendation delivery.
arXiv Detail & Related papers (2025-01-04T03:26:46Z) - Early Detection of Network Service Degradation: An Intra-Flow Approach [0.0]
This research presents a novel method for predicting service degradation (SD) in computer networks by leveraging early flow features.
Our approach focuses on the observable (O) segments of network flows, particularly analyzing Packet Inter-Arrival Time (PIAT)
We identify an optimal O/NO split threshold of 10 observed delay samples, balancing prediction accuracy and resource utilization.
arXiv Detail & Related papers (2024-07-09T08:05:14Z) - Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks [60.54852710216738]
We introduce a novel digital twin-assisted optimization framework, called D-REC, to ensure reliable caching in nextG wireless networks.
By incorporating reliability modules into a constrained decision process, D-REC can adaptively adjust actions, rewards, and states to comply with advantageous constraints.
arXiv Detail & Related papers (2024-06-29T02:40:28Z) - Uncertainty Quantification over Graph with Conformalized Graph Neural
Networks [52.20904874696597]
Graph Neural Networks (GNNs) are powerful machine learning prediction models on graph-structured data.
GNNs lack rigorous uncertainty estimates, limiting their reliable deployment in settings where the cost of errors is significant.
We propose conformalized GNN (CF-GNN), extending conformal prediction (CP) to graph-based models for guaranteed uncertainty estimates.
arXiv Detail & Related papers (2023-05-23T21:38:23Z) - Intelligent Proactive Fault Tolerance at the Edge through Resource Usage
Prediction [0.7046417074932255]
We propose an Intelligent Proactive Fault Tolerance (IPFT) method that leverages the edge resource usage predictions through Recurrent Neural Networks (RNN)
In this paper, we focus on the process-faults, which are related with the inability of the infrastructure to provide Quality of Service (QoS) in acceptable ranges due to the lack of processing power.
arXiv Detail & Related papers (2023-02-09T00:42:34Z) - Dual Accuracy-Quality-Driven Neural Network for Prediction Interval Generation [0.0]
We present a method to learn prediction intervals for regression-based neural networks automatically.
Our main contribution is the design of a novel loss function for the PI-generation network.
Experiments using a synthetic dataset, eight benchmark datasets, and a real-world crop yield prediction dataset showed that our method was able to maintain a nominal probability coverage.
arXiv Detail & Related papers (2022-12-13T05:03:16Z) - A Learning Convolutional Neural Network Approach for Network Robustness
Prediction [13.742495880357493]
Network robustness is critical for various societal and industrial networks again malicious attacks.
In this paper, an improved method for network robustness prediction is developed based on learning feature representation using convolutional neural network (LFR-CNN)
In this scheme, higher-dimensional network data are compressed to lower-dimensional representations, and then passed to a CNN to perform robustness prediction.
arXiv Detail & Related papers (2022-03-20T13:45:55Z) - Federated Learning with Unreliable Clients: Performance Analysis and
Mechanism Design [76.29738151117583]
Federated Learning (FL) has become a promising tool for training effective machine learning models among distributed clients.
However, low quality models could be uploaded to the aggregator server by unreliable clients, leading to a degradation or even a collapse of training.
We model these unreliable behaviors of clients and propose a defensive mechanism to mitigate such a security risk.
arXiv Detail & Related papers (2021-05-10T08:02:27Z) - The Benefit of the Doubt: Uncertainty Aware Sensing for Edge Computing
Platforms [10.86298377998459]
We propose an efficient framework for predictive uncertainty estimation in NNs deployed on embedded edge systems.
The framework is built from the ground up to provide predictive uncertainty based only on one forward pass.
Our approach not only obtains robust and accurate uncertainty estimations but also outperforms state-of-the-art methods in terms of systems performance.
arXiv Detail & Related papers (2021-02-11T11:44:32Z) - Bayesian Optimization with Machine Learning Algorithms Towards Anomaly
Detection [66.05992706105224]
In this paper, an effective anomaly detection framework is proposed utilizing Bayesian Optimization technique.
The performance of the considered algorithms is evaluated using the ISCX 2012 dataset.
Experimental results show the effectiveness of the proposed framework in term of accuracy rate, precision, low-false alarm rate, and recall.
arXiv Detail & Related papers (2020-08-05T19:29:35Z) - Towards a Competitive End-to-End Speech Recognition for CHiME-6 Dinner
Party Transcription [73.66530509749305]
In this paper, we argue that, even in difficult cases, some end-to-end approaches show performance close to the hybrid baseline.
We experimentally compare and analyze CTC-Attention versus RNN-Transducer approaches along with RNN versus Transformer architectures.
Our best end-to-end model based on RNN-Transducer, together with improved beam search, reaches quality by only 3.8% WER abs. worse than the LF-MMI TDNN-F CHiME-6 Challenge baseline.
arXiv Detail & Related papers (2020-04-22T19:08:33Z) - A Privacy-Preserving-Oriented DNN Pruning and Mobile Acceleration
Framework [56.57225686288006]
Weight pruning of deep neural networks (DNNs) has been proposed to satisfy the limited storage and computing capability of mobile edge devices.
Previous pruning methods mainly focus on reducing the model size and/or improving performance without considering the privacy of user data.
We propose a privacy-preserving-oriented pruning and mobile acceleration framework that does not require the private training dataset.
arXiv Detail & Related papers (2020-03-13T23:52:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.