Robustness Evaluation of Machine Learning Models for Fault Classification and Localization In Power System Protection

• URL: http://arxiv.org/abs/2512.15385v1
• Date: Wed, 17 Dec 2025 12:38:53 GMT
• Title: Robustness Evaluation of Machine Learning Models for Fault Classification and Localization In Power System Protection
• Authors: Julian Oelhaf, Mehran Pashaei, Georg Kordowich, Christian Bergler, Andreas Maier, Johann Jäger, Siming Bayer,
• Abstract summary: This work introduces a unified framework for evaluating the robustness of machine learning models in power system protection.<n>High-fidelity EMT simulations are used to model realistic degradation scenarios, including sensor outages, reduced sampling rates, and transient communication losses.<n>Results show that FC remains highly stable under most degradation types but drops by about 13% under single-phase loss, while FL is more sensitive overall, with voltage loss increasing localization error by over 150%.
• Score: 5.539105299550525
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The growing penetration of renewable and distributed generation is transforming power systems and challenging conventional protection schemes that rely on fixed settings and local measurements. Machine learning (ML) offers a data-driven alternative for centralized fault classification (FC) and fault localization (FL), enabling faster and more adaptive decision-making. However, practical deployment critically depends on robustness. Protection algorithms must remain reliable even when confronted with missing, noisy, or degraded sensor data. This work introduces a unified framework for systematically evaluating the robustness of ML models in power system protection. High-fidelity EMT simulations are used to model realistic degradation scenarios, including sensor outages, reduced sampling rates, and transient communication losses. The framework provides a consistent methodology for benchmarking models, quantifying the impact of limited observability, and identifying critical measurement channels required for resilient operation. Results show that FC remains highly stable under most degradation types but drops by about 13% under single-phase loss, while FL is more sensitive overall, with voltage loss increasing localization error by over 150%. These findings offer actionable guidance for robustness-aware design of future ML-assisted protection systems.

Related papers

• Benchmarking Machine Learning Models for Fault Classification and Localization in Power System Protection [10.403249318465468]
  This work presents a comparative benchmarking study of classical machine learning models for fault classification (FC) and fault localization (FL) in power system protection based on EMT data.<n>The best-performing FC model achieved an F1 score of 0.992$pm$0.001, while the top FL model reached an R2 of 0.806$pm$0.008 with a mean processing time of 0.563 ms.
  arXiv  Detail & Related papers  (2025-10-01T12:44:14Z)
• From Physics to Machine Learning and Back: Part II - Learning and Observational Bias in PHM [52.64097278841485]
  Review examines how incorporating learning and observational biases through physics-informed modeling and data strategies can guide models toward physically consistent and reliable predictions.<n>Fast adaptation methods including meta-learning and few-shot learning are reviewed alongside domain generalization techniques.
  arXiv  Detail & Related papers  (2025-09-25T14:15:43Z)
• A Scoping Review of Machine Learning Applications in Power System Protection and Disturbance Management [5.539105299550525]
  This scoping review synthesizes recent literature on machine learning (ML) applications in power system protection and disturbance management.<n>Three key objectives are addressed: (i) assessing the scope of ML research in protection tasks; (ii) evaluating ML performance across diverse operational scenarios; and (iii) identifying methods suitable for evolving grid conditions.
  arXiv  Detail & Related papers  (2025-09-10T23:19:28Z)
• Impact of Data Sparsity on Machine Learning for Fault Detection in Power System Protection [2.755840398228561]
  Germany's transition to a renewable energy-based power system is reshaping grid operations, requiring advanced monitoring and control to manage decentralized generation.<n>Machine learning (ML) has emerged as a powerful tool for power system protection, particularly for fault detection (FD) and fault line identification (FLI) in transmission grids.<n>Data sparsity resulting from sensor failures, communication disruptions, or reduced sampling rates poses a challenge to ML-based FD and FLI.<n>We propose a framework to assess the impact of data sparsity on ML-based FD and FLI performance.
  arXiv  Detail & Related papers  (2025-05-21T14:17:58Z)
• Model Hemorrhage and the Robustness Limits of Large Language Models [119.46442117681147]
  Large language models (LLMs) demonstrate strong performance across natural language processing tasks, yet undergo significant performance degradation when modified for deployment.<n>We define this phenomenon as model hemorrhage - performance decline caused by parameter alterations and architectural changes.
  arXiv  Detail & Related papers  (2025-03-31T10:16:03Z)
• Enhancing LLM Reliability via Explicit Knowledge Boundary Modeling [41.19330514054401]
  Large language models (LLMs) are prone to hallucination stemming from misaligned self-awareness.<n>We propose the Explicit Knowledge Boundary Modeling framework to integrate fast and slow reasoning systems to harmonize reliability and usability.
  arXiv  Detail & Related papers  (2025-03-04T03:16:02Z)
• AutoML for Multi-Class Anomaly Compensation of Sensor Drift [44.63945828405864]
  Sensor drift degrades the performance of machine learning models over time.<n>Standard cross-validation method overestimates performance by inadequately accounting for drift.<n>This paper presents two solutions: (1) a novel sensor drift compensation learning paradigm for validating models, and (2) automated machine learning (AutoML) techniques to enhance classification performance and compensate sensor drift.
  arXiv  Detail & Related papers  (2025-02-26T14:34:53Z)
• Federated Learning for Efficient Condition Monitoring and Anomaly Detection in Industrial Cyber-Physical Systems [0.30723404270319693]
  This paper introduces an enhanced FL framework with three key innovations: adaptive model aggregation based on sensor reliability, dynamic node selection for resource optimization, and Weibull-based checkpointing for fault tolerance.<n> Experiments on the NASA Bearing and Hydraulic System datasets demonstrate superior performance compared to state-of-the-art FL methods, achieving 99.5% AUC-ROC in anomaly detection and maintaining accuracy even under node failures.
  arXiv  Detail & Related papers  (2025-01-28T03:04:47Z)
• Transient Fault Tolerant Semantic Segmentation for Autonomous Driving [44.725591200232884]
  We introduce ReLUMax, a simple activation function designed to enhance resilience against transient faults. Our experiments demonstrate that ReLUMax effectively improves robustness, preserving performance and boosting prediction confidence.
  arXiv  Detail & Related papers  (2024-08-30T00:27:46Z)
• Enhancing Security in Federated Learning through Adaptive Consensus-Based Model Update Validation [2.28438857884398]
  This paper introduces an advanced approach for fortifying Federated Learning (FL) systems against label-flipping attacks. We propose a consensus-based verification process integrated with an adaptive thresholding mechanism. Our results indicate a significant mitigation of label-flipping attacks, bolstering the FL system's resilience.
  arXiv  Detail & Related papers  (2024-03-05T20:54:56Z)
• System Resilience through Health Monitoring and Reconfiguration [56.448036299746285]
  We demonstrate an end-to-end framework to improve the resilience of man-made systems to unforeseen events. The framework is based on a physics-based digital twin model and three modules tasked with real-time fault diagnosis, prognostics and reconfiguration.
  arXiv  Detail & Related papers  (2022-08-30T20:16:17Z)
• Providing reliability in Recommender Systems through Bernoulli Matrix Factorization [63.732639864601914]
  This paper proposes Bernoulli Matrix Factorization (BeMF) to provide both prediction values and reliability values. BeMF acts on model-based collaborative filtering rather than on memory-based filtering. The more reliable a prediction is, the less liable it is to be wrong.
  arXiv  Detail & Related papers  (2020-06-05T14:24:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.