A Trustworthy Industrial Fault Diagnosis Architecture Integrating Probabilistic Models and Large Language Models

• URL: http://arxiv.org/abs/2510.03815v1
• Date: Sat, 04 Oct 2025 14:11:13 GMT
• Title: A Trustworthy Industrial Fault Diagnosis Architecture Integrating Probabilistic Models and Large Language Models
• Abstract summary: The architecture performs preliminary analysis through a Bayesian network-based diagnostic engine.<n>The cognitive quorum module conducts expert-level arbitration of initial diagnoses.<n>Case studies have confirmed that HCAA effectively corrects misjudgments caused by complex feature patterns or knowledge gaps in traditional models.
• Score: 7.074098396770342
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: There are limitations of traditional methods and deep learning methods in terms of interpretability, generalization, and quantification of uncertainty in industrial fault diagnosis, and there are core problems of insufficient credibility in industrial fault diagnosis. The architecture performs preliminary analysis through a Bayesian network-based diagnostic engine and features an LLM-driven cognitive quorum module with multimodal input capabilities. The module conducts expert-level arbitration of initial diagnoses by analyzing structured features and diagnostic charts, prioritizing final decisions after conflicts are identified. To ensure the reliability of the system output, the architecture integrates a confidence calibration module based on temperature calibration and a risk assessment module, which objectively quantifies the reliability of the system using metrics such as expected calibration error (ECE). Experimental results on a dataset containing multiple fault types showed that the proposed framework improved diagnostic accuracy by more than 28 percentage points compared to the baseline model, while the calibrated ECE was reduced by more than 75%. Case studies have confirmed that HCAA effectively corrects misjudgments caused by complex feature patterns or knowledge gaps in traditional models, providing novel and practical engineering solutions for building high-trust, explainable AI diagnostic systems for industrial applications.

Related papers

• Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases [59.5328455571863]
  ClinMM-Bench is the largest multi-turn multimodal clinical diagnostic evaluation benchmark to date.<n>It contains 1,089 challenging real-world clinical cases and 3,760 medical images across eight specialties.<n> proprietary models achieved the highest overall diagnostic accuracy, but the proportion of completely correct diagnoses remained limited.
  arXiv  Detail & Related papers  (2026-07-28T16:19:03Z)
• A Reliable Fault Diagnosis Method Based on Belief Rule Base Consider Robustness Analysis [1.3372646184622108]
  A new fault diagnosis method is proposed to address the two problems of robustness assessment and robustness optimization.<n>The effectiveness of the proposed model is verified by taking the fault diagnosis of WD615 diesel engine and Case Western Reserve University bearings as an example.
  arXiv  Detail & Related papers  (2026-06-09T07:24:37Z)
• A Knowledge-Driven LLM-Based Decision-Support System for Explainable Defect Analysis and Mitigation Guidance in Laser Powder Bed Fusion [0.0]
  This work presents a knowledge-driven system that integrates structured defect knowledge with LLM-based reasoning to provide explainable defect diagnosis and mitigation guidance.<n>The proposed system is built on a knowledge base containing 27 known LPBF defect types organized into hierarchical categories and causal relationships.
  arXiv  Detail & Related papers  (2026-05-01T21:12:51Z)
• MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning [66.94527468532843]
  We propose MultiDx, a two-stage diagnostic reasoning framework.<n>It first generates suspected diagnoses and reasoning paths by leveraging knowledge from web search, SOAP-formatted case, and clinical case database.<n>Then it integrates multi-perspective evidence through matching, voting, and differential diagnosis to generate the final prediction.
  arXiv  Detail & Related papers  (2026-04-27T08:46:29Z)
• Clinical Cognition Alignment for Gastrointestinal Diagnosis with Multimodal LLMs [63.535652574541764]
  Multimodal Large Language Models (MLLMs) have demonstrated remarkable potential in medical image analysis.<n>Their application in gastrointestinal endoscopy is currently hindered by two critical limitations.<n>We propose a novel Clinical-Cognitive-Aligned (CogAlign) framework to address these challenges.
  arXiv  Detail & Related papers  (2026-03-21T07:47:37Z)
• A Multi-faceted Analysis of Cognitive Abilities: Evaluating Prompt Methods with Large Language Models on the CONSORT Checklist [1.1731001328350983]
  This study applies a behavioral and metacognitive analytic approach using an expert-validated dataset.<n>We analyze both cognitive adaptation and calibration error using metrics: Expected Error (ECE) and a baseline-normalized Relative Error (RCE)<n>Our results reveal pronounced miscalibration and overconfidence in both models, especially under clinical role-playing conditions.
  arXiv  Detail & Related papers  (2025-10-22T00:15:02Z)
• Probabilistic Machine Learning for Uncertainty-Aware Diagnosis of Industrial Systems [2.7946438090394903]
  This work presents a framework that uses ensemble probabilistic machine learning to improve diagnostic characteristics of data driven consistency based diagnosis.<n>The proposed method is evaluated across several case studies using both ablation and comparative analyses, showing consistent improvements across a range of diagnostic metrics.
  arXiv  Detail & Related papers  (2025-09-23T08:59:20Z)
• Consultation on Industrial Machine Faults with Large language Models [0.0]
  This paper introduces a novel approach leveraging Large Language Models (LLMs) to improve fault diagnosis accuracy. Experimental results demonstrate that our approach outperforms baseline models, achieving an accuracy of 91%.
  arXiv  Detail & Related papers  (2024-10-04T08:22:16Z)
• Unified Uncertainty Estimation for Cognitive Diagnosis Models [70.46998436898205]
  We propose a unified uncertainty estimation approach for a wide range of cognitive diagnosis models. We decompose the uncertainty of diagnostic parameters into data aspect and model aspect. Our method is effective and can provide useful insights into the uncertainty of cognitive diagnosis.
  arXiv  Detail & Related papers  (2024-03-09T13:48:20Z)
• Integrating LLMs for Explainable Fault Diagnosis in Complex Systems [0.0]
  This paper introduces an integrated system designed to enhance the explainability of fault diagnostics in complex systems, such as nuclear power plants. By combining a physics-based diagnostic tool with a Large Language Model, we offer a novel solution that not only identifies faults but also provides clear, understandable explanations of their causes and implications.
  arXiv  Detail & Related papers  (2024-02-08T22:11:21Z)
• Causal Disentanglement Hidden Markov Model for Fault Diagnosis [55.90917958154425]
  We propose a Causal Disentanglement Hidden Markov model (CDHM) to learn the causality in the bearing fault mechanism. Specifically, we make full use of the time-series data and progressively disentangle the vibration signal into fault-relevant and fault-irrelevant factors. To expand the scope of the application, we adopt unsupervised domain adaptation to transfer the learned disentangled representations to other working environments.
  arXiv  Detail & Related papers  (2023-08-06T05:58:45Z)
• Generalized Out-of-distribution Fault Diagnosis (GOOFD) via Internal Contrastive Learning [8.583116999933731]
  We propose a Generalized Out-of-distribution Fault Diagnosis framework to integrate diagnosis subtasks. A unified fault diagnosis method based on internal contrastive learning and Mahalanobis distance is put forward to underpin the proposed framework. Our proposed method can be applied to multiple faults diagnosis tasks and achieve better performance than the existing single-task methods.
  arXiv  Detail & Related papers  (2023-06-27T07:50:25Z)
• Towards Reliable Medical Image Segmentation by Modeling Evidential Calibrated Uncertainty [57.023423137202485]
  Concerns regarding the reliability of medical image segmentation persist among clinicians.<n>We introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks.<n>By leveraging subjective logic theory, we explicitly model probability and uncertainty for medical image segmentation.
  arXiv  Detail & Related papers  (2023-01-01T05:02:46Z)
• System Resilience through Health Monitoring and Reconfiguration [56.448036299746285]
  We demonstrate an end-to-end framework to improve the resilience of man-made systems to unforeseen events. The framework is based on a physics-based digital twin model and three modules tasked with real-time fault diagnosis, prognostics and reconfiguration.
  arXiv  Detail & Related papers  (2022-08-30T20:16:17Z)
• On-board Fault Diagnosis of a Laboratory Mini SR-30 Gas Turbine Engine [54.650189434544146]
  A data-driven fault diagnosis and isolation scheme is explicitly developed for failure in the fuel supply system and sensor measurements. A model is trained using machine learning classifiers to detect a given set of fault scenarios in real-time on which it is trained. Several simulation studies were carried out to demonstrate and illustrate the proposed fault diagnosis scheme's advantages, capabilities, and performance.
  arXiv  Detail & Related papers  (2021-10-17T13:42:37Z)
• An Uncertainty-Informed Framework for Trustworthy Fault Diagnosis in Safety-Critical Applications [1.988145627448243]
  Low trustworthiness of deep learning-based prognostic and health management (PHM) hinders its applications in safety-critical assets. We propose an uncertainty-informed framework to diagnose faults and meanwhile detect the OOD dataset. We show that the proposed framework is of particular advantage in tackling unknowns and enhancing the trustworthiness of fault diagnosis in safety-critical applications.
  arXiv  Detail & Related papers  (2021-10-08T21:24:14Z)
• Anytime Diagnosis for Reconfiguration [52.77024349608834]
  We introduce and analyze FlexDiag which is an anytime direct diagnosis approach. We evaluate the algorithm with regard to performance and diagnosis quality using a configuration benchmark from the domain of feature models and an industrial configuration knowledge base from the automotive domain.
  arXiv  Detail & Related papers  (2021-02-19T11:45:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.