Physically Verifiable Evidence and LLM-Based Reporting for Bearing Fault Diagnosis
- URL: http://arxiv.org/abs/2607.22797v1
- Date: Fri, 24 Jul 2026 14:09:16 GMT
- Title: Physically Verifiable Evidence and LLM-Based Reporting for Bearing Fault Diagnosis
- Abstract summary: Diagnostic Evidence Network (DENet) is an encoder-agnostic multi-task framework extending the output to a structured evidence record.<n>It incurs no statistically significant accuracy cost, with a frequency error of about 6 Hz on 1,024-point segments.<n>It detects misclassifications with AUROC values of 0.970 and 0.871, and remains discriminative in the high-confidence regime.
- Score: 6.168311548428149
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Trustworthy deployment of AI-based diagnosis in safety-critical mechanical systems hinges on validation: whether a prediction can be checked against physical reality before it is acted upon. Current intelligent fault diagnosers fail this standard in two ways. Their standard output, a class label with a softmax confidence score, is an internal statistic of the classifier, offering nothing checkable against independent physical knowledge; and the growing use of generative language models in maintenance reporting adds a second risk: hallucinated content entering reports on which decisions rest. Taking bearing fault diagnosis as the testbed, this work addresses both problems from the output side. The proposed Diagnostic Evidence Network (DENet) is an encoder-agnostic multi-task framework extending the output to a structured evidence record: the classification, a predicted characteristic frequency comparable against the theoretical value determined by bearing geometry and shaft speed, and a temporal localization of transient impulses inspectable on the raw waveform. Across four encoders and three public datasets, this evidence incurs no statistically significant accuracy cost, with a frequency error of about 6 Hz on 1,024-point segments where spectral estimation is structurally inapplicable. Centrally, the deviation between predicted and theoretical frequency constitutes a label-free, inference-time validation signal: it detects misclassifications with AUROC values of 0.970 and 0.871, and remains discriminative in the high-confidence regime where confidence-derived detectors are blind. Finally, a QLoRA-adapted language model is constrained to translate, but never generate, diagnostic content, reducing unsupported-claim rates from 10-12% to 2% and eliminating fabricated quantities.
Related papers
- Conformalized Large Language Models under Configuration Shift [46.502741608809174]
Conformal prediction is a distribution-free framework for uncertainty quantification.<n>Nonconformity scores are often induced by an inference pipeline, not just a fixed model.<n>We show that configuration shift consistently erodes CP validity.
arXiv Detail & Related papers (2026-08-02T19:34:41Z) - Understanding Online Failure Prediction in Linux Through Complementary Multi-View Explainability [0.0]
This paper reports a practical experience building and evaluating an explainable Online Failure Prediction pipeline for Linux OSs.<n>We combine consensus-based feature selection for detection with temporal onset analysis, subsystemlevel causal analysis, and complementary diagnostic mechanisms to support failure interpretation.
arXiv Detail & Related papers (2026-08-01T13:12:59Z) - Conformal Changepoint Localization and Root Cause Analysis with Corrupted Observations [55.76952683833966]
This paper proposes weighted CONCH (W-CONCH) and weighted CROC (W-CROC) to reduce confidence set size when data may be corrupted.<n>Experiments on image-based and real-world changepoint and root-cause benchmarks show that uncertainty-based weighting substantially reduces confidence set size.
arXiv Detail & Related papers (2026-07-29T05:16:59Z) - Fault Detection and Explainable Classification in Automotive HIL Validation via Denoising Autoencoders and In-Context Large Language Models [1.9435397960631864]
Machine and deep learning have advanced fault diagnosis, yet most supervised models require large labelled datasets.<n>We propose a generalisable and explainable two-phase framework for fault detection and classification during real-time validation.
arXiv Detail & Related papers (2026-07-04T06:43:43Z) - A prior-free blind detection of information leakage from model predictions [0.0]
We give a decision-theoretic framework in which leakage diagnostics are functionals of the predicted-risk/outcome law.<n>A recalibrated leak matching an honest model's calibration and discrimination is indistinguishable from honest performance by emphany function of the predictions.<n>A near-deterministic subgroup produces a sustained unit-purity head that no legitimate predictor of a non-deterministic outcome can manufacture.
arXiv Detail & Related papers (2026-06-09T05:13:03Z) - An Uncertainty-Aware Resilience Micro-Agent for Causal Observability in the Computing Continuum [2.589200983166521]
This paper presents an uncertainty-aware resilience micro-agent for causal observability (AURORA)<n>AURORA employs parallel micro-agents that integrate the free-energy principle, causal do-calculus, and localized causal state-graphs to support root-cause analysis within each fault's Markov blanket.<n>Our experiments demonstrate that AURORA outperforms baselines, achieving a 0% destructive action rate, while maintaining 62.0% repair accuracy and a 3ms mean time to repair.
arXiv Detail & Related papers (2026-05-11T15:28:37Z) - Towards Trustworthy Depression Estimation via Disentangled Evidential Learning [50.22167852149165]
We propose EviDep, an evidential learning framework that jointly quantifies depression severity.<n>EviDep enforces strict information integrity to guarantee robust evidence synthesis.<n>It achieves state-of-the-art predictive accuracy and superior uncertainty calibration, delivering a robust fail-safe mechanism for trustworthy clinical screening.
arXiv Detail & Related papers (2026-04-17T13:27:11Z) - VIBEPASS: Can Vibe Coders Really Pass the Vibe Check? [46.85901599242161]
We evaluate two coupled tasks: emphFault-Triggering Test Generation (FT-Test) and emphFault-targeted Program Repair (FPR)<n>We find that fault-targeted reasoning does not scale with general coding ability.<n>Test-guided repair reveals a complementary insight: when self-generated tests successfully witness a fault, the resulting repair matches or outperforms repair guided by externally provided tests, but tests that fail to witness the fault actively degrade repair below unguided baselines.
arXiv Detail & Related papers (2026-03-16T21:14:28Z) - Decomposed Prompting Does Not Fix Knowledge Gaps, But Helps Models Say "I Don't Know" [47.930782177987446]
Large language models often struggle to recognize their knowledge limits in closed-book question answering, leading to confident hallucinations.<n>We evaluate three task-equivalent prompting regimes: Direct, Assistive, and Incremental, across different model scales and multi-hop QA benchmarks.<n>Because factual knowledge is stable while hallucinations are agreement, cross-regime provides a precise signal of internal uncertainty.
arXiv Detail & Related papers (2026-02-04T18:39:58Z) - Modeling Clinical Uncertainty in Radiology Reports: from Explicit Uncertainty Markers to Implicit Reasoning Pathways [16.76473492794096]
Explicit uncertainty reflects doubt about the presence or absence of findings, conveyed through hedging phrases.<n>Implicit uncertainty arises when radiologists omit parts of their reasoning, recording only key findings or diagnoses.<n>Here, it is often unclear whether omitted findings are truly absent or simply unmentioned for brevity.<n>We quantify explicit uncertainty by creating an expert-validated, LLM-based reference ranking of common hedging phrases, and mapping each finding to a probability value based on this reference.<n>In addition, we model implicit uncertainty through an expansion framework that systematically adds characteristic sub-findings derived from expert-defined diagnostic pathways for 14 common diagnoses.
arXiv Detail & Related papers (2025-11-06T16:24:53Z) - Fault detection and diagnosis for the engine electrical system of a space launcher based on a temporal convolutional autoencoder and calibrated classifiers [0.0]
This paper outlines a first step toward developing an onboard fault detection and diagnostic capability for the next generation of reusable space launchers.<n>Unlike existing approaches in the literature, our solution is designed to meet a broader range of key requirements.<n>The proposed solution is based on a temporal convolutional autoencoder to automatically extract low-dimensional features from raw sensor data.
arXiv Detail & Related papers (2025-07-17T11:50:29Z) - Unlocking the Potential of Weakly Labeled Data: A Co-Evolutionary Learning Framework for Abnormality Detection and Report Generation [44.41011570487469]
Anatomical abnormality detection and report generation of chest X-ray (CXR) are two essential tasks in clinical practice.<n>Existing methods often focused on either task separately, ignoring their correlation.<n>This work proposes a co-evolutionary abnormality detection and report generation framework.
arXiv Detail & Related papers (2024-12-18T08:31:26Z) - Causal Disentanglement Hidden Markov Model for Fault Diagnosis [55.90917958154425]
We propose a Causal Disentanglement Hidden Markov model (CDHM) to learn the causality in the bearing fault mechanism.
Specifically, we make full use of the time-series data and progressively disentangle the vibration signal into fault-relevant and fault-irrelevant factors.
To expand the scope of the application, we adopt unsupervised domain adaptation to transfer the learned disentangled representations to other working environments.
arXiv Detail & Related papers (2023-08-06T05:58:45Z) - Towards Reliable Medical Image Segmentation by Modeling Evidential Calibrated Uncertainty [57.023423137202485]
Concerns regarding the reliability of medical image segmentation persist among clinicians.<n>We introduce DEviS, an easily implementable foundational model that seamlessly integrates into various medical image segmentation networks.<n>By leveraging subjective logic theory, we explicitly model probability and uncertainty for medical image segmentation.
arXiv Detail & Related papers (2023-01-01T05:02:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.