Fault Detection and Explainable Classification in Automotive HIL Validation via Denoising Autoencoders and In-Context Large Language Models

• URL: http://arxiv.org/abs/2607.03734v1
• Date: Sat, 04 Jul 2026 06:43:43 GMT
• Title: Fault Detection and Explainable Classification in Automotive HIL Validation via Denoising Autoencoders and In-Context Large Language Models
• Abstract summary: Machine and deep learning have advanced fault diagnosis, yet most supervised models require large labelled datasets.<n>We propose a generalisable and explainable two-phase framework for fault detection and classification during real-time validation.
• Score: 1.9435397960631864
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Validating automotive software systems produces large multivariate test recordings that are still examined through effort-intensive manual review and rule-based evaluation, which detects faults beyond predefined rules poorly. Machine and deep learning have advanced fault diagnosis, yet most supervised models require large labelled datasets, generalise poorly to unseen conditions, and offer little insight into their decisions. We propose a generalisable and explainable two-phase framework for fault detection and classification during real-time validation. A denoising autoencoder trained only on healthy signals first flags abnormal behaviour through reconstruction-error analysis, removing the need for fault labels. Each abnormal window is then encoded as compact textual statistical evidence relative to a time-aligned healthy reference and classified by a frozen large language model under zero-shot and few-shot prompting, returning the predicted class, ranked alternatives, a confidence value, the fault location, and a short evidence-based explanation. Eight open-source models are evaluated across two powertrains and three driving regimes. The detector attains average F1-scores of 0.97 across powertrains and 0.98 across regimes, with average mean error below 0.03. Zero-shot prompting proves insufficient (best 0.519 F1-score), whereas few-shot prompting reaches perfect discrimination under stable regimes, showing that prompting strategy, rather than parameter count, governs classification quality: a nine-billion-parameter model surpasses every zero-shot medium and large model. Mistral Small 24B is adopted as the main pipeline model for its balance of accuracy, class-balanced reliability, calibration, and inference cost, giving engineers interpretable diagnostic reports and more efficient validation.

Related papers

• NovGauge: A Fine-Grained Benchmark for Diagnosing LLMs' Capability in Paper Novelty Assessment [54.4265627247104]
  Large language models (LLMs) are increasingly used in peer review at major AI conferences.<n>Existing benchmarks assess novelty as a single holistic score.<n>We present NovGauge, a human-anchored benchmark for fine-grained novelty assessment diagnosis.
  arXiv  Detail & Related papers  (2026-09-10T08:34:56Z)
• LLM Ensemble Fault Classification for Automotive HiL Validation [1.9435397960631864]
  This paper proposes an explainable multi-LLM ensemble framework for sensor-level fault classification in automotive validation.<n>The framework uses compact evidence representations of fault-injection recordings and combines the outputs of heterogeneous large language models.<n>The approach is evaluated on gasoline-engine and electric-vehicle HiL systems across three driving settings and ten single-fault classes.
  arXiv  Detail & Related papers  (2026-08-11T09:31:18Z)
• Sensor-Level Fault Diagnosis for Automotive Software Validation Using Large Language Models [1.9435397960631864]
  This study examines whether open-source instruction-tuned large language models (LLMs) can serve as data-efficient and interpretable engines for fault detection and diagnosis inside the validation loop.<n>A two-phase framework is proposed: automated requirement checking on a dSPACE real-time platform first isolates the recordings that violate a safety requirement, and only these are inspected.<n>Four model families ranging from two to eight billion parameters were adapted and tested on a gasoline-engine case study spanning six injected fault classes.
  arXiv  Detail & Related papers  (2026-08-06T11:50:14Z)
• Cybersecurity Detection Classification with Reasoning-enabled Language Models [50.72675435043546]
  A major issue in Security Operations Centers (SOCs) is alert fatigue.<n>Prior work prompts or fine-tunes large language models (LLMs) to emit a triage label directly, but does not train them to reason about whether a detection is a genuine threat.<n>We train a chain-of-thought (CoT) reasoning-enabled triage classifier on real, human-labeled Windows endpoint detections.
  arXiv  Detail & Related papers  (2026-07-30T16:22:13Z)
• Physically Verifiable Evidence and LLM-Based Reporting for Bearing Fault Diagnosis [6.168311548428149]
  Diagnostic Evidence Network (DENet) is an encoder-agnostic multi-task framework extending the output to a structured evidence record.<n>It incurs no statistically significant accuracy cost, with a frequency error of about 6 Hz on 1,024-point segments.<n>It detects misclassifications with AUROC values of 0.970 and 0.871, and remains discriminative in the high-confidence regime.
  arXiv  Detail & Related papers  (2026-07-24T14:09:16Z)
• DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation [50.584834483403675]
  Adapting pre-trained text-to-image diffusion models, whether to learn new visual concepts or erase unwanted ones, is routinely evaluated on its intended effects alone.<n>We demonstrate that adaptation systematically damages semantically unrelated concepts in ways that aggregate metrics structurally cannot surface.<n>We introduce DriftScope, a prompt-level diagnostic tool that takes any two model checkpoints and returns a ranked list of tokens whose visual concepts have shifted most between them.
  arXiv  Detail & Related papers  (2026-06-30T20:57:51Z)
• What Single-Prompt Accuracy Misses: A Multi-Variant Reliability Audit of Language Models [0.0]
  Single-prompt accuracy is the dominant way to benchmark language models, but it can miss reliability failures that matter.<n>We evaluate a 15-model open-weight corpus, with the main reliability analyses focused on 10 instruct models across five classification and reasoning benchmarks.<n>We find three broad results. First, evaluation design can materially change the conclusion.<n>Second, confidence signals are fragile. On MMLU-Pro, every primary model verbally reports confidence substantially above both its accuracy and its token-probability confidence on the same rows, and verbal parse rate can collapse for a single model on a single prompt variant.
  arXiv  Detail & Related papers  (2026-05-03T20:05:08Z)
• LiveFMBench: Unveiling the Power and Limits of Agentic Workflows in Specification Generation [75.05397479715576]
  Large language models (LLMs) and agents have shown promising progress, but their true capabilities and failure modes remain unclear.<n>We present the first systematic and contamination-aware study of LLM- and agent-based formal specification generation for C programs.
  arXiv  Detail & Related papers  (2026-05-02T11:31:33Z)
• SAAG: Structured Agent Assessment and Grounding [13.62148061055744]
  We propose a cascaded diagnostic framework that decomposes agent-calling evaluation into three sequential stages.<n>We evaluate this framework on a benchmark derived from Glaive's function-calling dataset across registry sizes of 5, 10, and 15 agents.
  arXiv  Detail & Related papers  (2026-04-30T19:33:58Z)
• LLM-Enhanced Log Anomaly Detection: A Comprehensive Benchmark of Large Language Models for Automated System Diagnostics [0.0]
  Large Language Models (LLMs) offer promising new approaches to log understanding.<n>LLMs demonstrate remarkablezero-shot capabilities without requiring any labeled training data.<n>Our findings provide actionable guidelines for choosing log anomaly detection methods.
  arXiv  Detail & Related papers  (2026-04-14T02:51:48Z)
• Fault detection and diagnosis for the engine electrical system of a space launcher based on a temporal convolutional autoencoder and calibrated classifiers [0.0]
  This paper outlines a first step toward developing an onboard fault detection and diagnostic capability for the next generation of reusable space launchers.<n>Unlike existing approaches in the literature, our solution is designed to meet a broader range of key requirements.<n>The proposed solution is based on a temporal convolutional autoencoder to automatically extract low-dimensional features from raw sensor data.
  arXiv  Detail & Related papers  (2025-07-17T11:50:29Z)
• Consistency-based Abductive Reasoning over Perceptual Errors of Multiple Pre-trained Models in Novel Environments [5.5855749614100825]
  This paper addresses the hypothesis that leveraging multiple pre-trained models can mitigate this recall reduction.<n>We formulate the challenge of identifying and managing conflicting predictions from various models as a consistency-based abduction problem.<n>Our results validate the use of consistency-based abduction as an effective mechanism to robustly integrate knowledge from multiple imperfect models in challenging, novel scenarios.
  arXiv  Detail & Related papers  (2025-05-25T23:17:47Z)
• When Does Confidence-Based Cascade Deferral Suffice? [69.28314307469381]
  Cascades are a classical strategy to enable inference cost to vary adaptively across samples. A deferral rule determines whether to invoke the next classifier in the sequence, or to terminate prediction. Despite being oblivious to the structure of the cascade, confidence-based deferral often works remarkably well in practice.
  arXiv  Detail & Related papers  (2023-07-06T04:13:57Z)
• Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors [105.12462629663757]
  In this work, we aggregate factuality error annotations from nine existing datasets and stratify them according to the underlying summarization model. We compare performance of state-of-the-art factuality metrics, including recent ChatGPT-based metrics, on this stratified benchmark and show that their performance varies significantly across different types of summarization models.
  arXiv  Detail & Related papers  (2022-05-25T15:26:48Z)
• Anomaly Detection in Cybersecurity: Unsupervised, Graph-Based and Supervised Learning Methods in Adversarial Environments [63.942632088208505]
  Inherent to today's operating environment is the practice of adversarial machine learning. In this work, we examine the feasibility of unsupervised learning and graph-based methods for anomaly detection. We incorporate a realistic adversarial training mechanism when training our supervised models to enable strong classification performance in adversarial environments.
  arXiv  Detail & Related papers  (2021-05-14T10:05:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.