Implicit supervision for fault detection and segmentation of emerging
fault types with Deep Variational Autoencoders
- URL: http://arxiv.org/abs/1912.12502v2
- Date: Tue, 29 Sep 2020 19:23:57 GMT
- Title: Implicit supervision for fault detection and segmentation of emerging
fault types with Deep Variational Autoencoders
- Authors: Manuel Arias Chao, Bryan T. Adey, Olga Fink
- Abstract summary: We propose a variational autoencoder (VAE) with labeled and unlabeled samples while inducing implicit supervision on the latent representation of the healthy conditions.
This creates a compact and informative latent representation that allows good detection and segmentation of unseen fault types.
In an extensive comparison, we demonstrate that the proposed method outperforms other learning strategies.
- Score: 1.160208922584163
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Data-driven fault diagnostics of safety-critical systems often faces the
challenge of a complete lack of labeled data associated with faulty system
conditions (i.e., fault types) at training time. Since an unknown number and
nature of fault types can arise during deployment, data-driven fault
diagnostics in this scenario is an open-set learning problem. Most of the
algorithms for open-set diagnostics are one-class classification and
unsupervised algorithms that do not leverage all the available labeled and
unlabeled data in the learning algorithm. As a result, their fault detection
and segmentation performance (i.e., identifying and separating faults of
different types) are sub-optimal. With this work, we propose training a
variational autoencoder (VAE) with labeled and unlabeled samples while inducing
implicit supervision on the latent representation of the healthy conditions.
This, together with a modified sampling process of VAE, creates a compact and
informative latent representation that allows good detection and segmentation
of unseen fault types using existing one-class and clustering algorithms. We
refer to the proposed methodology as "knowledge induced variational autoencoder
with adaptive sampling" (KIL-AdaVAE). The fault detection and segmentation
capabilities of the proposed methodology are demonstrated in a new simulated
case study using the Advanced Geared Turbofan 30000 (AGTF30) dynamical model
under real flight conditions. In an extensive comparison, we demonstrate that
the proposed method outperforms other learning strategies (supervised learning,
supervised learning with embedding and semi-supervised learning) and deep
learning algorithms, yielding significant performance improvements on fault
detection and fault segmentation.
Related papers
- Collaborative Feature-Logits Contrastive Learning for Open-Set Semi-Supervised Object Detection [75.02249869573994]
In open-set scenarios, the unlabeled dataset contains both in-distribution (ID) classes and out-of-distribution (OOD) classes.
Applying semi-supervised detectors in such settings can lead to misclassifying OOD class as ID classes.
We propose a simple yet effective method, termed Collaborative Feature-Logits Detector (CFL-Detector)
arXiv Detail & Related papers (2024-11-20T02:57:35Z) - Can Tree Based Approaches Surpass Deep Learning in Anomaly Detection? A
Benchmarking Study [0.6291443816903801]
This paper evaluates a diverse array of machine learning-based anomaly detection algorithms.
The paper contributes significantly by conducting an unbiased comparison of various anomaly detection algorithms.
arXiv Detail & Related papers (2024-02-11T19:12:51Z) - Unsupervised Continual Anomaly Detection with Contrastively-learned
Prompt [80.43623986759691]
We introduce a novel Unsupervised Continual Anomaly Detection framework called UCAD.
The framework equips the UAD with continual learning capability through contrastively-learned prompts.
We conduct comprehensive experiments and set the benchmark on unsupervised continual anomaly detection and segmentation.
arXiv Detail & Related papers (2024-01-02T03:37:11Z) - Active Foundational Models for Fault Diagnosis of Electrical Motors [0.5999777817331317]
Fault detection and diagnosis of electrical motors is of utmost importance in ensuring the safe and reliable operation of industrial systems.
The existing data-driven deep learning approaches for machine fault diagnosis rely extensively on huge amounts of labeled samples.
We propose a foundational model-based Active Learning framework that utilizes less amount of labeled samples.
arXiv Detail & Related papers (2023-11-27T03:25:12Z) - Open-Vocabulary Video Anomaly Detection [57.552523669351636]
Video anomaly detection (VAD) with weak supervision has achieved remarkable performance in utilizing video-level labels to discriminate whether a video frame is normal or abnormal.
Recent studies attempt to tackle a more realistic setting, open-set VAD, which aims to detect unseen anomalies given seen anomalies and normal videos.
This paper takes a step further and explores open-vocabulary video anomaly detection (OVVAD), in which we aim to leverage pre-trained large models to detect and categorize seen and unseen anomalies.
arXiv Detail & Related papers (2023-11-13T02:54:17Z) - Learn then Test: Calibrating Predictive Algorithms to Achieve Risk
Control [67.52000805944924]
Learn then Test (LTT) is a framework for calibrating machine learning models.
Our main insight is to reframe the risk-control problem as multiple hypothesis testing.
We use our framework to provide new calibration methods for several core machine learning tasks with detailed worked examples in computer vision.
arXiv Detail & Related papers (2021-10-03T17:42:03Z) - Zero-sample surface defect detection and classification based on
semantic feedback neural network [13.796631421521765]
We propose an Ensemble Co-training algorithm, which adaptively reduces the prediction error in image tag embedding from multiple angles.
Various experiments conducted on the zero-shot dataset and the cylinder liner dataset in the industrial field provide competitive results.
arXiv Detail & Related papers (2021-06-15T08:26:36Z) - Bayesian Structural Learning for an Improved Diagnosis of Cyber-Physical
Systems [0.8379286663107844]
This paper proposes a scalable algorithm for an automated learning of a structured diagnosis model.
It offers equal performance to comparable algorithms while giving better interpretability.
arXiv Detail & Related papers (2021-04-02T11:14:05Z) - Meta-learning One-class Classifiers with Eigenvalue Solvers for
Supervised Anomaly Detection [55.888835686183995]
We propose a neural network-based meta-learning method for supervised anomaly detection.
We experimentally demonstrate that the proposed method achieves better performance than existing anomaly detection and few-shot learning methods.
arXiv Detail & Related papers (2021-03-01T01:43:04Z) - Data-Driven Fault Diagnosis Analysis and Open-Set Classification of
Time-Series Data [1.0152838128195467]
A framework for data-driven analysis and open-set classification is developed for fault diagnosis applications.
A data-driven fault classification algorithm is proposed which can handle imbalanced datasets, class overlapping, and unknown faults.
An algorithm is proposed to estimate the size of the fault when training data contains information from known fault realizations.
arXiv Detail & Related papers (2020-09-10T09:53:13Z) - Open Set Recognition with Conditional Probabilistic Generative Models [51.40872765917125]
We propose Conditional Probabilistic Generative Models (CPGM) for open set recognition.
CPGM can detect unknown samples but also classify known classes by forcing different latent features to approximate conditional Gaussian distributions.
Experiment results on multiple benchmark datasets reveal that the proposed method significantly outperforms the baselines.
arXiv Detail & Related papers (2020-08-12T06:23:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.