Reconstructed Student-Teacher and Discriminative Networks for Anomaly Detection

• URL: http://arxiv.org/abs/2210.07548v1
• Date: Fri, 14 Oct 2022 05:57:50 GMT
• Title: Reconstructed Student-Teacher and Discriminative Networks for Anomaly Detection
• Authors: Shinji Yamada, Satoshi Kamiya, Kazuhiro Hotta
• Abstract summary: A powerful anomaly detection method is proposed based on student-teacher feature pyramid matching (STPM), which consists of a student and teacher network. To improve the accuracy of STPM, this work uses a student network, as in generative models, to reconstruct normal features. To further improve accuracy, a discriminative network trained with pseudo-anomalies from anomaly maps is used in our method.
• Score: 8.35780131268962
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Anomaly detection is an important problem in computer vision; however, the scarcity of anomalous samples makes this task difficult. Thus, recent anomaly detection methods have used only normal images with no abnormal areas for training. In this work, a powerful anomaly detection method is proposed based on student-teacher feature pyramid matching (STPM), which consists of a student and teacher network. Generative models are another approach to anomaly detection. They reconstruct normal images from an input and compute the difference between the predicted normal and the input. Unfortunately, STPM does not have the ability to generate normal images. To improve the accuracy of STPM, this work uses a student network, as in generative models, to reconstruct normal features. This improves the accuracy; however, the anomaly maps for normal images are not clean because STPM does not use anomaly images for training, which decreases the accuracy of the image-level anomaly detection. To further improve accuracy, a discriminative network trained with pseudo-anomalies from anomaly maps is used in our method, which consists of two pairs of student-teacher networks and a discriminative network. The method displayed high accuracy on the MVTec anomaly detection dataset.

Related papers

• Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detection [88.34095233600719]
  FAPrompt is a novel framework designed to learn Fine-grained Abnormality Prompts for more accurate ZSAD. It substantially outperforms state-of-the-art methods by at least 3%-5% AUC/AP in both image- and pixel-level ZSAD tasks.
  arXiv  Detail & Related papers  (2024-10-14T08:41:31Z)
• Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
  We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images. SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images. Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-21T15:41:34Z)
• Normality Learning-based Graph Anomaly Detection via Multi-Scale Contrastive Learning [61.57383634677747]
  Graph anomaly detection (GAD) has attracted increasing attention in machine learning and data mining. Here, we propose a normality learning-based GAD framework via multi-scale contrastive learning networks (NLGAD for abbreviation) Notably, the proposed algorithm improves the detection performance (up to 5.89% AUC gain) compared with the state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-09-12T08:06:04Z)
• EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies [1.1602089225841632]
  We propose a lightweight feature extractor that processes an image in less than a millisecond on a modern GPU. We then use a student-teacher approach to detect anomalous features. We evaluate our method, called EfficientAD, on 32 datasets from three industrial anomaly detection dataset collections.
  arXiv  Detail & Related papers  (2023-03-25T18:48:33Z)
• Supervised Anomaly Detection Method Combining Generative Adversarial Networks and Three-Dimensional Data in Vehicle Inspections [0.0]
  The external visual inspections of rolling stock's underfloor equipment are currently being performed via human visual inspection. In this study, we propose a new method that uses style conversion via generative adversarial networks on three-dimensional computer graphics.
  arXiv  Detail & Related papers  (2022-12-22T06:39:52Z)
• Asymmetric Student-Teacher Networks for Industrial Anomaly Detection [22.641661538154054]
  This work discovers previously unknown problems of student-teacher approaches for anomaly detection. Two neural networks are trained to produce the same output for the defect-free training examples. Our method produces state-of-the-art results on the two currently most relevant defect detection datasets MVTec AD and MVTec 3D-AD.
  arXiv  Detail & Related papers  (2022-10-14T13:56:50Z)
• Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images [29.57501199670898]
  We introduce one-class semi-supervised learning (OC-SSL) to utilize known normal and unlabeled images for training. Ensembles of reconstruction networks are designed to model the distribution of normal images and the distribution of both normal and unlabeled images. We propose a new perspective on self-supervised learning, which is designed to refine the anomaly scores rather than detect anomalies directly.
  arXiv  Detail & Related papers  (2022-10-09T11:18:45Z)
• SLA$^2$P: Self-supervised Anomaly Detection with Adversarial Perturbation [77.71161225100927]
  Anomaly detection is a fundamental yet challenging problem in machine learning. We propose a novel and powerful framework, dubbed as SLA$2$P, for unsupervised anomaly detection.
  arXiv  Detail & Related papers  (2021-11-25T03:53:43Z)
• Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
  We introduce a novel weakly-supervised anomaly detection framework to train detection models. The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability. Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
  arXiv  Detail & Related papers  (2021-08-01T14:33:17Z)
• CutPaste: Self-Supervised Learning for Anomaly Detection and Localization [59.719925639875036]
  We propose a framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects.
  arXiv  Detail & Related papers  (2021-04-08T19:04:55Z)
• Image Anomaly Detection by Aggregating Deep Pyramidal Representations [16.246831343527052]
  Anomaly detection consists in identifying, within a dataset, those samples that significantly differ from the majority of the data. This paper focuses on image anomaly detection using a deep neural network with multiple pyramid levels to analyze the image features at different scales.
  arXiv  Detail & Related papers  (2020-11-12T09:58:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.