Neural Transformation Learning for Deep Anomaly Detection Beyond Images

• URL: http://arxiv.org/abs/2103.16440v2
• Date: Wed, 31 Mar 2021 15:09:56 GMT
• Title: Neural Transformation Learning for Deep Anomaly Detection Beyond Images
• Authors: Chen Qiu, Timo Pfrommer, Marius Kloft, Stephan Mandt, Maja Rudolph
• Abstract summary: We present a simple end-to-end procedure for anomaly detection with learnable transformations. The key idea is to embed the transformed data into a semantic space such that the transformed data still resemble their untransformed form. Our method learns domain-specific transformations and detects anomalies more accurately than previous work.
• Score: 24.451389236365152
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Data transformations (e.g. rotations, reflections, and cropping) play an important role in self-supervised learning. Typically, images are transformed into different views, and neural networks trained on tasks involving these views produce useful feature representations for downstream tasks, including anomaly detection. However, for anomaly detection beyond image data, it is often unclear which transformations to use. Here we present a simple end-to-end procedure for anomaly detection with learnable transformations. The key idea is to embed the transformed data into a semantic space such that the transformed data still resemble their untransformed form, while different transformations are easily distinguishable. Extensive experiments on time series demonstrate that we significantly outperform existing methods on the one-vs.-rest setting but also on the more challenging n-vs.-rest anomaly-detection task. On tabular datasets from the medical and cyber-security domains, our method learns domain-specific transformations and detects anomalies more accurately than previous work.

Related papers

• Cross-domain and Cross-dimension Learning for Image-to-Graph Transformers [50.576354045312115]
  Direct image-to-graph transformation is a challenging task that solves object detection and relationship prediction in a single model. We introduce a set of methods enabling cross-domain and cross-dimension transfer learning for image-to-graph transformers. We demonstrate our method's utility in cross-domain and cross-dimension experiments, where we pretrain our models on 2D satellite images before applying them to vastly different target domains in 2D and 3D.
  arXiv  Detail & Related papers  (2024-03-11T10:48:56Z)
• Learning Transformations To Reduce the Geometric Shift in Object Detection [60.20931827772482]
  We tackle geometric shifts emerging from variations in the image capture process. We introduce a self-training approach that learns a set of geometric transformations to minimize these shifts. We evaluate our method on two different shifts, i.e., a camera's field of view (FoV) change and a viewpoint change.
  arXiv  Detail & Related papers  (2023-01-13T11:55:30Z)
• Supervised Anomaly Detection Method Combining Generative Adversarial Networks and Three-Dimensional Data in Vehicle Inspections [0.0]
  The external visual inspections of rolling stock's underfloor equipment are currently being performed via human visual inspection. In this study, we propose a new method that uses style conversion via generative adversarial networks on three-dimensional computer graphics.
  arXiv  Detail & Related papers  (2022-12-22T06:39:52Z)
• Masked Transformer for image Anomaly Localization [14.455765147827345]
  We propose a new model for image anomaly detection based on Vision Transformer architecture with patch masking. We show that multi-resolution patches and their collective embeddings provide a large improvement in the model's performance. The proposed model has been tested on popular anomaly detection datasets such as MVTec and head CT.
  arXiv  Detail & Related papers  (2022-10-27T15:30:48Z)
• Sketched Multi-view Subspace Learning for Hyperspectral Anomalous Change Detection [12.719327447589345]
  A sketched multi-view subspace learning model is proposed for anomalous change detection. The proposed model preserves major information from the image pairs and improves computational complexity. experiments are conducted on a benchmark hyperspectral remote sensing dataset and a natural hyperspectral dataset.
  arXiv  Detail & Related papers  (2022-10-09T14:08:17Z)
• An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers [0.0]
  We explore self-supervised methods based on image reconstruction, masked image modeling and jigsaw. Preliminary experiments in the iSAID dataset demonstrate faster convergence of DETR in the initial epochs in both pretraining and multi-task learning settings.
  arXiv  Detail & Related papers  (2022-05-11T14:39:27Z)
• Detecting Anomalies within Time Series using Local Neural Transformations [30.668488830909936]
  Local Neural Transformations(LNT) is a method learning local transformations of time series from data. LNT produces an anomaly score for each time step and thus can be used to detect anomalies within time series. Our experiments demonstrate that LNT can find anomalies in speech segments from the LibriSpeech data set and better detect interruptions to cyber-physical systems than previous work.
  arXiv  Detail & Related papers  (2022-02-08T15:51:31Z)
• SLA$^2$P: Self-supervised Anomaly Detection with Adversarial Perturbation [77.71161225100927]
  Anomaly detection is a fundamental yet challenging problem in machine learning. We propose a novel and powerful framework, dubbed as SLA$2$P, for unsupervised anomaly detection.
  arXiv  Detail & Related papers  (2021-11-25T03:53:43Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• CutPaste: Self-Supervised Learning for Anomaly Detection and Localization [59.719925639875036]
  We propose a framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects.
  arXiv  Detail & Related papers  (2021-04-08T19:04:55Z)
• Fine-grained Image-to-Image Transformation towards Visual Recognition [102.51124181873101]
  We aim at transforming an image with a fine-grained category to synthesize new images that preserve the identity of the input image. We adopt a model based on generative adversarial networks to disentangle the identity related and unrelated factors of an image. Experiments on the CompCars and Multi-PIE datasets demonstrate that our model preserves the identity of the generated images much better than the state-of-the-art image-to-image transformation models.
  arXiv  Detail & Related papers  (2020-01-12T05:26:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.