Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks

• URL: http://arxiv.org/abs/2111.12379v1
• Date: Wed, 24 Nov 2021 09:54:50 GMT
• Title: Efficient Anomaly Detection Using Self-Supervised Multi-Cue Tasks
• Authors: Loic Jezequel, Ngoc-Son Vu, Jean Beaudet, Aymeric Histace
• Abstract summary: We introduce novel discriminative and generative tasks which focus on different visual cues. We present a new out-of-distribution detection function and highlight its better stability compared to other out-of-distribution detection methods. Our model can more accurately learn highly discriminative features using these self-supervised tasks.
• Score: 2.9237210794416755
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep anomaly detection has proven to be an efficient and robust approach in several fields. The introduction of self-supervised learning has greatly helped many methods including anomaly detection where simple geometric transformation recognition tasks are used. However these methods do not perform well on fine-grained problems since they lack finer features and are usually highly dependent on the anomaly type. In this paper, we explore each step of self-supervised anomaly detection with pretext tasks. First, we introduce novel discriminative and generative tasks which focus on different visual cues. A piece-wise jigsaw puzzle task focuses on structure cues, while a tint rotation recognition is used on each piece for colorimetry and a partial re-colorization task is performed. In order for the re-colorization task to focus more on the object rather than on the background, we propose to include the contextual color information of the image border. Then, we present a new out-of-distribution detection function and highlight its better stability compared to other out-of-distribution detection methods. Along with it, we also experiment different score fusion functions. Finally, we evaluate our method on a comprehensive anomaly detection protocol composed of object anomalies with classical object recognition, style anomalies with fine-grained classification and local anomalies with face anti-spoofing datasets. Our model can more accurately learn highly discriminative features using these self-supervised tasks. It outperforms state-of-the-art with up to 36% relative error improvement on object anomalies and 40% on face anti-spoofing problems.

Related papers

• GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features [68.14842693208465]
  GeneralAD is an anomaly detection framework designed to operate in semantic, near-distribution, and industrial settings. We propose a novel self-supervised anomaly generation module that employs straightforward operations like noise addition and shuffling to patch features. We extensively evaluated our approach on ten datasets, achieving state-of-the-art results in six and on-par performance in the remaining.
  arXiv  Detail & Related papers  (2024-07-17T09:27:41Z)
• Continuous Memory Representation for Anomaly Detection [24.58611060347548]
  CRAD is a novel anomaly detection method for representing normal features within a "continuous" memory. In an evaluation using the MVTec AD dataset, CRAD significantly outperforms the previous state-of-the-art method by reducing 65.0% of the error for multi-class unified anomaly detection.
  arXiv  Detail & Related papers  (2024-02-28T12:38:44Z)
• Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection [59.41026558455904]
  We focus on multi-modal anomaly detection. Specifically, we investigate early multi-modal approaches that attempted to utilize models pre-trained on large-scale visual datasets. We propose a Local-to-global Self-supervised Feature Adaptation (LSFA) method to finetune the adaptors and learn task-oriented representation toward anomaly detection.
  arXiv  Detail & Related papers  (2024-01-06T07:30:41Z)
• Don't Miss Out on Novelty: Importance of Novel Features for Deep Anomaly Detection [64.21963650519312]
  Anomaly Detection (AD) is a critical task that involves identifying observations that do not conform to a learned model of normality. We propose a novel approach to AD using explainability to capture such novel features as unexplained observations in the input space. Our approach establishes a new state-of-the-art across multiple benchmarks, handling diverse anomaly types.
  arXiv  Detail & Related papers  (2023-10-01T21:24:05Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• UniFormaly: Towards Task-Agnostic Unified Framework for Visual Anomaly Detection [6.260747047974035]
  We present UniFormaly, a universal and powerful anomaly detection framework. We emphasize the necessity of our off-the-shelf approach by pointing out a suboptimal issue in online encoder-based methods. UniFormaly achieves outstanding results on various tasks and datasets.
  arXiv  Detail & Related papers  (2023-07-24T06:04:12Z)
• Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection [97.93062818228015]
  We propose to integrate the reconstruction-based functionality into a novel self-supervised predictive architectural building block. Our block is equipped with a loss that minimizes the reconstruction error with respect to the masked area in the receptive field. We demonstrate the generality of our block by integrating it into several state-of-the-art frameworks for anomaly detection on image and video.
  arXiv  Detail & Related papers  (2021-11-17T13:30:31Z)
• Multi-Perspective Anomaly Detection [3.3511723893430476]
  We build upon the deep support vector data description algorithm and address multi-perspective anomaly detection. We employ different augmentation techniques with a denoising process to deal with scarce one-class data. We evaluate our approach on the new dices dataset using images from two different perspectives and also benchmark on the standard MNIST dataset.
  arXiv  Detail & Related papers  (2021-05-20T17:07:36Z)
• Masked Contrastive Learning for Anomaly Detection [10.499890749386676]
  We propose a task-specific variant of contrastive learning named masked contrastive learning. We also propose a new inference method dubbed self-ensemble inference.
  arXiv  Detail & Related papers  (2021-05-18T19:27:02Z)
• Fine-grained Anomaly Detection via Multi-task Self-Supervision [2.9237210794416755]
  Self-supervised learning has greatly helped many methods including anomaly detection. By combining in a multi-task framework high-scale shape features oriented task with low-scale fine features oriented task, our method greatly improves fine-grained anomaly detection. It outperforms state-of-the-art with up to 31% relative error reduction measured with AUROC on various anomaly detection problems.
  arXiv  Detail & Related papers  (2021-04-20T14:19:08Z)
• Anomaly Detection in Video via Self-Supervised and Multi-Task Learning [113.81927544121625]
  Anomaly detection in video is a challenging computer vision problem. In this paper, we approach anomalous event detection in video through self-supervised and multi-task learning at the object level.
  arXiv  Detail & Related papers  (2020-11-15T10:21:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.