Self-Supervised Anomaly Detection in Computer Vision and Beyond: A
Survey and Outlook
- URL: http://arxiv.org/abs/2205.05173v5
- Date: Tue, 23 Jan 2024 06:25:31 GMT
- Title: Self-Supervised Anomaly Detection in Computer Vision and Beyond: A
Survey and Outlook
- Authors: Hadi Hojjati, Thi Kieu Khanh Ho, Narges Armanfard
- Abstract summary: Anomaly detection plays a crucial role in various domains, including cybersecurity, finance, and healthcare.
In recent years, significant progress has been made in this field due to the remarkable growth of deep learning models.
The advent of self-supervised learning has sparked the development of novel AD algorithms that outperform the existing state-of-the-art approaches.
- Score: 9.85256783464329
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Anomaly detection (AD) plays a crucial role in various domains, including
cybersecurity, finance, and healthcare, by identifying patterns or events that
deviate from normal behaviour. In recent years, significant progress has been
made in this field due to the remarkable growth of deep learning models.
Notably, the advent of self-supervised learning has sparked the development of
novel AD algorithms that outperform the existing state-of-the-art approaches by
a considerable margin. This paper aims to provide a comprehensive review of the
current methodologies in self-supervised anomaly detection. We present
technical details of the standard methods and discuss their strengths and
drawbacks. We also compare the performance of these models against each other
and other state-of-the-art anomaly detection models. Finally, the paper
concludes with a discussion of future directions for self-supervised anomaly
detection, including the development of more effective and efficient algorithms
and the integration of these techniques with other related fields, such as
multi-modal learning.
Related papers
- Large Language Models for Forecasting and Anomaly Detection: A
Systematic Literature Review [10.325003320290547]
This systematic literature review comprehensively examines the application of Large Language Models (LLMs) in forecasting and anomaly detection.
LLMs have demonstrated significant potential in parsing and analyzing extensive datasets to identify patterns, predict future events, and detect anomalous behavior across various domains.
This review identifies several critical challenges that impede their broader adoption and effectiveness, including the reliance on vast historical datasets, issues with generalizability across different contexts, and the phenomenon of model hallucinations.
arXiv Detail & Related papers (2024-02-15T22:43:02Z) - Masked Modeling for Self-supervised Representation Learning on Vision
and Beyond [69.64364187449773]
Masked modeling has emerged as a distinctive approach that involves predicting parts of the original data that are proportionally masked during training.
We elaborate on the details of techniques within masked modeling, including diverse masking strategies, recovering targets, network architectures, and more.
We conclude by discussing the limitations of current techniques and point out several potential avenues for advancing masked modeling research.
arXiv Detail & Related papers (2023-12-31T12:03:21Z) - Deep Anomaly Detection in Text [3.4265828682659705]
This thesis aims to develop a method for detecting anomalies by exploiting pretext tasks tailored for text corpora.
This approach greatly improves the state-of-the-art on two datasets, 20Newsgroups, and AG News, for both semi-supervised and unsupervised anomaly detection.
arXiv Detail & Related papers (2023-12-14T22:04:43Z) - The Fairness Stitch: Unveiling the Potential of Model Stitching in
Neural Network De-Biasing [0.043512163406552]
This study introduces a novel method called "The Fairness Stitch" to enhance fairness in deep learning models.
We conduct a comprehensive evaluation of two well-known datasets, CelebA and UTKFace.
Our findings reveal a notable improvement in achieving a balanced trade-off between fairness and performance.
arXiv Detail & Related papers (2023-11-06T21:14:37Z) - Unsupervised Pathology Detection: A Deep Dive Into the State of the Art [6.667150890634173]
We evaluate a selection of cutting-edge Unsupervised Anomaly Detection (UAD) methods on multiple medical datasets.
Our experiments demonstrate that newly developed feature-modeling methods from the industrial and medical literature achieve increased performance.
We show that such methods are capable of benefiting from recently developed self-supervised pre-training algorithms.
arXiv Detail & Related papers (2023-03-01T16:03:25Z) - GLUECons: A Generic Benchmark for Learning Under Constraints [102.78051169725455]
In this work, we create a benchmark that is a collection of nine tasks in the domains of natural language processing and computer vision.
We model external knowledge as constraints, specify the sources of the constraints for each task, and implement various models that use these constraints.
arXiv Detail & Related papers (2023-02-16T16:45:36Z) - Deep Learning for Time Series Anomaly Detection: A Survey [53.83593870825628]
Time series anomaly detection has applications in a wide range of research fields and applications, including manufacturing and healthcare.
The large size and complex patterns of time series have led researchers to develop specialised deep learning models for detecting anomalous patterns.
This survey focuses on providing structured and comprehensive state-of-the-art time series anomaly detection models through the use of deep learning.
arXiv Detail & Related papers (2022-11-09T22:40:22Z) - Knowledge as Invariance -- History and Perspectives of
Knowledge-augmented Machine Learning [69.99522650448213]
Research in machine learning is at a turning point.
Research interests are shifting away from increasing the performance of highly parameterized models to exceedingly specific tasks.
This white paper provides an introduction and discussion of this emerging field in machine learning research.
arXiv Detail & Related papers (2020-12-21T15:07:19Z) - A Unifying Review of Deep and Shallow Anomaly Detection [38.202998314502786]
We aim to identify the common underlying principles as well as the assumptions that are often made implicitly by various methods.
We provide an empirical assessment of major existing methods that is enriched by the use of recent explainability techniques.
We outline critical open challenges and identify specific paths for future research in anomaly detection.
arXiv Detail & Related papers (2020-09-24T14:47:54Z) - A Comprehensive Study on Temporal Modeling for Online Action Detection [50.558313106389335]
Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years.
This paper aims to provide a comprehensive study on temporal modeling for OAD including four meta types of temporal modeling methods.
We present several hybrid temporal modeling methods, which outperform the recent state-of-the-art methods with sizable margins on THUMOS-14 and TVSeries.
arXiv Detail & Related papers (2020-01-21T13:12:58Z) - Rethinking Generalization of Neural Models: A Named Entity Recognition
Case Study [81.11161697133095]
We take the NER task as a testbed to analyze the generalization behavior of existing models from different perspectives.
Experiments with in-depth analyses diagnose the bottleneck of existing neural NER models.
As a by-product of this paper, we have open-sourced a project that involves a comprehensive summary of recent NER papers.
arXiv Detail & Related papers (2020-01-12T04:33:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.