Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach

• URL: http://arxiv.org/abs/2311.16514v2
• Date: Sun, 7 Apr 2024 13:33:56 GMT
• Title: Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach
• Authors: Ayush K. Rai, Tarun Krishna, Feiyan Hu, Alexandru Drimbarean, Kevin McGuinness, Alan F. Smeaton, Noel E. O'Connor,
• Abstract summary: This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting. Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
• Score: 49.995833831087175
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Video Anomaly Detection (VAD) is an open-set recognition task, which is usually formulated as a one-class classification (OCC) problem, where training data is comprised of videos with normal instances while test data contains both normal and anomalous instances. Recent works have investigated the creation of pseudo-anomalies (PAs) using only the normal data and making strong assumptions about real-world anomalies with regards to abnormality of objects and speed of motion to inject prior information about anomalies in an autoencoder (AE) based reconstruction model during training. This work proposes a novel method for generating generic spatio-temporal PAs by inpainting a masked out region of an image using a pre-trained Latent Diffusion Model and further perturbing the optical flow using mixup to emulate spatio-temporal distortions in the data. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting by learning three types of anomaly indicators, namely reconstruction quality, temporal irregularity and semantic inconsistency. Extensive experiments on four VAD benchmark datasets namely Ped2, Avenue, ShanghaiTech and UBnormal demonstrate that our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting. Our analysis also examines the transferability and generalisation of PAs across these datasets, offering valuable insights by identifying real-world anomalies through PAs.

Related papers

• Anomaly Detection by Context Contrasting [57.695202846009714]
  Anomaly Detection focuses on identifying samples that deviate from the norm. Recent advances in self-supervised learning have shown great promise in this regard. We propose Con2, which addresses this problem by setting normal training data into distinct contexts. Our approach achieves state-of-the-art performance on various benchmarks while exhibiting superior performance in a more realistic healthcare setting.
  arXiv  Detail & Related papers  (2024-05-29T07:59:06Z)
• Spatial-temporal Memories Enhanced Graph Autoencoder for Anomaly Detection in Dynamic Graphs [52.956235109354175]
  Anomaly detection in dynamic graphs presents a significant challenge due to the temporal evolution of graph structures and attributes. We introduce a novel Spatial-Temporal memories-enhanced graph autoencoder (STRIPE) STRIPE has demonstrated a superior capability to discern anomalies by effectively leveraging the distinct spatial and temporal dynamics of dynamic graphs.
  arXiv  Detail & Related papers  (2024-03-14T02:26:10Z)
• AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model [59.08735812631131]
  Anomaly inspection plays an important role in industrial manufacture. Existing anomaly inspection methods are limited in their performance due to insufficient anomaly data. We propose AnomalyDiffusion, a novel diffusion-based few-shot anomaly generation model.
  arXiv  Detail & Related papers  (2023-12-10T05:13:40Z)
• Time-series Anomaly Detection via Contextual Discriminative Contrastive Learning [0.0]
  One-class classification methods are commonly used for anomaly detection tasks. We propose a novel approach inspired by the loss function of DeepSVDD. We combine our approach with a deterministic contrastive loss from Neutral AD, a promising self-supervised learning anomaly detection approach.
  arXiv  Detail & Related papers  (2023-04-16T21:36:19Z)
• PseudoBound: Limiting the anomaly reconstruction capability of one-class classifiers using pseudo anomalies [13.14903445595385]
  Autoencoder (AE) is trained to reconstruct the normal only training data with the expectation that, in test time, it can poorly reconstruct the anomalous data. We propose to limit the anomaly reconstruction capability of AEs by incorporating pseudo anomalies during the training of an AE. We demonstrate the effectiveness of our proposed pseudo anomaly based training approach against several existing state-ofthe-art (SOTA) methods on three benchmark video anomaly datasets.
  arXiv  Detail & Related papers  (2023-03-19T16:19:13Z)
• Unsupervised Visual Defect Detection with Score-Based Generative Model [17.610722842950555]
  We focus on the unsupervised visual defect detection and localization tasks. We propose a novel framework based on the recent score-based generative models. We evaluate our method on several datasets to demonstrate its effectiveness.
  arXiv  Detail & Related papers  (2022-11-29T11:06:29Z)
• Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
  We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples. We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
  arXiv  Detail & Related papers  (2022-06-23T14:16:30Z)
• Object-centric and memory-guided normality reconstruction for video anomaly detection [56.64792194894702]
  This paper addresses anomaly detection problem for videosurveillance. Due to the inherent rarity and heterogeneity of abnormal events, the problem is viewed as a normality modeling strategy. Our model learns object-centric normal patterns without seeing anomalous samples during training.
  arXiv  Detail & Related papers  (2022-03-07T19:28:39Z)
• Learning Not to Reconstruct Anomalies [14.632592282260363]
  Autoencoder (AE) is trained to reconstruct the input with training set consisting only of normal data. AE is then expected to well reconstruct the normal data while poorly reconstructing the anomalous data. We propose a novel methodology to train AEs with the objective of reconstructing only normal data, regardless of the input.
  arXiv  Detail & Related papers  (2021-10-19T05:22:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.