BatchNorm-based Weakly Supervised Video Anomaly Detection
- URL: http://arxiv.org/abs/2311.15367v1
- Date: Sun, 26 Nov 2023 17:47:57 GMT
- Title: BatchNorm-based Weakly Supervised Video Anomaly Detection
- Authors: Yixuan Zhou, Yi Qu, Xing Xu, Fumin Shen, Jingkuan Song, Hengtao Shen
- Abstract summary: In weakly supervised video anomaly detection, temporal features of abnormal events often exhibit outlier characteristics.
We propose a novel method, BN-WVAD, which incorporates BatchNorm into WVAD.
The proposed BN-WVAD model demonstrates state-of-the-art performance on UCF-Crime with an AUC of 87.24%, and XD-Violence, where AP reaches up to 84.93%.
- Score: 117.11382325721016
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In weakly supervised video anomaly detection (WVAD), where only video-level
labels indicating the presence or absence of abnormal events are available, the
primary challenge arises from the inherent ambiguity in temporal annotations of
abnormal occurrences. Inspired by the statistical insight that temporal
features of abnormal events often exhibit outlier characteristics, we propose a
novel method, BN-WVAD, which incorporates BatchNorm into WVAD. In the proposed
BN-WVAD, we leverage the Divergence of Feature from Mean vector (DFM) of
BatchNorm as a reliable abnormality criterion to discern potential abnormal
snippets in abnormal videos. The proposed DFM criterion is also discriminative
for anomaly recognition and more resilient to label noise, serving as the
additional anomaly score to amend the prediction of the anomaly classifier that
is susceptible to noisy labels. Moreover, a batch-level selection strategy is
devised to filter more abnormal snippets in videos where more abnormal events
occur. The proposed BN-WVAD model demonstrates state-of-the-art performance on
UCF-Crime with an AUC of 87.24%, and XD-Violence, where AP reaches up to
84.93%. Our code implementation is accessible at
https://github.com/cool-xuan/BN-WVAD.
Related papers
- GlanceVAD: Exploring Glance Supervision for Label-efficient Video
Anomaly Detection [36.73022075416943]
We present a novel labeling paradigm, termed "glance annotation", to achieve a better balance between anomaly detection accuracy and annotation cost.
To assess its effectiveness, we manually annotate the glance annotations for two standard video anomaly detection datasets: UCF-Crime and XD-Violence.
We also propose a customized GlanceVAD method, that leverages ssian kernels as the basic unit to compose the temporal anomaly distribution.
arXiv Detail & Related papers (2024-03-10T09:57:10Z) - Open-Vocabulary Video Anomaly Detection [57.552523669351636]
Video anomaly detection (VAD) with weak supervision has achieved remarkable performance in utilizing video-level labels to discriminate whether a video frame is normal or abnormal.
Recent studies attempt to tackle a more realistic setting, open-set VAD, which aims to detect unseen anomalies given seen anomalies and normal videos.
This paper takes a step further and explores open-vocabulary video anomaly detection (OVVAD), in which we aim to leverage pre-trained large models to detect and categorize seen and unseen anomalies.
arXiv Detail & Related papers (2023-11-13T02:54:17Z) - A Coarse-to-Fine Pseudo-Labeling (C2FPL) Framework for Unsupervised
Video Anomaly Detection [4.494911384096143]
Detection of anomalous events in videos is an important problem in applications such as surveillance.
We propose a simple-but-effective two-stage pseudo-label generation framework that produces segment-level (normal/anomaly) pseudo-labels.
The proposed coarse-to-fine pseudo-label generator employs carefully-designed hierarchical divisive clustering and statistical hypothesis testing.
arXiv Detail & Related papers (2023-10-26T17:59:19Z) - MSFlow: Multi-Scale Flow-based Framework for Unsupervised Anomaly
Detection [124.52227588930543]
Unsupervised anomaly detection (UAD) attracts a lot of research interest and drives widespread applications.
An inconspicuous yet powerful statistics model, the normalizing flows, is appropriate for anomaly detection and localization in an unsupervised fashion.
We propose a novel Multi-Scale Flow-based framework dubbed MSFlow composed of asymmetrical parallel flows followed by a fusion flow.
Our MSFlow achieves a new state-of-the-art with a detection AUORC score of up to 99.7%, localization AUCROC score of 98.8%, and PRO score of 97.1%.
arXiv Detail & Related papers (2023-08-29T13:38:35Z) - SLA$^2$P: Self-supervised Anomaly Detection with Adversarial
Perturbation [77.71161225100927]
Anomaly detection is a fundamental yet challenging problem in machine learning.
We propose a novel and powerful framework, dubbed as SLA$2$P, for unsupervised anomaly detection.
arXiv Detail & Related papers (2021-11-25T03:53:43Z) - UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detection [103.06327681038304]
We propose a supervised open-set benchmark composed of multiple virtual scenes for video anomaly detection.
Unlike existing data sets, we introduce abnormal events annotated at the pixel level at training time.
We show that UBnormal can enhance the performance of a state-of-the-art anomaly detection framework.
arXiv Detail & Related papers (2021-11-16T17:28:46Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - Localizing Anomalies from Weakly-Labeled Videos [45.58643708315132]
We propose a WeaklySupervised Anomaly localization (WSAL) method focusing on temporally localizing anomalous segments within anomalous videos.
Inspired by the appearance difference in anomalous videos, the evolution of adjacent temporal segments is evaluated for the localization of anomalous segments.
Our proposed method achieves new state-of-the-art performance on the UCF-Crime and TAD datasets.
arXiv Detail & Related papers (2020-08-20T12:58:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.