LGN-Net: Local-Global Normality Network for Video Anomaly Detection

• URL: http://arxiv.org/abs/2211.07454v1
• Date: Mon, 14 Nov 2022 15:32:08 GMT
• Title: LGN-Net: Local-Global Normality Network for Video Anomaly Detection
• Abstract summary: Video detection (VAD) has been intensively studied for years of its potential applications in intelligent video systems unsupervised. Existing VAD methods tend to learn normality from training sets consisting of only normal videos. We propose a two-branch model Local Normality Network (LG-Net) to learn local and global normality simultaneously.
• Score: 9.578697308678153
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video anomaly detection (VAD) has been intensively studied for years because of its potential applications in intelligent video systems. Existing unsupervised VAD methods tend to learn normality from training sets consisting of only normal videos and regard instances deviating from such normality as anomalies. However, they often consider only local or global normality. Some of them focus on learning local spatiotemporal representations from consecutive frames in video clips to enhance the representation for normal events. But powerful representation allows these methods to represent some anomalies and causes missed detections. In contrast, the other methods are devoted to memorizing global prototypical patterns of whole training videos to weaken the generalization for anomalies, which also restricts them to represent diverse normal patterns and causes false alarms. To this end, we propose a two-branch model, Local-Global Normality Network (LGN-Net), to learn local and global normality simultaneously. Specifically, one branch learns the evolution regularities of appearance and motion from consecutive frames as local normality utilizing a spatiotemporal prediction network, while the other branch memorizes prototype features of the whole videos as global normality by a memory module. LGN-Net achieves a balance of representing normal and abnormal instances by fusing local and global normality. The fused normality enables our model more generalized to various scenes compared to exploiting single normality. Experiments demonstrate the effectiveness and superior performance of our method. The code is available online: https://github.com/Myzhao1999/LGN-Net.

Related papers

• Learning to Tell Apart: Weakly Supervised Video Anomaly Detection via Disentangled Semantic Alignment [47.507511439028754]
  We propose a novel Disentangled Semantic Alignment Network (DSANet) to explicitly separate abnormal and normal features from coarse-grained and fine-grained aspects.<n>At the coarse-grained level, we introduce a self-guided normality modeling branch that reconstructs input video features under the guidance of learned normal prototypes.<n>At the fine-grained level, we present a decoupled contrastive semantic alignment mechanism, which first temporally decomposes each video into event-centric and background-centric components.
  arXiv  Detail & Related papers  (2025-11-13T14:06:48Z)
• Omni-AD: Learning to Reconstruct Global and Local Features for Multi-class Anomaly Detection [14.683307311332195]
  We build a framework, Omni-AD, to learn normal patterns of different granularity and reconstruct them progressively. Experiments on public anomaly detection benchmarks show that our method outperforms state-of-the-art approaches in MUAD.
  arXiv  Detail & Related papers  (2025-03-27T03:33:03Z)
• CRCL: Causal Representation Consistency Learning for Anomaly Detection in Surveillance Videos [40.63347505454772]
  Video Anomaly Detection (VAD) remains a fundamental yet formidable task in the video understanding community. Previous methods only use easily collected regular events to model the inherent normality of normal spatial-temporal patterns in an unsupervised manner. We propose Causal Consistency Representation Learning (CRCL) to implicitly mine potential scene-robust causal variable in unsupervised video normality learning.
  arXiv  Detail & Related papers  (2025-03-24T15:50:19Z)
• Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Prompts [57.01985221057047]
  This paper introduces a novel method that learnstemporal prompt embeddings for weakly supervised video anomaly detection and localization (WSVADL) based on pre-trained vision-language models (VLMs) Our method achieves state-of-theart performance on three public benchmarks for the WSVADL task.
  arXiv  Detail & Related papers  (2024-08-12T03:31:29Z)
• GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection [60.78684630040313]
  Diffusion models tend to reconstruct normal counterparts of test images with certain noises added. From the global perspective, the difficulty of reconstructing images with different anomalies is uneven. We propose a global and local adaptive diffusion model (abbreviated to GLAD) for unsupervised anomaly detection.
  arXiv  Detail & Related papers  (2024-06-11T17:27:23Z)
• Dynamic Erasing Network Based on Multi-Scale Temporal Features for Weakly Supervised Video Anomaly Detection [103.92970668001277]
  We propose a Dynamic Erasing Network (DE-Net) for weakly supervised video anomaly detection. We first propose a multi-scale temporal modeling module, capable of extracting features from segments of varying lengths. Then, we design a dynamic erasing strategy, which dynamically assesses the completeness of the detected anomalies.
  arXiv  Detail & Related papers  (2023-12-04T09:40:11Z)
• Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detection [15.991784541576788]
  Existing approaches, both video and segment-level label oriented, mainly focus on extracting representations for anomaly data. We propose an Uncertainty Regulated Dual Memory Units (UR-DMU) model to learn both the representations of normal data and discriminative features of abnormal data. Our method outperforms the state-of-the-art methods by a sizable margin.
  arXiv  Detail & Related papers  (2023-02-10T10:39:40Z)
• Rethinking Normalization Methods in Federated Learning [92.25845185724424]
  Federated learning (FL) is a popular distributed learning framework that can reduce privacy risks by not explicitly sharing private data. We show that external covariate shifts will lead to the obliteration of some devices' contributions to the global model.
  arXiv  Detail & Related papers  (2022-10-07T01:32:24Z)
• Anomaly Crossing: A New Method for Video Anomaly Detection as Cross-domain Few-shot Learning [32.0713939637202]
  Video anomaly detection aims to identify abnormal events that occurred in videos. Most previous approaches learn only from normal videos using unsupervised or semi-supervised methods. We propose a new learning paradigm by making full use of both normal and abnormal videos for video anomaly detection.
  arXiv  Detail & Related papers  (2021-12-12T20:49:38Z)
• UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detection [103.06327681038304]
  We propose a supervised open-set benchmark composed of multiple virtual scenes for video anomaly detection. Unlike existing data sets, we introduce abnormal events annotated at the pixel level at training time. We show that UBnormal can enhance the performance of a state-of-the-art anomaly detection framework.
  arXiv  Detail & Related papers  (2021-11-16T17:28:46Z)
• Sensing Anomalies like Humans: A Hominine Framework to Detect Abnormal Events from Unlabeled Videos [48.15740415466055]
  Video anomaly detection (VAD) has constantly been a vital topic in video analysis. We are inspired by how humans sense anomalies and propose a hominine framework that enables both unsupervised and end-to-end VAD.
  arXiv  Detail & Related papers  (2021-08-04T11:31:57Z)
• Weakly Supervised Video Anomaly Detection via Center-guided Discriminative Learning [25.787860059872106]
  Anomaly detection in surveillance videos is a challenging task due to the diversity of anomalous video content and duration. We propose an anomaly detection framework, called Anomaly Regression Net (AR-Net), which only requires video-level labels in training stage. Our method yields a new state-of-the-art result for video anomaly detection on ShanghaiTech dataset.
  arXiv  Detail & Related papers  (2021-04-15T06:41:23Z)
• Unsupervised Video Anomaly Detection via Normalizing Flows with Implicit Latent Features [8.407188666535506]
  Most existing methods use an autoencoder to learn to reconstruct normal videos. We propose an implicit two-path AE (ITAE), a structure in which two encoders implicitly model appearance and motion features. For the complex distribution of normal scenes, we suggest normal density estimation of ITAE features. NF models intensify ITAE performance by learning normality through implicitly learned features.
  arXiv  Detail & Related papers  (2020-10-15T05:02:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.