Contracting Skeletal Kinematics for Human-Related Video Anomaly Detection

• URL: http://arxiv.org/abs/2301.09489v5
• Date: Tue, 23 Jul 2024 08:43:06 GMT
• Title: Contracting Skeletal Kinematics for Human-Related Video Anomaly Detection
• Abstract summary: COSKAD is a novel model that encodes skeletal human motion by a graph convolutional network. It learns to COntract SKeletal embeddings onto a latent hypersphere of minimum volume for Video Anomaly Detection. All variants outperform the state-of-the-art on the most recent UBnormal dataset.
• Score: 43.72042594414675
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Detecting the anomaly of human behavior is paramount to timely recognizing endangering situations, such as street fights or elderly falls. However, anomaly detection is complex since anomalous events are rare and because it is an open set recognition task, i.e., what is anomalous at inference has not been observed at training. We propose COSKAD, a novel model that encodes skeletal human motion by a graph convolutional network and learns to COntract SKeletal kinematic embeddings onto a latent hypersphere of minimum volume for Video Anomaly Detection. We propose three latent spaces: the commonly-adopted Euclidean and the novel spherical and hyperbolic. All variants outperform the state-of-the-art on the most recent UBnormal dataset, for which we contribute a human-related version with annotated skeletons. COSKAD sets a new state-of-the-art on the human-related versions of ShanghaiTech Campus and CUHK Avenue, with performance comparable to video-based methods. Source code and dataset will be released upon acceptance.

Related papers

• Video Anomaly Detection with Contours - A Study [24.525564527855092]
  We investigate the potential of learning recurrent motion patterns of normal human behavior using 2D contours. Our results indicate that this novel perspective on Pose-based Video Anomaly Detection marks a promising direction for future research.
  arXiv  Detail & Related papers  (2025-03-25T12:11:50Z)
• Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection [16.77262005540559]
  A novel framework is proposed to guide the learning of suspected anomalies from event prompts. It enables a new multi-prompt learning process to constrain the visual-semantic features across all videos. Our proposed model outperforms most state-of-the-art methods in terms of AP or AUC.
  arXiv  Detail & Related papers  (2024-03-02T10:42:47Z)
• Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
  This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting. Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
  arXiv  Detail & Related papers  (2023-11-27T13:14:06Z)
• Human Kinematics-inspired Skeleton-based Video Anomaly Detection [3.261881784285304]
  We introduce a new idea called HKVAD (Human Kinematic-inspired Video Anomaly Detection) for video anomaly detection. Our method achieves good results with minimal computational resources, validating its effectiveness and potential.
  arXiv  Detail & Related papers  (2023-09-27T13:52:53Z)
• A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipation [46.687762316415096]
  We propose a new comprehensive dataset, NWPU Campus, containing 43 scenes, 28 classes of abnormal events, and 16 hours of videos. It is the largest semi-supervised VAD dataset with the largest number of scenes and classes of anomalies, the longest duration, and the only one considering the scene-dependent anomaly. We propose a novel model capable of detecting and anticipating anomalous events simultaneously.
  arXiv  Detail & Related papers  (2023-05-23T02:20:12Z)
• Are we certain it's anomalous? [57.729669157989235]
  Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations. Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD) HypAD learns self-supervisedly to reconstruct the input signal.
  arXiv  Detail & Related papers  (2022-11-16T21:31:39Z)
• Neural Rendering of Humans in Novel View and Pose from Monocular Video [68.37767099240236]
  We introduce a new method that generates photo-realistic humans under novel views and poses given a monocular video as input. Our method significantly outperforms existing approaches under unseen poses and novel views given monocular videos as input.
  arXiv  Detail & Related papers  (2022-04-04T03:09:20Z)
• UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detection [103.06327681038304]
  We propose a supervised open-set benchmark composed of multiple virtual scenes for video anomaly detection. Unlike existing data sets, we introduce abnormal events annotated at the pixel level at training time. We show that UBnormal can enhance the performance of a state-of-the-art anomaly detection framework.
  arXiv  Detail & Related papers  (2021-11-16T17:28:46Z)
• Anomalous entities detection using a cascade of deep learning models [2.9005223064604078]
  This paper presents a new approach to detect anomalous entities in complex situations of examination halls. The proposed method uses a cascade of deep convolutional neural network models. Our results show that the proposed method can detect anomalous entities and warrant unusual behavior with high accuracy.
  arXiv  Detail & Related papers  (2021-03-09T01:23:19Z)
• Robust Unsupervised Video Anomaly Detection by Multi-Path Frame Prediction [61.17654438176999]
  We propose a novel and robust unsupervised video anomaly detection method by frame prediction with proper design. Our proposed method obtains the frame-level AUROC score of 88.3% on the CUHK Avenue dataset.
  arXiv  Detail & Related papers  (2020-11-05T11:34:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.