X-MAN: Explaining multiple sources of anomalies in video

• URL: http://arxiv.org/abs/2106.08856v1
• Date: Wed, 16 Jun 2021 15:25:50 GMT
• Title: X-MAN: Explaining multiple sources of anomalies in video
• Authors: Stanislaw Szymanowicz, James Charles, Roberto Cipolla
• Abstract summary: We show how to build interpretable feature representations suitable for detecting anomalies in video. We also propose an interpretable probabilistic anomaly detector which can describe the reason behind it's response. Our method competes well with the state of the art on public datasets.
• Score: 25.929134751869032
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Our objective is to detect anomalies in video while also automatically explaining the reason behind the detector's response. In a practical sense, explainability is crucial for this task as the required response to an anomaly depends on its nature and severity. However, most leading methods (based on deep neural networks) are not interpretable and hide the decision making process in uninterpretable feature representations. In an effort to tackle this problem we make the following contributions: (1) we show how to build interpretable feature representations suitable for detecting anomalies with state of the art performance, (2) we propose an interpretable probabilistic anomaly detector which can describe the reason behind it's response using high level concepts, (3) we are the first to directly consider object interactions for anomaly detection and (4) we propose a new task of explaining anomalies and release a large dataset for evaluating methods on this task. Our method competes well with the state of the art on public datasets while also providing anomaly explanation based on objects and their interactions.

Related papers

• Anomaly Detection by Context Contrasting [57.695202846009714]
  Anomaly detection focuses on identifying samples that deviate from the norm. Recent advances in self-supervised learning have shown great promise in this regard. We propose Con$$, which learns through context augmentations.
  arXiv  Detail & Related papers  (2024-05-29T07:59:06Z)
• Reimagining Anomalies: What If Anomalies Were Normal? [21.480869966442143]
  We introduce a novel explanation method that generates multiple counterfactual examples for each anomaly. A counterfactual example is a modification of the anomaly that is perceived as normal by the anomaly detector. The method provides a high-level semantic explanation of the mechanism that triggered the anomaly detector, allowing users to explore "what-if scenarios"
  arXiv  Detail & Related papers  (2024-02-22T11:56:44Z)
• Open-Vocabulary Video Anomaly Detection [57.552523669351636]
  Video anomaly detection (VAD) with weak supervision has achieved remarkable performance in utilizing video-level labels to discriminate whether a video frame is normal or abnormal. Recent studies attempt to tackle a more realistic setting, open-set VAD, which aims to detect unseen anomalies given seen anomalies and normal videos. This paper takes a step further and explores open-vocabulary video anomaly detection (OVVAD), in which we aim to leverage pre-trained large models to detect and categorize seen and unseen anomalies.
  arXiv  Detail & Related papers  (2023-11-13T02:54:17Z)
• Understanding the Challenges and Opportunities of Pose-based Anomaly Detection [2.924868086534434]
  Pose-based anomaly detection is a video-analysis technique for detecting anomalous events or behaviors by examining human pose extracted from the video frames. In this work, we analyze and quantify the characteristics of two well-known video anomaly datasets to better understand the difficulties of pose-based anomaly detection. We believe these experiments are beneficial for a better comprehension of pose-based anomaly detection and the datasets currently available.
  arXiv  Detail & Related papers  (2023-03-09T18:09:45Z)
• Explainable Anomaly Detection in Images and Videos: A Survey [49.07140708026425]
  Anomaly detection and localization of visual data, including images and videos, are of great significance in machine learning academia and applied real-world scenarios. Despite the rapid development of visual anomaly detection techniques in recent years, the interpretations of these black-box models and reasonable explanations of why anomalies can be distinguished out are scarce. This paper provides the first survey concentrated on explainable visual anomaly detection methods.
  arXiv  Detail & Related papers  (2023-02-13T20:17:41Z)
• Discrete neural representations for explainable anomaly detection [25.929134751869032]
  We show how to robustly detect anomalies without the use of object or action classifiers. We also show how to improve the quality of saliency maps using a novel neural architecture for learning discrete representations of video.
  arXiv  Detail & Related papers  (2021-12-10T14:56:58Z)
• A2Log: Attentive Augmented Log Anomaly Detection [53.06341151551106]
  Anomaly detection becomes increasingly important for the dependability and serviceability of IT services. Existing unsupervised methods need anomaly examples to obtain a suitable decision boundary. We develop A2Log, which is an unsupervised anomaly detection method consisting of two steps: Anomaly scoring and anomaly decision.
  arXiv  Detail & Related papers  (2021-09-20T13:40:21Z)
• Abnormal Behavior Detection Based on Target Analysis [57.78993932008633]
  We propose a multivariate fusion method that analyzes each target through three branches: object, action and motion. The information that these branches focus on is different, and they can complement each other and jointly detect abnormal behavior.
  arXiv  Detail & Related papers  (2021-07-29T02:03:47Z)
• Towards Fair Deep Anomaly Detection [24.237000220172906]
  We propose a new architecture for the fair anomaly detection approach (Deep Fair SVDD) We show that our proposed approach can remove the unfairness largely with minimal loss on the anomaly detection performance.
  arXiv  Detail & Related papers  (2020-12-29T22:34:45Z)
• Deep Unsupervised Image Anomaly Detection: An Information Theoretic Framework [17.261978826394973]
  Surrogate task based methods have recently shown great promise for unsupervised image anomaly detection. In this paper, we return to a direct objective function for anomaly detection with information theory. We introduce a novel information theoretic framework for unsupervised image anomaly detection.
  arXiv  Detail & Related papers  (2020-12-09T03:07:00Z)
• Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detection [114.9714355807607]
  We show that applying self-trained deep ordinal regression to video anomaly detection overcomes two key limitations of existing methods. We devise an end-to-end trainable video anomaly detection approach that enables joint representation learning and anomaly scoring without manually labeled normal/abnormal data.
  arXiv  Detail & Related papers  (2020-03-15T08:44:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.