Pixel-wise Anomaly Detection in Complex Driving Scenes
- URL: http://arxiv.org/abs/2103.05445v1
- Date: Tue, 9 Mar 2021 14:26:20 GMT
- Title: Pixel-wise Anomaly Detection in Complex Driving Scenes
- Authors: Giancarlo Di Biase, Hermann Blum, Roland Siegwart, Cesar Cadena
- Abstract summary: We present a pixel-wise anomaly detection framework that uses uncertainty maps to improve anomaly detection.
Our approach works as a general framework around already trained segmentation networks.
Top-2 performance across a range of different anomaly datasets shows the robustness of our approach to handling different anomaly instances.
- Score: 30.884375526254836
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The inability of state-of-the-art semantic segmentation methods to detect
anomaly instances hinders them from being deployed in safety-critical and
complex applications, such as autonomous driving. Recent approaches have
focused on either leveraging segmentation uncertainty to identify anomalous
areas or re-synthesizing the image from the semantic label map to find
dissimilarities with the input image. In this work, we demonstrate that these
two methodologies contain complementary information and can be combined to
produce robust predictions for anomaly segmentation. We present a pixel-wise
anomaly detection framework that uses uncertainty maps to improve over existing
re-synthesis methods in finding dissimilarities between the input and generated
images. Our approach works as a general framework around already trained
segmentation networks, which ensures anomaly detection without compromising
segmentation accuracy, while significantly outperforming all similar methods.
Top-2 performance across a range of different anomaly datasets shows the
robustness of our approach to handling different anomaly instances.
Related papers
- GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features [68.14842693208465]
GeneralAD is an anomaly detection framework designed to operate in semantic, near-distribution, and industrial settings.
We propose a novel self-supervised anomaly generation module that employs straightforward operations like noise addition and shuffling to patch features.
We extensively evaluated our approach on ten datasets, achieving state-of-the-art results in six and on-par performance in the remaining.
arXiv Detail & Related papers (2024-07-17T09:27:41Z) - DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection.
It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor.
Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
arXiv Detail & Related papers (2023-12-11T18:38:28Z) - UGainS: Uncertainty Guided Anomaly Instance Segmentation [80.12253291709673]
A single unexpected object on the road can cause an accident or lead to injuries.
Current approaches tackle anomaly segmentation by assigning an anomaly score to each pixel.
We propose an approach that produces accurate anomaly instance masks.
arXiv Detail & Related papers (2023-08-03T20:55:37Z) - COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
Face forgery recognition methods can only process one face at a time.
Most face forgery recognition methods can only process one face at a time.
We propose COMICS, an end-to-end framework for multi-face forgery detection.
arXiv Detail & Related papers (2023-08-03T03:37:13Z) - On the Effectiveness of Image Manipulation Detection in the Age of
Social Media [9.227950734832447]
manipulation detection algorithms often rely on the manipulated regions being sufficiently'' different from the rest of the non-tampered regions in the image.
We present an in-depth analysis of deep learning-based and learning-free methods, assessing their performance on benchmark datasets.
We propose a novel deep learning-based pre-processing technique that accentuates the anomalies present in manipulated regions.
arXiv Detail & Related papers (2023-04-19T04:05:54Z) - The Treasure Beneath Multiple Annotations: An Uncertainty-aware Edge
Detector [70.43599299422813]
Existing methods fuse multiple annotations using a simple voting process, ignoring the inherent ambiguity of edges and labeling bias of annotators.
We propose a novel uncertainty-aware edge detector (UAED), which employs uncertainty to investigate the subjectivity and ambiguity of diverse annotations.
UAED achieves superior performance consistently across multiple edge detection benchmarks.
arXiv Detail & Related papers (2023-03-21T13:14:36Z) - AnoSeg: Anomaly Segmentation Network Using Self-Supervised Learning [11.234583962952891]
This paper proposes a novel anomaly segmentation network (AnoSeg) that can directly generate an accurate anomaly map using self-supervised learning.
For highly accurate anomaly segmentation, the proposed AnoSeg considers three novel techniques: Anomaly data generation based on hard augmentation, self-supervised learning with pixel-wise and adversarial losses, and coordinate channel concatenation.
Our experiments show that the proposed method outperforms the state-of-the-art anomaly detection and anomaly segmentation methods for the MVTec AD dataset.
arXiv Detail & Related papers (2021-10-07T12:36:36Z) - Contrastive Predictive Coding for Anomaly Detection [0.0]
Contrastive Predictive Coding model (arXiv:1807.03748) used for anomaly detection and segmentation.
We show that its patch-wise contrastive loss can directly be interpreted as an anomaly score.
Model achieves promising results for both anomaly detection and segmentation on the MVTec-AD dataset.
arXiv Detail & Related papers (2021-07-16T11:04:35Z) - Data-Uncertainty Guided Multi-Phase Learning for Semi-Supervised Object
Detection [66.10057490293981]
We propose a data-uncertainty guided multi-phase learning method for semi-supervised object detection.
Our method behaves extraordinarily compared to baseline approaches and outperforms them by a large margin.
arXiv Detail & Related papers (2021-03-29T09:27:23Z) - Unsupervised Two-Stage Anomaly Detection [18.045265572566276]
Anomaly detection from a single image is challenging since anomaly data is always rare and can be with highly unpredictable types.
We propose a two-stage approach, which generates high-fidelity yet anomaly-free reconstructions.
Our method outperforms state-of-the-arts on four anomaly detection datasets.
arXiv Detail & Related papers (2021-03-22T08:57:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.