UGainS: Uncertainty Guided Anomaly Instance Segmentation
- URL: http://arxiv.org/abs/2308.02046v1
- Date: Thu, 3 Aug 2023 20:55:37 GMT
- Title: UGainS: Uncertainty Guided Anomaly Instance Segmentation
- Authors: Alexey Nekrasov, Alexander Hermans, Lars Kuhnert, Bastian Leibe
- Abstract summary: A single unexpected object on the road can cause an accident or lead to injuries.
Current approaches tackle anomaly segmentation by assigning an anomaly score to each pixel.
We propose an approach that produces accurate anomaly instance masks.
- Score: 80.12253291709673
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: A single unexpected object on the road can cause an accident or may lead to
injuries. To prevent this, we need a reliable mechanism for finding anomalous
objects on the road. This task, called anomaly segmentation, can be a stepping
stone to safe and reliable autonomous driving. Current approaches tackle
anomaly segmentation by assigning an anomaly score to each pixel and by
grouping anomalous regions using simple heuristics. However, pixel grouping is
a limiting factor when it comes to evaluating the segmentation performance of
individual anomalous objects. To address the issue of grouping multiple anomaly
instances into one, we propose an approach that produces accurate anomaly
instance masks. Our approach centers on an out-of-distribution segmentation
model for identifying uncertain regions and a strong generalist segmentation
model for anomaly instances segmentation. We investigate ways to use uncertain
regions to guide such a segmentation model to perform segmentation of anomalous
instances. By incorporating strong object priors from a generalist model we
additionally improve the per-pixel anomaly segmentation performance. Our
approach outperforms current pixel-level anomaly segmentation methods,
achieving an AP of 80.08% and 88.98% on the Fishyscapes Lost and Found and the
RoadAnomaly validation sets respectively. Project page:
https://vision.rwth-aachen.de/ugains
Related papers
- GeneralAD: Anomaly Detection Across Domains by Attending to Distorted Features [68.14842693208465]
GeneralAD is an anomaly detection framework designed to operate in semantic, near-distribution, and industrial settings.
We propose a novel self-supervised anomaly generation module that employs straightforward operations like noise addition and shuffling to patch features.
We extensively evaluated our approach on ten datasets, achieving state-of-the-art results in six and on-par performance in the remaining.
arXiv Detail & Related papers (2024-07-17T09:27:41Z) - OoDIS: Anomaly Instance Segmentation Benchmark [57.89836988990543]
We extend the most commonly used anomaly segmentation benchmarks to include the instance segmentation task.
Development in this area has been lagging, largely due to the lack of dedicated benchmarks.
Our evaluation of anomaly instance segmentation methods shows that this challenge remains an unsolved problem.
arXiv Detail & Related papers (2024-06-17T17:59:56Z) - Test Time Training for Industrial Anomaly Segmentation [15.973768095014906]
Anomaly Detection and Ranging (AD&S) is crucial for industrial quality control.
This paper proposes a test time training strategy to improve the segmentation performance.
We demonstrate the effectiveness of our approach over baselines through extensive experimentation and evaluation on MVTec AD and MVTec 3D-AD.
arXiv Detail & Related papers (2024-04-04T18:31:24Z) - Segment Every Out-of-Distribution Object [24.495734304922244]
This paper introduces a method to convert anomaly textbfScore textbfTo segmentation textbfMask, called S2M, a simple and effective framework for OoD detection in semantic segmentation.
By transforming anomaly scores into prompts for a promptable segmentation model, S2M eliminates the need for threshold selection.
arXiv Detail & Related papers (2023-11-27T18:20:03Z) - A Generalist Framework for Panoptic Segmentation of Images and Videos [61.61453194912186]
We formulate panoptic segmentation as a discrete data generation problem, without relying on inductive bias of the task.
A diffusion model is proposed to model panoptic masks, with a simple architecture and generic loss function.
Our method is capable of modeling video (in a streaming setting) and thereby learns to track object instances automatically.
arXiv Detail & Related papers (2022-10-12T16:18:25Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - FSNet: A Failure Detection Framework for Semantic Segmentation [9.453250122818808]
We propose a failure detection framework to identify pixel-level misclassification.
We do so by exploiting internal features of the segmentation model and training it simultaneously with a failure detection network.
We evaluate the proposed approach against state-of-the-art methods and achieve 12.30%, 9.46%, and 9.65% performance improvement.
arXiv Detail & Related papers (2021-08-19T15:26:52Z) - Detecting Anomalies in Semantic Segmentation with Prototypes [23.999211737485812]
We propose to address anomaly segmentation through prototype learning.
Our approach achieves the new state of the art, with a significant margin over previous works.
arXiv Detail & Related papers (2021-06-01T13:22:33Z) - SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation [111.61261419566908]
Deep neural networks (DNNs) are usually trained on a closed set of semantic classes.
They are ill-equipped to handle previously-unseen objects.
detecting and localizing such objects is crucial for safety-critical applications such as perception for automated driving.
arXiv Detail & Related papers (2021-04-30T07:58:19Z) - Pixel-wise Anomaly Detection in Complex Driving Scenes [30.884375526254836]
We present a pixel-wise anomaly detection framework that uses uncertainty maps to improve anomaly detection.
Our approach works as a general framework around already trained segmentation networks.
Top-2 performance across a range of different anomaly datasets shows the robustness of our approach to handling different anomaly instances.
arXiv Detail & Related papers (2021-03-09T14:26:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.