Detecting Out-of-distribution Objects Using Neuron Activation Patterns
- URL: http://arxiv.org/abs/2307.16433v1
- Date: Mon, 31 Jul 2023 06:41:26 GMT
- Title: Detecting Out-of-distribution Objects Using Neuron Activation Patterns
- Authors: Bart{\l}omiej Olber, Krystian Radlak, Krystian Chachu{\l}a, Jakub
{\L}yskawa, Piotr Fr\k{a}tczak
- Abstract summary: We introduce Neuron Activation PaTteRns for out-of-distribution samples detection in Object detectioN (NAPTRON)
Our approach outperforms state-of-the-art methods, without the need to affect in-distribution (ID) performance.
We have created the largest open-source benchmark for OOD object detection.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Object detection is essential to many perception algorithms used in modern
robotics applications. Unfortunately, the existing models share a tendency to
assign high confidence scores for out-of-distribution (OOD) samples. Although
OOD detection has been extensively studied in recent years by the computer
vision (CV) community, most proposed solutions apply only to the image
recognition task. Real-world applications such as perception in autonomous
vehicles struggle with far more complex challenges than classification. In our
work, we focus on the prevalent field of object detection, introducing Neuron
Activation PaTteRns for out-of-distribution samples detection in Object
detectioN (NAPTRON). Performed experiments show that our approach outperforms
state-of-the-art methods, without the need to affect in-distribution (ID)
performance. By evaluating the methods in two distinct OOD scenarios and three
types of object detectors we have created the largest open-source benchmark for
OOD object detection.
Related papers
- Revisiting Out-of-Distribution Detection in LiDAR-based 3D Object Detection [12.633311483061647]
Out-of-distribution (OOD) objects can lead to misclassifications, posing a significant risk to the safety and reliability of automated vehicles.
We propose a new evaluation protocol that allows the use of existing datasets without modifying the point cloud.
The effectiveness of our method is validated through experiments on the newly proposed nuScenes OOD benchmark.
arXiv Detail & Related papers (2024-04-24T13:48:38Z) - From Global to Local: Multi-scale Out-of-distribution Detection [129.37607313927458]
Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process.
Recent progress in representation learning gives rise to distance-based OOD detection.
We propose Multi-scale OOD DEtection (MODE), a first framework leveraging both global visual information and local region details.
arXiv Detail & Related papers (2023-08-20T11:56:25Z) - Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection
Capability [70.72426887518517]
Out-of-distribution (OOD) detection is an indispensable aspect of secure AI when deploying machine learning models in real-world applications.
We propose a novel method, Unleashing Mask, which aims to restore the OOD discriminative capabilities of the well-trained model with ID data.
Our method utilizes a mask to figure out the memorized atypical samples, and then finetune the model or prune it with the introduced mask to forget them.
arXiv Detail & Related papers (2023-06-06T14:23:34Z) - Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for
Autonomous Driving [91.39625612027386]
We propose a novel task, called generalized few-shot 3D object detection, where we have a large amount of training data for common (base) objects, but only a few data for rare (novel) classes.
Specifically, we analyze in-depth differences between images and point clouds, and then present a practical principle for the few-shot setting in the 3D LiDAR dataset.
To solve this task, we propose an incremental fine-tuning method to extend existing 3D detection models to recognize both common and rare objects.
arXiv Detail & Related papers (2023-02-08T07:11:36Z) - YolOOD: Utilizing Object Detection Concepts for Multi-Label
Out-of-Distribution Detection [25.68925703896601]
YolOOD is a method that utilizes concepts from the object detection domain to perform OOD detection in the multi-label classification task.
We compare our approach to state-of-the-art OOD detection methods and demonstrate YolOOD's ability to outperform these methods on a comprehensive suite of in-distribution and OOD benchmark datasets.
arXiv Detail & Related papers (2022-12-05T07:52:08Z) - Beyond Mahalanobis-Based Scores for Textual OOD Detection [32.721317681946246]
We introduce TRUSTED, a new OOD detector for classifiers based on Transformer architectures that meets operational requirements.
The efficiency of TRUSTED relies on the fruitful idea that all hidden layers carry relevant information to detect OOD examples.
Our experiments involve 51k model configurations, including various checkpoints, seeds, datasets, and demonstrate that TRUSTED achieves state-of-the-art performances.
arXiv Detail & Related papers (2022-11-24T10:51:58Z) - Out-of-Distribution Detection for LiDAR-based 3D Object Detection [8.33476679218773]
3D object detection is an essential part of automated driving.
Deep models are notorious for assigning high confidence scores to out-of-distribution (OOD) inputs.
In this paper, we focus on the detection of OOD inputs for LiDAR-based 3D object detection.
arXiv Detail & Related papers (2022-09-28T21:39:25Z) - Identifying Out-of-Distribution Samples in Real-Time for Safety-Critical
2D Object Detection with Margin Entropy Loss [0.0]
We present an approach to enable OOD detection for 2D object detection by employing the margin entropy (ME) loss.
A CNN trained with the ME loss significantly outperforms OOD detection using standard confidence scores.
arXiv Detail & Related papers (2022-09-01T11:14:57Z) - Triggering Failures: Out-Of-Distribution detection by learning from
local adversarial attacks in Semantic Segmentation [76.2621758731288]
We tackle the detection of out-of-distribution (OOD) objects in semantic segmentation.
Our main contribution is a new OOD detection architecture called ObsNet associated with a dedicated training scheme based on Local Adversarial Attacks (LAA)
We show it obtains top performances both in speed and accuracy when compared to ten recent methods of the literature on three different datasets.
arXiv Detail & Related papers (2021-08-03T17:09:56Z) - AutoOD: Automated Outlier Detection via Curiosity-guided Search and
Self-imitation Learning [72.99415402575886]
Outlier detection is an important data mining task with numerous practical applications.
We propose AutoOD, an automated outlier detection framework, which aims to search for an optimal neural network model.
Experimental results on various real-world benchmark datasets demonstrate that the deep model identified by AutoOD achieves the best performance.
arXiv Detail & Related papers (2020-06-19T18:57:51Z) - Progressive Object Transfer Detection [84.48927705173494]
We propose a novel Progressive Object Transfer Detection (POTD) framework.
First, POTD can leverage various object supervision of different domains effectively into a progressive detection procedure.
Second, POTD consists of two delicate transfer stages, i.e., Low-Shot Transfer Detection (LSTD), and Weakly-Supervised Transfer Detection (WSTD)
arXiv Detail & Related papers (2020-02-12T00:16:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.