A Comprehensive Review of Trends, Applications and Challenges In
Out-of-Distribution Detection
- URL: http://arxiv.org/abs/2209.12935v1
- Date: Mon, 26 Sep 2022 18:13:14 GMT
- Title: A Comprehensive Review of Trends, Applications and Challenges In
Out-of-Distribution Detection
- Authors: Navid Ghassemi, Ehsan Fazl-Ersi
- Abstract summary: Field of study has emerged, focusing on detecting out-of-distribution data subsets and enabling a more comprehensive generalization.
As many deep learning based models have achieved near-perfect results on benchmark datasets, the need to evaluate these models' reliability and trustworthiness is felt more strongly than ever.
This paper presents a survey that, in addition to reviewing more than 70 papers in this field, presents challenges and directions for future works and offers a unifying look into various types of data shifts and solutions for better generalization.
- Score: 0.76146285961466
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: With recent advancements in artificial intelligence, its applications can be
seen in every aspect of humans' daily life. From voice assistants to mobile
healthcare and autonomous driving, we rely on the performance of AI methods for
many critical tasks; therefore, it is essential to assert the performance of
models in proper means to prevent damage. One of the shortfalls of AI models in
general, and deep machine learning in particular, is a drop in performance when
faced with shifts in the distribution of data. Nonetheless, these shifts are
always expected in real-world applications; thus, a field of study has emerged,
focusing on detecting out-of-distribution data subsets and enabling a more
comprehensive generalization. Furthermore, as many deep learning based models
have achieved near-perfect results on benchmark datasets, the need to evaluate
these models' reliability and trustworthiness for pushing towards real-world
applications is felt more strongly than ever. This has given rise to a growing
number of studies in the field of out-of-distribution detection and domain
generalization, which begs the need for surveys that compare these studies from
various perspectives and highlight their straightens and weaknesses. This paper
presents a survey that, in addition to reviewing more than 70 papers in this
field, presents challenges and directions for future works and offers a
unifying look into various types of data shifts and solutions for better
generalization.
Related papers
- Deep Learning-Based Object Pose Estimation: A Comprehensive Survey [73.74933379151419]
We discuss the recent advances in deep learning-based object pose estimation.
Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks.
arXiv Detail & Related papers (2024-05-13T14:44:22Z) - A Survey of Deep Long-Tail Classification Advancements [1.6233132273470656]
Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed.
This poses an interesting problem for machine learning, where most algorithms assume or work well with uniformly distributed data.
The problem is further exacerbated by current state-of-the-art deep learning models requiring large volumes of training data.
arXiv Detail & Related papers (2024-04-24T01:59:02Z) - Data Augmentation in Human-Centric Vision [54.97327269866757]
This survey presents a comprehensive analysis of data augmentation techniques in human-centric vision tasks.
It delves into a wide range of research areas including person ReID, human parsing, human pose estimation, and pedestrian detection.
Our work categorizes data augmentation methods into two main types: data generation and data perturbation.
arXiv Detail & Related papers (2024-03-13T16:05:18Z) - A Study on Domain Generalization for Failure Detection through Human
Reactions in HRI [7.664159325276515]
Machine learning models are commonly tested in-distribution (same dataset); performance almost always drops in out-of-distribution settings.
This makes domain generalization - retaining performance in different settings - a critical issue.
We present a concise analysis of domain generalization in failure detection models trained on human facial expressions.
arXiv Detail & Related papers (2024-03-10T21:30:22Z) - Robust Computer Vision in an Ever-Changing World: A Survey of Techniques
for Tackling Distribution Shifts [20.17397328893533]
AI applications are becoming increasingly visible to the general public.
There is a notable gap between the theoretical assumptions researchers make about computer vision models and the reality those models face when deployed in the real world.
One of the critical reasons for this gap is a challenging problem known as distribution shift.
arXiv Detail & Related papers (2023-12-03T23:40:12Z) - Zero-shot Retrieval: Augmenting Pre-trained Models with Search Engines [83.65380507372483]
Large pre-trained models can dramatically reduce the amount of task-specific data required to solve a problem, but they often fail to capture domain-specific nuances out of the box.
This paper shows how to leverage recent advances in NLP and multi-modal learning to augment a pre-trained model with search engine retrieval.
arXiv Detail & Related papers (2023-11-29T05:33:28Z) - Non-adversarial Robustness of Deep Learning Methods for Computer Vision [0.0]
Non-adversarial robustness, also known as natural robustness, is a property of deep learning models.
We present a brief overview of the most recent techniques for improving the robustness of computer vision methods.
arXiv Detail & Related papers (2023-05-24T10:21:31Z) - Causal Reasoning Meets Visual Representation Learning: A Prospective
Study [117.08431221482638]
Lack of interpretability, robustness, and out-of-distribution generalization are becoming the challenges of the existing visual models.
Inspired by the strong inference ability of human-level agents, recent years have witnessed great effort in developing causal reasoning paradigms.
This paper aims to provide a comprehensive overview of this emerging field, attract attention, encourage discussions, bring to the forefront the urgency of developing novel causal reasoning methods.
arXiv Detail & Related papers (2022-04-26T02:22:28Z) - On the Efficacy of Adversarial Data Collection for Question Answering:
Results from a Large-Scale Randomized Study [65.17429512679695]
In adversarial data collection (ADC), a human workforce interacts with a model in real time, attempting to produce examples that elicit incorrect predictions.
Despite ADC's intuitive appeal, it remains unclear when training on adversarial datasets produces more robust models.
arXiv Detail & Related papers (2021-06-02T00:48:33Z) - Accurate and Robust Feature Importance Estimation under Distribution
Shifts [49.58991359544005]
PRoFILE is a novel feature importance estimation method.
We show significant improvements over state-of-the-art approaches, both in terms of fidelity and robustness.
arXiv Detail & Related papers (2020-09-30T05:29:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.