On the Importance of Gradients for Detecting Distributional Shifts in the Wild

• URL: http://arxiv.org/abs/2110.00218v1
• Date: Fri, 1 Oct 2021 05:19:32 GMT
• Title: On the Importance of Gradients for Detecting Distributional Shifts in the Wild
• Authors: Rui Huang, Andrew Geng, Yixuan Li
• Abstract summary: We present GradNorm, a simple and effective approach for detecting OOD inputs by utilizing information extracted from the gradient space. GradNorm demonstrates superior performance, reducing the average FPR95 by up to 10.89% compared to the previous best method.
• Score: 15.548068221414384
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Detecting out-of-distribution (OOD) data has become a critical component in ensuring the safe deployment of machine learning models in the real world. Existing OOD detection approaches primarily rely on the output or feature space for deriving OOD scores, while largely overlooking information from the gradient space. In this paper, we present GradNorm, a simple and effective approach for detecting OOD inputs by utilizing information extracted from the gradient space. GradNorm directly employs the vector norm of gradients, backpropagated from the KL divergence between the softmax output and a uniform probability distribution. Our key idea is that the magnitude of gradients is higher for in-distribution (ID) data than that for OOD data, making it informative for OOD detection. GradNorm demonstrates superior performance, reducing the average FPR95 by up to 10.89% compared to the previous best method.

Related papers

• Approximations to the Fisher Information Metric of Deep Generative Models for Out-Of-Distribution Detection [2.3749120526936465]
  We show that deep generative models consistently infer higher log-likelihoods for OOD data than data they were trained on. We use the gradient of a data point with respect to the parameters of the deep generative model for OOD detection, based on the simple intuition that OOD data should have larger gradient norms than training data. Our empirical results indicate that this method outperforms the Typicality test for most deep generative models and image dataset pairings.
  arXiv  Detail & Related papers  (2024-03-03T11:36:35Z)
• GROOD: GRadient-aware Out-Of-Distribution detection in interpolated manifolds [12.727088216619386]
  Out-of-distribution detection in deep neural networks (DNNs) can pose risks in real-world deployments. We introduce GRadient-aware Out-Of-Distribution detection in. internative manifold (GROOD), a novel framework that relies on the discriminative power of gradient space. We show that GROD surpasses the established robustness of state-of-the-art baselines.
  arXiv  Detail & Related papers  (2023-12-22T04:28:43Z)
• EAT: Towards Long-Tailed Out-of-Distribution Detection [55.380390767978554]
  This paper addresses the challenging task of long-tailed OOD detection. The main difficulty lies in distinguishing OOD data from samples belonging to the tail classes. We propose two simple ideas: (1) Expanding the in-distribution class space by introducing multiple abstention classes, and (2) Augmenting the context-limited tail classes by overlaying images onto the context-rich OOD data.
  arXiv  Detail & Related papers  (2023-12-14T13:47:13Z)
• Low-Dimensional Gradient Helps Out-of-Distribution Detection [26.237034426573523]
  We conduct a comprehensive investigation into leveraging the entirety of gradient information for OOD detection. The primary challenge arises from the high dimensionality of gradients due to the large number of network parameters. We propose performing linear dimension reduction on the gradient using a designated subspace. This innovative technique enables us to obtain a low-dimensional representation of the gradient with minimal information loss.
  arXiv  Detail & Related papers  (2023-10-26T05:28:32Z)
• GradOrth: A Simple yet Efficient Out-of-Distribution Detection with Orthogonal Projection of Gradients [24.50445616970387]
  out-of-distribution (OOD) data is crucial for ensuring the safe deployment of machine learning models in real-world applications. We propose a novel approach called GradOrth to facilitate OOD detection based on one intriguing observation. This simple yet effective method exhibits outstanding performance, showcasing a notable reduction in the average false positive rate at a 95% true positive rate (FPR95) of up to 8% when compared to the current state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-08-01T06:12:12Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• GOOD-D: On Unsupervised Graph Out-Of-Distribution Detection [67.90365841083951]
  We develop a new graph contrastive learning framework GOOD-D for detecting OOD graphs without using any ground-truth labels. GOOD-D is able to capture the latent ID patterns and accurately detect OOD graphs based on the semantic inconsistency in different granularities. As a pioneering work in unsupervised graph-level OOD detection, we build a comprehensive benchmark to compare our proposed approach with different state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-11-08T12:41:58Z)
• How Useful are Gradients for OOD Detection Really? [5.459639971144757]
  Out of distribution (OOD) detection is a critical challenge in deploying highly performant machine learning models in real-life applications. We provide an in-depth analysis and comparison of gradient based methods for OOD detection. We propose a general, non-gradient based method of OOD detection which improves over previous baselines in both performance and computational efficiency.
  arXiv  Detail & Related papers  (2022-05-20T21:10:05Z)
• Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data [77.27338842609153]
  characterization reveals that sensitivity to each type of shift is important to the detection and confidence calibration of OOD data. We propose a geometrically-inspired method to improve OOD detection under both shifts with only in-distribution data. We are the first to propose a method that works well across both OOD detection and calibration and under different types of shifts.
  arXiv  Detail & Related papers  (2021-10-28T15:42:55Z)
• ATOM: Robustifying Out-of-distribution Detection Using Outlier Mining [51.19164318924997]
  Adrial Training with informative Outlier Mining improves robustness of OOD detection. ATOM achieves state-of-the-art performance under a broad family of classic and adversarial OOD evaluation tasks.
  arXiv  Detail & Related papers  (2020-06-26T20:58:05Z)
• Robust Out-of-distribution Detection for Neural Networks [51.19164318924997]
  We show that existing detection mechanisms can be extremely brittle when evaluating on in-distribution and OOD inputs. We propose an effective algorithm called ALOE, which performs robust training by exposing the model to both adversarially crafted inlier and outlier examples.
  arXiv  Detail & Related papers  (2020-03-21T17:46:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.