Multi-Label Out-of-Distribution Detection with Spectral Normalized Joint Energy

• URL: http://arxiv.org/abs/2405.04759v2
• Date: Mon, 13 May 2024 01:39:34 GMT
• Title: Multi-Label Out-of-Distribution Detection with Spectral Normalized Joint Energy
• Authors: Yihan Mei, Xinyu Wang, Dell Zhang, Xiaoling Wang,
• Abstract summary: We introduce Spectral Normalized Joint Energy (SNoJoE), a method that consolidates label-specific information across multiple labels. Our findings indicate that the application of spectral normalization to joint energy scores notably amplifies the model's capability for OOD detection.
• Score: 14.149428145967939
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In today's interconnected world, achieving reliable out-of-distribution (OOD) detection poses a significant challenge for machine learning models. While numerous studies have introduced improved approaches for multi-class OOD detection tasks, the investigation into multi-label OOD detection tasks has been notably limited. We introduce Spectral Normalized Joint Energy (SNoJoE), a method that consolidates label-specific information across multiple labels through the theoretically justified concept of an energy-based function. Throughout the training process, we employ spectral normalization to manage the model's feature space, thereby enhancing model efficacy and generalization, in addition to bolstering robustness. Our findings indicate that the application of spectral normalization to joint energy scores notably amplifies the model's capability for OOD detection. We perform OOD detection experiments utilizing PASCAL-VOC as the in-distribution dataset and ImageNet-22K or Texture as the out-of-distribution datasets. Our experimental results reveal that, in comparison to prior top performances, SNoJoE achieves 11% and 54% relative reductions in FPR95 on the respective OOD datasets, thereby defining the new state of the art in this field of study.

Related papers

• EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion [47.0234440617797]
  Multi-label Out-Of-Distribution (OOD) detection aims to discriminate the OOD samples from the multi-label In-Distribution (ID) ones. JointEnergy is a representative multi-label OOD inference criterion. We propose an unknown-aware multi-label learning framework to reshape the uncertainty energy space layout.
  arXiv  Detail & Related papers  (2024-12-10T13:27:58Z)
• Revisiting Energy-Based Model for Out-of-Distribution Detection [23.39953997547791]
  Outlier Exposure by Simple Transformations (OEST) is a framework that enhances OOD detection by leveraging "peripheral-distribution" (PD) data. PD data are samples generated through simple data transformations, thus providing an efficient alternative to manually curated outliers. OEST* achieves better or similar accuracy compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-12-04T06:25:26Z)
• Can OOD Object Detectors Learn from Foundation Models? [56.03404530594071]
  Out-of-distribution (OOD) object detection is a challenging task due to the absence of open-set OOD data. Inspired by recent advancements in text-to-image generative models, we study the potential of generative models trained on large-scale open-set data to synthesize OOD samples. We introduce SyncOOD, a simple data curation method that capitalizes on the capabilities of large foundation models.
  arXiv  Detail & Related papers  (2024-09-08T17:28:22Z)
• Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark [73.58840254552656]
  Unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection have received significant attention in recent years. We present a Unified Benchmark for unsupervised Graph-level OOD and anomaly Detection (our method) Our benchmark encompasses 35 datasets spanning four practical anomaly and OOD detection scenarios. We conduct multi-dimensional analyses to explore the effectiveness, generalizability, robustness, and efficiency of existing methods.
  arXiv  Detail & Related papers  (2024-06-21T04:07:43Z)
• Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models [71.39421638547164]
  We propose to detect OOD molecules by adopting an auxiliary diffusion model-based framework, which compares similarities between input molecules and reconstructed graphs. Due to the generative bias towards reconstructing ID training samples, the similarity scores of OOD molecules will be much lower to facilitate detection. Our research pioneers an approach of Prototypical Graph Reconstruction for Molecular OOD Detection, dubbed as PGR-MOOD and hinges on three innovations.
  arXiv  Detail & Related papers  (2024-04-24T03:25:53Z)
• DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalization [58.704753031608625]
  Time series is one of the most challenging modalities in machine learning research. OOD detection and generalization on time series tend to suffer due to its non-stationary property. We propose DIVERSIFY, a framework for OOD detection and generalization on dynamic distributions of time series.
  arXiv  Detail & Related papers  (2023-08-04T12:27:11Z)
• A Functional Data Perspective and Baseline On Multi-Layer Out-of-Distribution Detection [30.499548939422194]
  Methods that explore the multiple layers either require a special architecture or a supervised objective to do so. This work adopts an original approach based on a functional view of the network that exploits the sample's trajectories through the various layers and their statistical dependencies. We validate our method and empirically demonstrate its effectiveness in OOD detection compared to strong state-of-the-art baselines on computer vision benchmarks.
  arXiv  Detail & Related papers  (2023-06-06T09:14:05Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• On the Usefulness of Deep Ensemble Diversity for Out-of-Distribution Detection [7.221206118679026]
  The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. An existing intuition in the literature is that the diversity of Deep Ensemble predictions indicates distributional shift. We show experimentally that this intuition is not valid on ImageNet-scale OOD detection.
  arXiv  Detail & Related papers  (2022-07-15T15:02:38Z)
• Provable Guarantees for Understanding Out-of-distribution Detection [13.36367318623728]
  We develop an analytical framework that characterizes and unifies the theoretical understanding for OOD detection. Our framework motivates a novel OOD detection method for neural networks, GEM, which demonstrates both theoretical and empirical superiority.
  arXiv  Detail & Related papers  (2021-12-01T19:18:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.