Unsupervised Energy-based Out-of-distribution Detection using Stiefel-Restricted Kernel Machine

• URL: http://arxiv.org/abs/2102.08443v1
• Date: Tue, 16 Feb 2021 20:46:50 GMT
• Title: Unsupervised Energy-based Out-of-distribution Detection using Stiefel-Restricted Kernel Machine
• Authors: Francesco Tonin, Arun Pandey, Panagiotis Patrinos, Johan A. K. Suykens
• Abstract summary: We propose an unsupervised energy-based OOD detector leveraging the Stiefel-Restricted Kernel Machine (St-RKM) In the experiments on standard datasets, the proposed method improves over the existing energy-based OOD detectors and deep generative models.
• Score: 13.345005810199181
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Detecting out-of-distribution (OOD) samples is an essential requirement for the deployment of machine learning systems in the real world. Until now, research on energy-based OOD detectors has focused on the softmax confidence score from a pre-trained neural network classifier with access to class labels. In contrast, we propose an unsupervised energy-based OOD detector leveraging the Stiefel-Restricted Kernel Machine (St-RKM). Training requires minimizing an objective function with an autoencoder loss term and the RKM energy where the interconnection matrix lies on the Stiefel manifold. Further, we outline multiple energy function definitions based on the RKM framework and discuss their utility. In the experiments on standard datasets, the proposed method improves over the existing energy-based OOD detectors and deep generative models. Through several ablation studies, we further illustrate the merit of each proposed energy function on the OOD detection performance.

Related papers

• Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark [73.58840254552656]
  Unsupervised graph-level anomaly detection (GLAD) and unsupervised graph-level out-of-distribution (OOD) detection have received significant attention in recent years. We present a Unified Benchmark for unsupervised Graph-level OOD and anomaly Detection (our method) Our benchmark encompasses 35 datasets spanning four practical anomaly and OOD detection scenarios. We conduct multi-dimensional analyses to explore the effectiveness, generalizability, robustness, and efficiency of existing methods.
  arXiv  Detail & Related papers  (2024-06-21T04:07:43Z)
• Multi-Label Out-of-Distribution Detection with Spectral Normalized Joint Energy [14.149428145967939]
  We introduce Spectral Normalized Joint Energy (SNoJoE), a method that consolidates label-specific information across multiple labels. Our findings indicate that the application of spectral normalization to joint energy scores notably amplifies the model's capability for OOD detection.
  arXiv  Detail & Related papers  (2024-05-08T02:05:38Z)
• Multiagent Reinforcement Learning with an Attention Mechanism for Improving Energy Efficiency in LoRa Networks [52.96907334080273]
  As the network scale increases, the energy efficiency of LoRa networks decreases sharply due to severe packet collisions. We propose a transmission parameter allocation algorithm based on multiagent reinforcement learning (MALoRa) Simulation results demonstrate that MALoRa significantly improves the system EE compared with baseline algorithms.
  arXiv  Detail & Related papers  (2023-09-16T11:37:23Z)
• Autonomous Point Cloud Segmentation for Power Lines Inspection in Smart Grid [56.838297900091426]
  An unsupervised Machine Learning (ML) framework is proposed, to detect, extract and analyze the characteristics of power lines of both high and low voltage. The proposed framework can efficiently detect the power lines and perform PLC-based hazard analysis.
  arXiv  Detail & Related papers  (2023-08-14T17:14:58Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• Beyond Mahalanobis-Based Scores for Textual OOD Detection [32.721317681946246]
  We introduce TRUSTED, a new OOD detector for classifiers based on Transformer architectures that meets operational requirements. The efficiency of TRUSTED relies on the fruitful idea that all hidden layers carry relevant information to detect OOD examples. Our experiments involve 51k model configurations, including various checkpoints, seeds, datasets, and demonstrate that TRUSTED achieves state-of-the-art performances.
  arXiv  Detail & Related papers  (2022-11-24T10:51:58Z)
• Energy-based Unknown Intent Detection with Data Manipulation [48.76465739088016]
  Unknown intent detection aims to identify the out-of-distribution utterance whose intent has never appeared in the training set. We propose using energy scores for this task as the energy score is theoretically aligned with the density of the input.
  arXiv  Detail & Related papers  (2021-07-27T01:32:23Z)
• Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates [1.7205106391379024]
  We present a deep autoencoder based energy method (DAEM) for the bending, vibration and buckling analysis of Kirchhoff plates. The DAEM exploits the higher order continuity of the DAEM and integrates a deep autoencoder and the minimum total potential principle.
  arXiv  Detail & Related papers  (2020-10-09T09:26:33Z)
• Energy-based Out-of-distribution Detection [24.320646820385065]
  We propose a unified framework for OOD detection that uses an energy score. We show that energy scores better distinguish in- and out-of-distribution samples than the traditional approach. With energy-based training, our method outperforms the state-of-the-art on common benchmarks.
  arXiv  Detail & Related papers  (2020-10-08T04:42:17Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.