Novelty Detection Through Model-Based Characterization of Neural Networks

• URL: http://arxiv.org/abs/2008.06094v1
• Date: Thu, 13 Aug 2020 20:03:25 GMT
• Title: Novelty Detection Through Model-Based Characterization of Neural Networks
• Authors: Gukyeong Kwon, Mohit Prabhushankar, Dogancan Temel, Ghassan AlRegib
• Abstract summary: We propose a model-based characterization of neural networks to detect novel input types and conditions. We validate our approach using four image recognition datasets including MNIST, Fashion-MNIST, CIFAR-10, and CURE-TSR.
• Score: 19.191613437266184
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we propose a model-based characterization of neural networks to detect novel input types and conditions. Novelty detection is crucial to identify abnormal inputs that can significantly degrade the performance of machine learning algorithms. Majority of existing studies have focused on activation-based representations to detect abnormal inputs, which limits the characterization of abnormality from a data perspective. However, a model perspective can also be informative in terms of the novelties and abnormalities. To articulate the significance of the model perspective in novelty detection, we utilize backpropagated gradients. We conduct a comprehensive analysis to compare the representation capability of gradients with that of activation and show that the gradients outperform the activation in novel class and condition detection. We validate our approach using four image recognition datasets including MNIST, Fashion-MNIST, CIFAR-10, and CURE-TSR. We achieve a significant improvement on all four datasets with an average AUROC of 0.953, 0.918, 0.582, and 0.746, respectively.

Related papers

• Image anomaly detection and prediction scheme based on SSA optimized ResNet50-BiGRU model [6.95262627755758]
  This paper introduces a network combining Residual Network (ResNet) and Bidirectional Gated Recurrent Unit (BiGRU) It can predict potential injury types and provide early warnings by analyzing changes in muscle and bone poses from video images. Experiments conducted on four datasets demonstrated that our model has the smallest error in image anomaly detection compared to other models.
  arXiv  Detail & Related papers  (2024-06-20T04:26:45Z)
• Feature graph construction with static features for malware detection [0.7640997351702609]
  We introduce a feature graph-based malware detection method, MFGraph, to characterize applications. We demonstrate that it achieves an AUC score of 0.98756 on the malware detection task, outperforming other baseline models. The AUC score of MFGraph decreases by only 5.884% in one year, indicating that it is the least affected by concept drift.
  arXiv  Detail & Related papers  (2024-04-25T06:54:32Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• Fake It Till You Make It: Near-Distribution Novelty Detection by Score-Based Generative Models [54.182955830194445]
  existing models either fail or face a dramatic drop under the so-called near-distribution" setting. We propose to exploit a score-based generative model to produce synthetic near-distribution anomalous data. Our method improves the near-distribution novelty detection by 6% and passes the state-of-the-art by 1% to 5% across nine novelty detection benchmarks.
  arXiv  Detail & Related papers  (2022-05-28T02:02:53Z)
• Entity-Conditioned Question Generation for Robust Attention Distribution in Neural Information Retrieval [51.53892300802014]
  We show that supervised neural information retrieval models are prone to learning sparse attention patterns over passage tokens. Using a novel targeted synthetic data generation method, we teach neural IR to attend more uniformly and robustly to all entities in a given passage.
  arXiv  Detail & Related papers  (2022-04-24T22:36:48Z)
• Facial Anatomical Landmark Detection using Regularized Transfer Learning with Application to Fetal Alcohol Syndrome Recognition [24.27777060287004]
  Fetal alcohol syndrome (FAS) caused by prenatal alcohol exposure can result in a series of cranio-facial anomalies. Anatomical landmark detection is important to detect the presence of FAS associated facial anomalies. Current deep learning-based heatmap regression methods designed for facial landmark detection in natural images assume availability of large datasets. We develop a new regularized transfer learning approach that exploits the knowledge of a network learned on large facial recognition datasets.
  arXiv  Detail & Related papers  (2021-09-12T11:05:06Z)
• Gradients as a Measure of Uncertainty in Neural Networks [16.80077149399317]
  We propose to utilize backpropagated gradients to quantify the uncertainty of trained models. We show that our gradient-based method outperforms state-of-the-art methods by up to 4.8% of AUROC score in out-of-distribution detection.
  arXiv  Detail & Related papers  (2020-08-18T16:58:46Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Regularized Cycle Consistent Generative Adversarial Network for Anomaly Detection [5.457279006229213]
  We propose a new Regularized Cycle Consistent Generative Adversarial Network (RCGAN) in which deep neural networks are adversarially trained to better recognize anomalous samples. Experimental results on both real-world and synthetic data show that our model leads to significant and consistent improvements on previous anomaly detection benchmarks.
  arXiv  Detail & Related papers  (2020-01-18T03:35:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.