Residual ANODE
- URL: http://arxiv.org/abs/2312.11629v1
- Date: Mon, 18 Dec 2023 19:00:03 GMT
- Title: Residual ANODE
- Authors: Ranit Das, Gregor Kasieczka and David Shih
- Abstract summary: We present R-ANODE, a new method for data-driven, model-agnostic resonant anomaly detection.
The key to R-ANODE is to enhance the inductive bias of the anomaly detection task by fitting a normalizing flow directly to the small and unknown signal component.
We show that the method works equally well whether the unknown signal fraction is learned or fixed, and is even robust to signal fraction misspecification.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present R-ANODE, a new method for data-driven, model-agnostic resonant
anomaly detection that raises the bar for both performance and
interpretability. The key to R-ANODE is to enhance the inductive bias of the
anomaly detection task by fitting a normalizing flow directly to the small and
unknown signal component, while holding fixed a background model (also a
normalizing flow) learned from sidebands. In doing so, R-ANODE is able to
outperform all classifier-based, weakly-supervised approaches, as well as the
previous ANODE method which fit a density estimator to all of the data in the
signal region instead of just the signal. We show that the method works equally
well whether the unknown signal fraction is learned or fixed, and is even
robust to signal fraction misspecification. Finally, with the learned signal
model we can sample and gain qualitative insights into the underlying anomaly,
which greatly enhances the interpretability of resonant anomaly detection and
offers the possibility of simultaneously discovering and characterizing the new
physics that could be hiding in the data.
Related papers
- CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for
Better Anomaly Detection [1.951082473090397]
We propose a self-supervised anomaly detection approach that combines contrastive learning with 2D-Flow.
Compared to mainstream unsupervised approaches, our self-supervised method demonstrates superior detection accuracy, fewer additional model parameters, and faster inference speed.
Our approach showcases new state-of-the-art results, achieving a performance of 99.6% in image-level AUROC on the MVTecAD dataset and 96.8% in image-level AUROC on the BTAD dataset.
arXiv Detail & Related papers (2023-11-12T10:07:03Z) - Score-based Source Separation with Applications to Digital Communication
Signals [72.6570125649502]
We propose a new method for separating superimposed sources using diffusion-based generative models.
Motivated by applications in radio-frequency (RF) systems, we are interested in sources with underlying discrete nature.
Our method can be viewed as a multi-source extension to the recently proposed score distillation sampling scheme.
arXiv Detail & Related papers (2023-06-26T04:12:40Z) - Spot The Odd One Out: Regularized Complete Cycle Consistent Anomaly Detector GAN [4.5123329001179275]
This study presents an adversarial method for anomaly detection in real-world applications, leveraging the power of generative adversarial neural networks (GANs)
Previous methods suffer from the high variance between class-wise accuracy which leads to not being applicable for all types of anomalies.
The proposed method named RCALAD tries to solve this problem by introducing a novel discriminator to the structure, which results in a more efficient training process.
arXiv Detail & Related papers (2023-04-16T13:05:39Z) - GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse
Problems with Denoising Diffusion Restoration [64.8770356696056]
We propose GibbsDDRM, an extension of Denoising Diffusion Restoration Models (DDRM) to a blind setting in which the linear measurement operator is unknown.
The proposed method is problem-agnostic, meaning that a pre-trained diffusion model can be applied to various inverse problems without fine-tuning.
arXiv Detail & Related papers (2023-01-30T06:27:48Z) - MissDAG: Causal Discovery in the Presence of Missing Data with
Continuous Additive Noise Models [78.72682320019737]
We develop a general method, which we call MissDAG, to perform causal discovery from data with incomplete observations.
MissDAG maximizes the expected likelihood of the visible part of observations under the expectation-maximization framework.
We demonstrate the flexibility of MissDAG for incorporating various causal discovery algorithms and its efficacy through extensive simulations and real data experiments.
arXiv Detail & Related papers (2022-05-27T09:59:46Z) - On the Double Descent of Random Features Models Trained with SGD [78.0918823643911]
We study properties of random features (RF) regression in high dimensions optimized by gradient descent (SGD)
We derive precise non-asymptotic error bounds of RF regression under both constant and adaptive step-size SGD setting.
We observe the double descent phenomenon both theoretically and empirically.
arXiv Detail & Related papers (2021-10-13T17:47:39Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - Iterative Correction of Sensor Degradation and a Bayesian Multi-Sensor
Data Fusion Method [0.0]
We present a novel method for inferring ground-truth signal from degraded signals.
The algorithm learns a multiplicative degradation effect by performing iterative corrections of two signals.
We include theoretical analysis and prove convergence to the ground-truth signal for the noiseless measurement model.
arXiv Detail & Related papers (2020-09-07T13:24:47Z) - Regularized Cycle Consistent Generative Adversarial Network for Anomaly
Detection [5.457279006229213]
We propose a new Regularized Cycle Consistent Generative Adversarial Network (RCGAN) in which deep neural networks are adversarially trained to better recognize anomalous samples.
Experimental results on both real-world and synthetic data show that our model leads to significant and consistent improvements on previous anomaly detection benchmarks.
arXiv Detail & Related papers (2020-01-18T03:35:05Z) - Anomaly Detection with Density Estimation [2.0813318162800707]
We propose a new unsupervised anomaly detection technique (ANODE)
By estimating the probability density of the data in a signal region and in sidebands, a likelihood ratio of data vs. background can be constructed.
ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods.
arXiv Detail & Related papers (2020-01-14T19:00:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.