Residual ANODE
- URL: http://arxiv.org/abs/2312.11629v1
- Date: Mon, 18 Dec 2023 19:00:03 GMT
- Title: Residual ANODE
- Authors: Ranit Das, Gregor Kasieczka and David Shih
- Abstract summary: We present R-ANODE, a new method for data-driven, model-agnostic resonant anomaly detection.
The key to R-ANODE is to enhance the inductive bias of the anomaly detection task by fitting a normalizing flow directly to the small and unknown signal component.
We show that the method works equally well whether the unknown signal fraction is learned or fixed, and is even robust to signal fraction misspecification.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We present R-ANODE, a new method for data-driven, model-agnostic resonant
anomaly detection that raises the bar for both performance and
interpretability. The key to R-ANODE is to enhance the inductive bias of the
anomaly detection task by fitting a normalizing flow directly to the small and
unknown signal component, while holding fixed a background model (also a
normalizing flow) learned from sidebands. In doing so, R-ANODE is able to
outperform all classifier-based, weakly-supervised approaches, as well as the
previous ANODE method which fit a density estimator to all of the data in the
signal region instead of just the signal. We show that the method works equally
well whether the unknown signal fraction is learned or fixed, and is even
robust to signal fraction misspecification. Finally, with the learned signal
model we can sample and gain qualitative insights into the underlying anomaly,
which greatly enhances the interpretability of resonant anomaly detection and
offers the possibility of simultaneously discovering and characterizing the new
physics that could be hiding in the data.
Related papers
- Robust semi-parametric signal detection in particle physics with classifiers decorrelated via optimal transport [0.20971479389679337]
In particle physics, a supervised classifier is used to separate a signal model from the known Standard Model physics.
But errors in the background model might adversely affect the signal detection procedure.
This paper shows how to use the (possibly misspecified) classifier only to perform a preliminary signal-enrichment step.
We then carry out a bump hunt on the signal-rich sample using only the real experimental data.
arXiv Detail & Related papers (2024-09-10T10:32:21Z) - Score-based Source Separation with Applications to Digital Communication
Signals [72.6570125649502]
We propose a new method for separating superimposed sources using diffusion-based generative models.
Motivated by applications in radio-frequency (RF) systems, we are interested in sources with underlying discrete nature.
Our method can be viewed as a multi-source extension to the recently proposed score distillation sampling scheme.
arXiv Detail & Related papers (2023-06-26T04:12:40Z) - A Geometric Perspective on Diffusion Models [57.27857591493788]
We inspect the ODE-based sampling of a popular variance-exploding SDE.
We establish a theoretical relationship between the optimal ODE-based sampling and the classic mean-shift (mode-seeking) algorithm.
arXiv Detail & Related papers (2023-05-31T15:33:16Z) - Spot The Odd One Out: Regularized Complete Cycle Consistent Anomaly Detector GAN [4.5123329001179275]
This study presents an adversarial method for anomaly detection in real-world applications, leveraging the power of generative adversarial neural networks (GANs)
Previous methods suffer from the high variance between class-wise accuracy which leads to not being applicable for all types of anomalies.
The proposed method named RCALAD tries to solve this problem by introducing a novel discriminator to the structure, which results in a more efficient training process.
arXiv Detail & Related papers (2023-04-16T13:05:39Z) - GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse
Problems with Denoising Diffusion Restoration [64.8770356696056]
We propose GibbsDDRM, an extension of Denoising Diffusion Restoration Models (DDRM) to a blind setting in which the linear measurement operator is unknown.
The proposed method is problem-agnostic, meaning that a pre-trained diffusion model can be applied to various inverse problems without fine-tuning.
arXiv Detail & Related papers (2023-01-30T06:27:48Z) - MissDAG: Causal Discovery in the Presence of Missing Data with
Continuous Additive Noise Models [78.72682320019737]
We develop a general method, which we call MissDAG, to perform causal discovery from data with incomplete observations.
MissDAG maximizes the expected likelihood of the visible part of observations under the expectation-maximization framework.
We demonstrate the flexibility of MissDAG for incorporating various causal discovery algorithms and its efficacy through extensive simulations and real data experiments.
arXiv Detail & Related papers (2022-05-27T09:59:46Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - Iterative Correction of Sensor Degradation and a Bayesian Multi-Sensor
Data Fusion Method [0.0]
We present a novel method for inferring ground-truth signal from degraded signals.
The algorithm learns a multiplicative degradation effect by performing iterative corrections of two signals.
We include theoretical analysis and prove convergence to the ground-truth signal for the noiseless measurement model.
arXiv Detail & Related papers (2020-09-07T13:24:47Z) - Regularized Cycle Consistent Generative Adversarial Network for Anomaly
Detection [5.457279006229213]
We propose a new Regularized Cycle Consistent Generative Adversarial Network (RCGAN) in which deep neural networks are adversarially trained to better recognize anomalous samples.
Experimental results on both real-world and synthetic data show that our model leads to significant and consistent improvements on previous anomaly detection benchmarks.
arXiv Detail & Related papers (2020-01-18T03:35:05Z) - Anomaly Detection with Density Estimation [2.0813318162800707]
We propose a new unsupervised anomaly detection technique (ANODE)
By estimating the probability density of the data in a signal region and in sidebands, a likelihood ratio of data vs. background can be constructed.
ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods.
arXiv Detail & Related papers (2020-01-14T19:00:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.