Variational Autoencoders for Anomalous Jet Tagging
- URL: http://arxiv.org/abs/2007.01850v3
- Date: Mon, 15 Feb 2021 18:54:08 GMT
- Title: Variational Autoencoders for Anomalous Jet Tagging
- Authors: Taoli Cheng, Jean-Fran\c{c}ois Arguin, Julien Leissner-Martin,
Jacinthe Pilette, Tobias Golling
- Abstract summary: We present a detailed study on Variational Autoencoders (VAEs) for anomalous jet tagging at the Large Hadron Collider.
VAEs are able to encode important information for reconstructing jets, while learning an expressive posterior distribution in the latent space.
We propose the Outlier Exposed VAE, for which some samples are introduced in the training process to guide the learned information.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a detailed study on Variational Autoencoders (VAEs) for anomalous
jet tagging at the Large Hadron Collider. By taking in low-level jet
constituents' information, and training with background QCD jets in an
unsupervised manner, the VAE is able to encode important information for
reconstructing jets, while learning an expressive posterior distribution in the
latent space. When using the VAE as an anomaly detector, we present different
approaches to detect anomalies: directly comparing in the input space or,
instead, working in the latent space. In order to facilitate general search
approaches such as bump-hunt, mass-decorrelated VAEs based on distance
correlation regularization are also studied. We find that the naive
mass-decorrelated VAEs fail at maintaining proper detection performance, by
assigning higher probabilities to some anomalous samples. To build a performant
mass-decorrelated anomalous jet tagger, we propose the Outlier Exposed VAE
(OE-VAE), for which some outlier samples are introduced in the training process
to guide the learned information. OE-VAEs are employed to achieve two goals at
the same time: increasing sensitivity of outlier detection and decorrelating
jet mass from the anomaly score. We succeed in reaching excellent results from
both aspects. Code implementation of this work can be found at
\href{https://github.com/taolicheng/VAE-Jet}{Github}.
Related papers
- Improved Anomaly Detection through Conditional Latent Space VAE Ensembles [49.1574468325115]
Conditional Latent space Variational Autoencoder (CL-VAE) improved pre-processing for anomaly detection on data with known inlier classes and unknown outlier classes.
Model shows increased accuracy in anomaly detection, achieving an AUC of 97.4% on the MNIST dataset.
In addition, the CL-VAE shows increased benefits from ensembling, a more interpretable latent space, and an increased ability to learn patterns in complex data with limited model sizes.
arXiv Detail & Related papers (2024-10-16T07:48:53Z) - Resilient VAE: Unsupervised Anomaly Detection at the SLAC Linac Coherent
Light Source [3.7390282036618916]
This paper introduces the Resilient Variational Autoencoder (ResVAE), a deep generative model specifically designed for anomaly detection.
ResVAE exhibits resilience to anomalies present in the training data and provides feature-level anomaly attribution.
We apply our proposed method to detect anomalies in the accelerator status at the SLAC Linac Coherent Light Source.
arXiv Detail & Related papers (2023-09-05T15:53:41Z) - Unsupervised Out-of-Distribution Detection by Restoring Lossy Inputs
with Variational Autoencoder [3.498694457257263]
We propose a novel VAE-based score called Error Reduction (ER) for OOD detection.
ER is based on a VAE that takes a lossy version of the training set as inputs and the original set as targets.
arXiv Detail & Related papers (2023-09-05T09:42:15Z) - What do we learn? Debunking the Myth of Unsupervised Outlier Detection [9.599183039166284]
We investigate what auto-encoders actually learn when they are posed to solve two different tasks.
We show that state-of-the-art (SOTA) AEs are either unable to constrain the latent manifold and allow reconstruction of abnormal patterns, or they are failing to accurately restore the inputs from their latent distribution.
We propose novel deformable auto-encoders (AEMorphus) to learn perceptually aware global image priors and locally adapt their morphometry.
arXiv Detail & Related papers (2022-06-08T06:36:16Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly
Detection [9.19194451963411]
Semi-supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data.
We propose a method, DASVDD, that jointly learns the parameters of an autoencoder while minimizing the volume of an enclosing hyper-sphere on its latent representation.
arXiv Detail & Related papers (2021-06-09T21:57:41Z) - DAAIN: Detection of Anomalous and Adversarial Input using Normalizing
Flows [52.31831255787147]
We introduce a novel technique, DAAIN, to detect out-of-distribution (OOD) inputs and adversarial attacks (AA)
Our approach monitors the inner workings of a neural network and learns a density estimator of the activation distribution.
Our model can be trained on a single GPU making it compute efficient and deployable without requiring specialized accelerators.
arXiv Detail & Related papers (2021-05-30T22:07:13Z) - Autoencoders for unsupervised anomaly detection in high energy physics [105.54048699217668]
We study the tagging of top jet images in a background of QCD jet images.
We show that the standard autoencoder setup cannot be considered as a model-independent anomaly tagger.
We suggest improved performance measures for the task of model-independent anomaly detection.
arXiv Detail & Related papers (2021-04-19T05:06:57Z) - Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction.
We put forward an alternative measure of anomaly score to replace the reconstruction-based metric.
Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
arXiv Detail & Related papers (2020-03-24T08:26:58Z) - SUOD: Accelerating Large-Scale Unsupervised Heterogeneous Outlier
Detection [63.253850875265115]
Outlier detection (OD) is a key machine learning (ML) task for identifying abnormal objects from general samples.
We propose a modular acceleration system, called SUOD, to address it.
arXiv Detail & Related papers (2020-03-11T00:22:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.