Unsupervised in-distribution anomaly detection of new physics through conditional density estimation

• URL: http://arxiv.org/abs/2012.11638v1
• Date: Mon, 21 Dec 2020 19:05:22 GMT
• Title: Unsupervised in-distribution anomaly detection of new physics through conditional density estimation
• Authors: George Stein, Uros Seljak, Biwei Dai
• Abstract summary: We present and motivate a method for unsupervised in-distribution anomaly detection using a conditional density estimator. We apply this method towards the detection of new physics in simulated Large Hadron Collider (LHC) particle collisions as part of the 2020 LHC Olympics blind challenge. The results we present are our original blind submission to the 2020 LHC Olympics, where it achieved the state-of-the-art performance.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Anomaly detection is a key application of machine learning, but is generally focused on the detection of outlying samples in the low probability density regions of data. Here we instead present and motivate a method for unsupervised in-distribution anomaly detection using a conditional density estimator, designed to find unique, yet completely unknown, sets of samples residing in high probability density regions. We apply this method towards the detection of new physics in simulated Large Hadron Collider (LHC) particle collisions as part of the 2020 LHC Olympics blind challenge, and show how we detected a new particle appearing in only 0.08% of 1 million collision events. The results we present are our original blind submission to the 2020 LHC Olympics, where it achieved the state-of-the-art performance.

Related papers

• Track Any Anomalous Object: A Granular Video Anomaly Detection Pipeline [63.96226274616927]
  A new framework called Track Any Anomalous Object (TAO) introduces a granular video anomaly detection pipeline.<n>Unlike methods that assign anomaly scores to every pixel, our approach transforms the problem into pixel-level tracking of anomalous objects.<n>Experiments demonstrate that TAO sets new benchmarks in accuracy and robustness.
  arXiv  Detail & Related papers  (2025-06-05T15:49:39Z)
• Causal Lifting of Neural Representations: Zero-Shot Generalization for Causal Inferences [56.23412698865433]
  We focus on causal inferences on a target experiment with unlabeled factual outcomes, retrieved by a predictive model fine-tuned on a labeled similar experiment. First, we show that factual outcome estimation via Empirical Risk Minimization (ERM) may fail to yield valid causal inferences on the target population. We propose Deconfounded Empirical Risk Minimization (DERM), a new simple learning procedure minimizing the risk over a fictitious target population.
  arXiv  Detail & Related papers  (2025-02-10T10:52:17Z)
• Sobolev Space Regularised Pre Density Models [51.558848491038916]
  We propose a new approach to non-parametric density estimation that is based on regularizing a Sobolev norm of the density. This method is statistically consistent, and makes the inductive validation model clear and consistent.
  arXiv  Detail & Related papers  (2023-07-25T18:47:53Z)
• Unravelling physics beyond the standard model with classical and quantum anomaly detection [1.014313095022286]
  Current experiments do not indicate clear signs of new physics that could guide the development of additional Beyond Standard Model (BSM) theories. We propose a novel strategy to perform anomaly detection in a supervised learning setting, based on the artificial creation of anomalies through a random process. Even more promising, we find employing an SVC trained to identify the artificial anomalies, it is possible to identify realistic BSM events with high accuracy.
  arXiv  Detail & Related papers  (2023-01-25T19:00:14Z)
• Towards Spatial Equilibrium Object Detection [88.9747319572368]
  In this paper, we study the spatial disequilibrium problem of modern object detectors. We propose to quantify this problem by measuring the detection performance over zones. This motivates us to design a more generalized measurement, termed Spatial equilibrium Precision.
  arXiv  Detail & Related papers  (2023-01-14T17:33:26Z)
• Coincidence postselection for genuine multipartite nonlocality: Causal diagrams and threshold efficiencies [0.0]
  We show how to close the detection loophole for a coincidence detection in demonstrations of nonlocality and GMN. Our results imply that genuine $N$-partite nonlocality can be generated from $N$ independent particle sources even when allowing for non-ideal detectors.
  arXiv  Detail & Related papers  (2022-07-27T15:21:38Z)
• Fake It Till You Make It: Near-Distribution Novelty Detection by Score-Based Generative Models [54.182955830194445]
  existing models either fail or face a dramatic drop under the so-called near-distribution" setting. We propose to exploit a score-based generative model to produce synthetic near-distribution anomalous data. Our method improves the near-distribution novelty detection by 6% and passes the state-of-the-art by 1% to 5% across nine novelty detection benchmarks.
  arXiv  Detail & Related papers  (2022-05-28T02:02:53Z)
• Density-Based Clustering with Kernel Diffusion [59.4179549482505]
  A naive density corresponding to the indicator function of a unit $d$-dimensional Euclidean ball is commonly used in density-based clustering algorithms. We propose a new kernel diffusion density function, which is adaptive to data of varying local distributional characteristics and smoothness.
  arXiv  Detail & Related papers  (2021-10-11T09:00:33Z)
• Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
  We introduce a novel weakly-supervised anomaly detection framework to train detection models. The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability. Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
  arXiv  Detail & Related papers  (2021-08-01T14:33:17Z)
• New Methods and Datasets for Group Anomaly Detection From Fundamental Physics [0.4297070083645048]
  Unsupervised group anomaly detection has become a new frontier of fundamental physics. We propose a realistic synthetic benchmark dataset (LHCO 2020) for the development of group anomaly detection algorithms.
  arXiv  Detail & Related papers  (2021-07-06T18:00:57Z)
• DAAIN: Detection of Anomalous and Adversarial Input using Normalizing Flows [52.31831255787147]
  We introduce a novel technique, DAAIN, to detect out-of-distribution (OOD) inputs and adversarial attacks (AA) Our approach monitors the inner workings of a neural network and learns a density estimator of the activation distribution. Our model can be trained on a single GPU making it compute efficient and deployable without requiring specialized accelerators.
  arXiv  Detail & Related papers  (2021-05-30T22:07:13Z)
• The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider [0.0]
  We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms.
  arXiv  Detail & Related papers  (2021-05-28T18:00:02Z)
• Anomaly Detection with Density Estimation [2.0813318162800707]
  We propose a new unsupervised anomaly detection technique (ANODE) By estimating the probability density of the data in a signal region and in sidebands, a likelihood ratio of data vs. background can be constructed. ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods.
  arXiv  Detail & Related papers  (2020-01-14T19:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.