Real-time Detection of Anomalies in Multivariate Time Series of
Astronomical Data
- URL: http://arxiv.org/abs/2112.08415v1
- Date: Wed, 15 Dec 2021 19:02:54 GMT
- Title: Real-time Detection of Anomalies in Multivariate Time Series of
Astronomical Data
- Authors: Daniel Muthukrishna, Kaisey S. Mandel, Michelle Lochner, Sara Webb,
Gautham Narayan
- Abstract summary: Astronomical transients are stellar objects that become temporarily brighter on various timescales.
New astronomical sky surveys are observing unprecedented numbers of multi-wavelength transients.
We present two novel methods that aim to quickly and automatically detect anomalous transient light curves in real-time.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Astronomical transients are stellar objects that become temporarily brighter
on various timescales and have led to some of the most significant discoveries
in cosmology and astronomy. Some of these transients are the explosive deaths
of stars known as supernovae while others are rare, exotic, or entirely new
kinds of exciting stellar explosions. New astronomical sky surveys are
observing unprecedented numbers of multi-wavelength transients, making standard
approaches of visually identifying new and interesting transients infeasible.
To meet this demand, we present two novel methods that aim to quickly and
automatically detect anomalous transient light curves in real-time. Both
methods are based on the simple idea that if the light curves from a known
population of transients can be accurately modelled, any deviations from model
predictions are likely anomalies. The first approach is a probabilistic neural
network built using Temporal Convolutional Networks (TCNs) and the second is an
interpretable Bayesian parametric model of a transient. We show that the
flexibility of neural networks, the attribute that makes them such a powerful
tool for many regression tasks, is what makes them less suitable for anomaly
detection when compared with our parametric model.
Related papers
- Real-time gravitational-wave inference for binary neutron stars using machine learning [71.29593576787549]
We present a machine learning framework that performs complete BNS inference in just one second without making any approximations.
Our approach enhances multi-messenger observations by providing (i) accurate localization even before the merger; (ii) improved localization precision by $sim30%$ compared to approximate low-latency methods; and (iii) detailed information on luminosity distance, inclination, and masses.
arXiv Detail & Related papers (2024-07-12T18:00:02Z) - A Classifier-Based Approach to Multi-Class Anomaly Detection for Astronomical Transients [0.0]
Real-time anomaly detection is essential for identifying rare transients in the era of large-scale astronomical surveys.
Currently, most anomaly detection algorithms for astronomical transients rely on hand-crafted features extracted from light curves.
We introduce an alternative approach to detecting anomalies: using the penultimate layer of a neural network classifier as the latent space for anomaly detection.
arXiv Detail & Related papers (2024-03-21T18:00:00Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised
Time Series Anomaly Detection [49.52429991848581]
We propose a Light and Anti-overfitting Retraining Approach (LARA) for deep variational auto-encoder based time series anomaly detection methods (VAEs)
This work aims to make three novel contributions: 1) the retraining process is formulated as a convex problem and can converge at a fast rate as well as prevent overfitting; 2) designing a ruminate block, which leverages the historical data without the need to store them; and 3) mathematically proving that when fine-tuning the latent vector and reconstructed data, the linear formations can achieve the least adjusting errors between the ground truths and the fine-tuned ones.
arXiv Detail & Related papers (2023-10-09T12:36:16Z) - Self-Supervised Learning for Modeling Gamma-ray Variability in Blazars [0.0]
Blazars are active galactic nuclei with relativistic jets pointed almost directly at Earth.
Deep learning can help uncover structure in gamma-ray blazars' complex variability patterns.
arXiv Detail & Related papers (2023-02-15T14:57:46Z) - Are we certain it's anomalous? [57.729669157989235]
Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations.
Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD)
HypAD learns self-supervisedly to reconstruct the input signal.
arXiv Detail & Related papers (2022-11-16T21:31:39Z) - Supernova Light Curves Approximation based on Neural Network Models [53.180678723280145]
Photometric data-driven classification of supernovae becomes a challenge due to the appearance of real-time processing of big data in astronomy.
Recent studies have demonstrated the superior quality of solutions based on various machine learning models.
We study the application of multilayer perceptron (MLP), bayesian neural network (BNN), and normalizing flows (NF) to approximate observations for a single light curve.
arXiv Detail & Related papers (2022-06-27T13:46:51Z) - Real-time detection of anomalies in large-scale transient surveys [0.0]
We present two novel methods of automatically detecting anomalous transient light curves in real-time.
Both methods are based on the simple idea that if the light curves from a known population of transients can be accurately modelled, any deviations from model predictions are likely anomalies.
arXiv Detail & Related papers (2021-10-29T18:29:25Z) - A Deep Learning Approach for Active Anomaly Detection of Extragalactic
Transients [1.7152709285783647]
We present a variational recurrent autoencoder neural network to encode simulated Rubin Observatory extragalactic transient events.
We rank 1,129,184 events based on an anomaly score estimated using an isolation forest.
Our algorithm is able to identify these transients as anomalous well before peak, enabling real-time follow up studies.
arXiv Detail & Related papers (2021-03-22T18:02:19Z) - Anomaly Detection for Multivariate Time Series of Exotic Supernovae [1.2999518604217852]
We present an unsupervised method to search for anomalous time series in real time.
We apply this method to a simulated dataset of 12,159 supernovae.
This work is the first anomaly detection pipeline for supernovae which works with online datastreams.
arXiv Detail & Related papers (2020-10-21T18:00:01Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.