Training Process of Unsupervised Learning Architecture for Gravity Spy
Dataset
- URL: http://arxiv.org/abs/2208.03623v1
- Date: Sun, 7 Aug 2022 02:51:36 GMT
- Title: Training Process of Unsupervised Learning Architecture for Gravity Spy
Dataset
- Authors: Yusuke Sakai, Yousuke Itoh, Piljong Jung, Keiko Kokeyama, Chihiro
Kozakai, Katsuko T. Nakahira, Shoichi Oshino, Yutaka Shikano, Hirotaka
Takahashi, Takashi Uchiyama, Gen Ueshima, Tatsuki Washimi, Takahiro Yamamoto,
Takaaki Yokozawa
- Abstract summary: Transient noise appearing in the data from gravitational-wave detectors frequently causes problems.
Because transient noise is considered to be associated with the environment and instrument, its classification would help to understand its origin and improve the detector's performance.
In a previous study, an architecture for classifying transient noise using a time-frequency 2D image (spectrogram) is proposed, which uses unsupervised deep learning combined with variational autoencoder and invariant information clustering.
The proposed unsupervised-learning architecture is applied to the Gravity Spy dataset, which consists of Advanced Laser Interferometer Gravitational-Wave Observatory (Advanced
- Score: 2.8555963243398073
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Transient noise appearing in the data from gravitational-wave detectors
frequently causes problems, such as instability of the detectors and
overlapping or mimicking gravitational-wave signals. Because transient noise is
considered to be associated with the environment and instrument, its
classification would help to understand its origin and improve the detector's
performance. In a previous study, an architecture for classifying transient
noise using a time-frequency 2D image (spectrogram) is proposed, which uses
unsupervised deep learning combined with variational autoencoder and invariant
information clustering. The proposed unsupervised-learning architecture is
applied to the Gravity Spy dataset, which consists of Advanced Laser
Interferometer Gravitational-Wave Observatory (Advanced LIGO) transient noises
with their associated metadata to discuss the potential for online or offline
data analysis. In this study, focused on the Gravity Spy dataset, the training
process of unsupervised-learning architecture of the previous study is examined
and reported.
Related papers
- Localized Gaussians as Self-Attention Weights for Point Clouds Correspondence [92.07601770031236]
We investigate semantically meaningful patterns in the attention heads of an encoder-only Transformer architecture.
We find that fixing the attention weights not only accelerates the training process but also enhances the stability of the optimization.
arXiv Detail & Related papers (2024-09-20T07:41:47Z) - Improving Robustness of Spectrogram Classifiers with Neural Stochastic Differential Equations [4.259762400898358]
Computer-vision-based deep learning models applied to spectrograms have proven useful in the field of signal classification and detection.
These methods aren't designed to handle the low signal-to-noise ratios inherent within non-vision signal processing tasks.
arXiv Detail & Related papers (2024-09-03T02:03:50Z) - SoftPatch: Unsupervised Anomaly Detection with Noisy Data [67.38948127630644]
This paper considers label-level noise in image sensory anomaly detection for the first time.
We propose a memory-based unsupervised AD method, SoftPatch, which efficiently denoises the data at the patch level.
Compared with existing methods, SoftPatch maintains a strong modeling ability of normal data and alleviates the overconfidence problem in coreset.
arXiv Detail & Related papers (2024-03-21T08:49:34Z) - Learning with Noisy Foundation Models [95.50968225050012]
This paper is the first work to comprehensively understand and analyze the nature of noise in pre-training datasets.
We propose a tuning method (NMTune) to affine the feature space to mitigate the malignant effect of noise and improve generalization.
arXiv Detail & Related papers (2024-03-11T16:22:41Z) - Robust Tiny Object Detection in Aerial Images amidst Label Noise [50.257696872021164]
This study addresses the issue of tiny object detection under noisy label supervision.
We propose a DeNoising Tiny Object Detector (DN-TOD), which incorporates a Class-aware Label Correction scheme.
Our method can be seamlessly integrated into both one-stage and two-stage object detection pipelines.
arXiv Detail & Related papers (2024-01-16T02:14:33Z) - Treatment Learning Causal Transformer for Noisy Image Classification [62.639851972495094]
In this work, we incorporate this binary information of "existence of noise" as treatment into image classification tasks to improve prediction accuracy.
Motivated from causal variational inference, we propose a transformer-based architecture, that uses a latent generative model to estimate robust feature representations for noise image classification.
We also create new noisy image datasets incorporating a wide range of noise factors for performance benchmarking.
arXiv Detail & Related papers (2022-03-29T13:07:53Z) - Architectural Optimization and Feature Learning for High-Dimensional
Time Series Datasets [0.7388859384645262]
We study the problem of predicting the presence of transient noise artifacts in a gravitational wave detector.
We introduce models that reduce the error rate by over 60% compared to the previous state of the art.
arXiv Detail & Related papers (2022-02-27T23:41:23Z) - Unsupervised Learning Architecture for Classifying the Transient Noise
of Interferometric Gravitational-wave Detectors [2.8555963243398073]
transient noise with non-stationary and non-Gaussian features occurs at a high rate.
Classification of transient noise can offer clues for exploring its origin and improving the performance of the detector.
In this study, we propose an unsupervised learning architecture for the classification of transient noise.
arXiv Detail & Related papers (2021-11-19T05:37:06Z) - DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly
detection in air transportation [68.8204255655161]
We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE)
It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase.
Results show that the DAE achieves better results in both accuracy and speed of detection.
arXiv Detail & Related papers (2021-09-08T14:07:55Z) - Source-Agnostic Gravitational-Wave Detection with Recurrent Autoencoders [0.0]
We present an application of anomaly detection techniques based on deep recurrent autoencoders to the problem of detecting gravitational wave signals in laser interferometers.
Trained on noise data, this class of algorithms could detect signals using an unsupervised strategy, without targeting a specific kind of source.
arXiv Detail & Related papers (2021-07-27T09:56:49Z) - Canonical Polyadic Decomposition and Deep Learning for Machine Fault
Detection [0.0]
It is impossible to collect enough data to learn all types of faults from a machine.
New algorithms, trained using data from healthy conditions only, were developed to perform unsupervised anomaly detection.
A key issue in the development of these algorithms is the noise in the signals, as it impacts the anomaly detection performance.
arXiv Detail & Related papers (2021-07-20T14:06:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.