Radial Autoencoders for Enhanced Anomaly Detection
- URL: http://arxiv.org/abs/2203.15884v2
- Date: Thu, 31 Mar 2022 08:29:14 GMT
- Title: Radial Autoencoders for Enhanced Anomaly Detection
- Authors: Mihai-Cezar Augustin, Vivien Bonvin, Regis Houssou, Efstratios Rappos
and Stephan Robert-Nicoud
- Abstract summary: In two-class classification tasks like anomaly or fraud detection, unsupervised methods could do even better.
An intuitive approach of anomaly detection can be based on the distances from the centers of mass of the two classes.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In classification problems, supervised machine-learning methods outperform
traditional algorithms, thanks to the ability of neural networks to learn
complex patterns. However, in two-class classification tasks like anomaly or
fraud detection, unsupervised methods could do even better, because their
prediction is not limited to previously learned types of anomalies. An
intuitive approach of anomaly detection can be based on the distances from the
centers of mass of the two respective classes. Autoencoders, although trained
without supervision, can also detect anomalies: considering the center of mass
of the normal points, reconstructions have now radii, with largest radii most
likely indicating anomalous points. Of course, radii-based classification were
already possible without interposing an autoencoder. In any space, radial
classification can be operated, to some extent. In order to outperform it, we
proceed to radial deformations of data (i.e. centric compression or expansions
of axes) and autoencoder training. Any autoencoder that makes use of a data
center is here baptized a centric autoencoder (cAE). A special type is the cAE
trained with a uniformly compressed dataset, named the centripetal autoencoder
(cpAE). The new concept is studied here in relation with a schematic artificial
dataset, and the derived methods show consistent score improvements. But tested
on real banking data, our radial deformation supervised algorithms alone still
perform better that cAEs, as expected from most supervised methods;
nonetheless, in hybrid approaches, cAEs can be combined with a radial
deformation of space, improving its classification score. We expect that
centric autoencoders will become irreplaceable objects in anomaly live
detection based on geometry, thanks to their ability to stem naturally on
geometrical algorithms and to their native capability of detecting unknown
anomaly types.
Related papers
- Remote sensing framework for geological mapping via stacked autoencoders and clustering [0.15833270109954137]
We present an unsupervised machine learning-based framework for processing remote sensing data.
We use Landsat 8, ASTER, and Sentinel-2 datasets to evaluate the framework for geological mapping of the Mutawintji region in Australia.
Our results reveal that the framework produces accurate and interpretable geological maps, efficiently discriminating rock units.
arXiv Detail & Related papers (2024-04-02T09:15:32Z) - Feature Selection using Sparse Adaptive Bottleneck Centroid-Encoder [1.2487990897680423]
We introduce a novel nonlinear model, Sparse Adaptive Bottleneckid-Encoder (SABCE), for determining the features that discriminate between two or more classes.
The algorithm is applied to various real-world data sets, including high-dimensional biological, image, speech, and accelerometer sensor data.
arXiv Detail & Related papers (2023-06-07T21:37:21Z) - AnoRand: A Semi Supervised Deep Learning Anomaly Detection Method by
Random Labeling [0.0]
Anomaly detection or more generally outliers detection is one of the most popular and challenging subject in theoretical and applied machine learning.
We present a new semi-supervised anomaly detection method called textbfAnoRand by combining a deep learning architecture with random synthetic label generation.
arXiv Detail & Related papers (2023-05-28T10:53:34Z) - Open-Set Automatic Target Recognition [52.27048031302509]
Automatic Target Recognition (ATR) is a category of computer vision algorithms which attempts to recognize targets on data obtained from different sensors.
Existing ATR algorithms are developed for traditional closed-set methods where training and testing have the same class distribution.
We propose an Open-set Automatic Target Recognition framework where we enable open-set recognition capability for ATR algorithms.
arXiv Detail & Related papers (2022-11-10T21:28:24Z) - Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology
Classification and Anomaly Detection [57.85347204640585]
We develop a Universal Domain Adaptation method DeepAstroUDA.
It can be applied to datasets with different types of class overlap.
For the first time, we demonstrate the successful use of domain adaptation on two very different observational datasets.
arXiv Detail & Related papers (2022-11-01T18:07:21Z) - Neurosymbolic hybrid approach to driver collision warning [64.02492460600905]
There are two main algorithmic approaches to autonomous driving systems.
Deep learning alone has achieved state-of-the-art results in many areas.
But sometimes it can be very difficult to debug if the deep learning model doesn't work.
arXiv Detail & Related papers (2022-03-28T20:29:50Z) - Latent Vector Expansion using Autoencoder for Anomaly Detection [1.370633147306388]
We use the features of the autoencoder to train latent vectors from low to high dimensionality.
We propose a latent vector expansion autoencoder model that improves classification performance at imbalanced data.
arXiv Detail & Related papers (2022-01-05T02:28:38Z) - High-dimensional separability for one- and few-shot learning [58.8599521537]
This work is driven by a practical question, corrections of Artificial Intelligence (AI) errors.
Special external devices, correctors, are developed. They should provide quick and non-iterative system fix without modification of a legacy AI system.
New multi-correctors of AI systems are presented and illustrated with examples of predicting errors and learning new classes of objects by a deep convolutional neural network.
arXiv Detail & Related papers (2021-06-28T14:58:14Z) - DASVDD: Deep Autoencoding Support Vector Data Descriptor for Anomaly
Detection [9.19194451963411]
Semi-supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data.
We propose a method, DASVDD, that jointly learns the parameters of an autoencoder while minimizing the volume of an enclosing hyper-sphere on its latent representation.
arXiv Detail & Related papers (2021-06-09T21:57:41Z) - TELESTO: A Graph Neural Network Model for Anomaly Classification in
Cloud Services [77.454688257702]
Machine learning (ML) and artificial intelligence (AI) are applied on IT system operation and maintenance.
One direction aims at the recognition of re-occurring anomaly types to enable remediation automation.
We propose a method that is invariant to dimensionality changes of given data.
arXiv Detail & Related papers (2021-02-25T14:24:49Z) - Dual Adversarial Auto-Encoders for Clustering [152.84443014554745]
We propose Dual Adversarial Auto-encoder (Dual-AAE) for unsupervised clustering.
By performing variational inference on the objective function of Dual-AAE, we derive a new reconstruction loss which can be optimized by training a pair of Auto-encoders.
Experiments on four benchmarks show that Dual-AAE achieves superior performance over state-of-the-art clustering methods.
arXiv Detail & Related papers (2020-08-23T13:16:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.