Anomaly detection in radio galaxy data with trainable COSFIRE filters
- URL: http://arxiv.org/abs/2505.18643v1
- Date: Sat, 24 May 2025 11:08:41 GMT
- Title: Anomaly detection in radio galaxy data with trainable COSFIRE filters
- Authors: Steven Ndung'u, Trienko Grobler, Stefan J. Wijnholds, George Azzopardi,
- Abstract summary: This work introduces an innovative approach to anomaly detection based on morphological characteristics of the radio sources using trainable COSFIRE filters.<n>The framework integrates COSFIRE descriptors with an unsupervised Local Outlier Factor (LOF) algorithm to identify unusual radio galaxy morphologies.<n> Evaluations on a radio galaxy benchmark data set demonstrate strong performance, with the COSFIRE-based approach achieving a geometric mean (G-Mean) score of 79%.
- Score: 3.9073553035370203
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Detecting anomalies in radio astronomy is challenging due to the vast amounts of data and the rarity of labeled anomalous examples. Addressing this challenge requires efficient methods capable of identifying unusual radio galaxy morphologies without relying on extensive supervision. This work introduces an innovative approach to anomaly detection based on morphological characteristics of the radio sources using trainable COSFIRE (Combination of Shifted Filter Responses) filters as an efficient alternative to complex deep learning methods. The framework integrates COSFIRE descriptors with an unsupervised Local Outlier Factor (LOF) algorithm to identify unusual radio galaxy morphologies. Evaluations on a radio galaxy benchmark data set demonstrate strong performance, with the COSFIRE-based approach achieving a geometric mean (G-Mean) score of 79%, surpassing the 77% achieved by a computationally intensive deep learning autoencoder. By characterizing normal patterns and detecting deviations, this semi-supervised methodology overcomes the need for anomalous examples in the training set, a major limitation of traditional supervised methods. This approach shows promise for next-generation radio telescopes, where fast processing and the ability to discover unknown phenomena are crucial.
Related papers
- CLIP Meets Diffusion: A Synergistic Approach to Anomaly Detection [54.85000884785013]
Anomaly detection is a complex problem due to the ambiguity in defining anomalies, the diversity of anomaly types, and the scarcity of training data.<n>We propose CLIPfusion, a method that leverages both discriminative and generative foundation models.<n>We believe that our method underscores the effectiveness of multi-modal and multi-model fusion in tackling the multifaceted challenges of anomaly detection.
arXiv Detail & Related papers (2025-06-13T13:30:15Z) - RF Challenge: The Data-Driven Radio Frequency Signal Separation Challenge [66.33067693672696]
We address the critical problem of interference rejection in radio-frequency (RF) signals using a data-driven approach that leverages deep-learning methods.<n>A primary contribution of this paper is the introduction of the RF Challenge, which is a publicly available, diverse RF signal dataset.
arXiv Detail & Related papers (2024-09-13T13:53:41Z) - CKNN: Cleansed k-Nearest Neighbor for Unsupervised Video Anomaly Detection [40.09012921252129]
We propose a new method called Cleansed k-Nearest Neighbor (CKNN)
CKNN explicitly filters out the Anomaly Clusters by cleansing the training dataset.
We evaluate the proposed method on various benchmark datasets and demonstrate that CKNN outperforms the previous state-of-the-art UVAD method by up to 8.5%.
arXiv Detail & Related papers (2024-08-06T07:51:20Z) - Supervised Radio Frequency Interference Detection with SNNs [25.08630315149258]
Radio Frequency Interference (RFI) poses a significant challenge in radio astronomy, arising from terrestrial and celestial sources, disrupting observations conducted by radio telescopes.<n>Given the dynamic and temporal nature of radio astronomy observations, Spiking Neural Networks (SNNs) emerge as a promising approach.<n>We study the encoding of radio astronomy visibility data for SNN inference, considering six encoding schemes: rate, latency, delta-modulation, and three variations of the step-forward algorithm.
arXiv Detail & Related papers (2024-06-10T07:49:51Z) - Classification of Radio Galaxies with trainable COSFIRE filters [4.268504966623082]
We introduce an innovative approach for radio galaxy classification using COSFIRE filters.
These filters possess the ability to adapt to both the shape and orientation of prototype patterns within images.
We conducted experiments on a benchmark radio galaxy data set comprising of 1180 training samples and 404 test samples.
arXiv Detail & Related papers (2023-11-19T10:12:09Z) - Unraveling the "Anomaly" in Time Series Anomaly Detection: A
Self-supervised Tri-domain Solution [89.16750999704969]
Anomaly labels hinder traditional supervised models in time series anomaly detection.
Various SOTA deep learning techniques, such as self-supervised learning, have been introduced to tackle this issue.
We propose a novel self-supervised learning based Tri-domain Anomaly Detector (TriAD)
arXiv Detail & Related papers (2023-11-19T05:37:18Z) - The ROAD to discovery: machine learning-driven anomaly detection in
radio astronomy spectrograms [0.3425341633647625]
We propose a new machine learning anomaly detection framework for radio telescopes.
We present a dataset consisting of 7050 autocorrelation-based spectrograms from the Low Frequency Array (LOFAR) telescope.
We show that our system is real-time in the context of the LOFAR data processing pipeline, requiring 1ms to process a single spectrogram.
arXiv Detail & Related papers (2023-07-03T14:34:27Z) - Advances on the classification of radio image cubes [4.443085464476228]
Modern radio telescopes will daily generate data sets on the scale of exabytes for systems like the Square Kilometre Array (SKA)
Massive data sets are a source of unknown and rare astrophysical phenomena that lead to discoveries.
Recently, there has been a surge in scientific publications focusing on the use of artificial intelligence in radio astronomy.
arXiv Detail & Related papers (2023-05-05T11:15:37Z) - Self-Supervised Training with Autoencoders for Visual Anomaly Detection [61.62861063776813]
We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold.
We adapt a self-supervised learning regime that exploits discriminative information during training but focuses on the submanifold of normal examples.
We achieve a new state-of-the-art result on the MVTec AD dataset -- a challenging benchmark for visual anomaly detection in the manufacturing domain.
arXiv Detail & Related papers (2022-06-23T14:16:30Z) - Three-Way Deep Neural Network for Radio Frequency Map Generation and
Source Localization [67.93423427193055]
Monitoring wireless spectrum over spatial, temporal, and frequency domains will become a critical feature in beyond-5G and 6G communication technologies.
In this paper, we present a Generative Adversarial Network (GAN) machine learning model to interpolate irregularly distributed measurements across the spatial domain.
arXiv Detail & Related papers (2021-11-23T22:25:10Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - SUOD: Accelerating Large-Scale Unsupervised Heterogeneous Outlier
Detection [63.253850875265115]
Outlier detection (OD) is a key machine learning (ML) task for identifying abnormal objects from general samples.
We propose a modular acceleration system, called SUOD, to address it.
arXiv Detail & Related papers (2020-03-11T00:22:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.