Anomaly Detection and RFI Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches

• URL: http://arxiv.org/abs/2411.16556v1
• Date: Mon, 25 Nov 2024 16:40:19 GMT
• Title: Anomaly Detection and RFI Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches
• Authors: Ben Jacobson-Bell, Steve Croft, Carmen Choza, Alex Andersson, Daniel Bautista, Vishal Gajjar, Matthew Lebofsky, David H. E. MacMahon, Caleb Painter, Andrew P. V. Siemion,
• Abstract summary: We present GLOBULAR clustering, a signal processing method that uses HDBSCAN to reduce the false-positive rate and isolate outlier signals. When combined with a standard narrowband signal detection and spatial filtering pipeline, GLOBULAR clustering offers significant improvements in the false-positive rate. We benchmark our method against the Choza et al. (2024) turboSETI-only search of 97 nearby galaxies at L-band, demonstrating a false-positive hit reduction rate of 93.1% and a false-positive event reduction rate of 99.3%.
• Score: 0.0
• License:
• Abstract: The search for radio technosignatures is an anomaly detection problem: candidate signals represent needles of interest in the proverbial haystack of radio-frequency interference (RFI). Current search frameworks find an enormity of false-positive signals, especially in large surveys, requiring manual follow-up to a sometimes prohibitive degree. Unsupervised learning provides an algorithmic way to winnow the most anomalous signals from the chaff, as well as group together RFI signals that bear morphological similarities. We present GLOBULAR (Grouping Low-frequency Observations By Unsupervised Learning After Reduction) clustering, a signal processing method that uses HDBSCAN to reduce the false-positive rate and isolate outlier signals for further analysis. When combined with a standard narrowband signal detection and spatial filtering pipeline, such as turboSETI, GLOBULAR clustering offers significant improvements in the false-positive rate over the standard pipeline alone, suggesting dramatic potential for the amelioration of manual follow-up requirements for future large surveys. By removing RFI signals in regions of high spectral occupancy, GLOBULAR clustering may also enable the detection of signals missed by the standard pipeline. We benchmark our method against the Choza et al. (2024) turboSETI-only search of 97 nearby galaxies at L-band, demonstrating a false-positive hit reduction rate of 93.1% and a false-positive event reduction rate of 99.3%.

Related papers

• RF Challenge: The Data-Driven Radio Frequency Signal Separation Challenge [66.33067693672696]
  This paper addresses the critical problem of interference rejection in radio-frequency (RF) signals using a novel, data-driven approach. First, we present an insightful signal model that serves as a foundation for developing and analyzing interference rejection algorithms. Second, we introduce the RF Challenge, a publicly available dataset featuring diverse RF signals along with code templates. Third, we propose novel AI-based rejection algorithms, specifically architectures like UNet and WaveNet, and evaluate their performance across eight different signal mixture types.
  arXiv  Detail & Related papers  (2024-09-13T13:53:41Z)
• BRSR-OpGAN: Blind Radar Signal Restoration using Operational Generative Adversarial Network [15.913517836391357]
  Real-world radar signals are often corrupted by a blend of artifacts, including but not limited to unwanted echo, sensor noise, intentional jamming, and interference. This study introduces Blind Radar Signal Restoration using an Operational Generative Adversarial Network (BRSR-OpGAN) This approach is designed to improve the quality of radar signals, regardless of the diversity and intensity of the corruption.
  arXiv  Detail & Related papers  (2024-07-18T23:55:48Z)
• Residual ANODE [0.0]
  We present R-ANODE, a new method for data-driven, model-agnostic resonant anomaly detection. The key to R-ANODE is to enhance the inductive bias of the anomaly detection task by fitting a normalizing flow directly to the small and unknown signal component. We show that the method works equally well whether the unknown signal fraction is learned or fixed, and is even robust to signal fraction misspecification.
  arXiv  Detail & Related papers  (2023-12-18T19:00:03Z)
• Disentangled Representation Learning for RF Fingerprint Extraction under Unknown Channel Statistics [77.13542705329328]
  We propose a framework of disentangled representation learning(DRL) that first learns to factor the input signals into a device-relevant component and a device-irrelevant component via adversarial learning. The implicit data augmentation in the proposed framework imposes a regularization on the RFF extractor to avoid the possible overfitting of device-irrelevant channel statistics. Experiments validate that the proposed approach, referred to as DR-RFF, outperforms conventional methods in terms of generalizability to unknown complicated propagation environments.
  arXiv  Detail & Related papers  (2022-08-04T15:46:48Z)
• Space-based gravitational wave signal detection and extraction with deep neural network [13.176946557548042]
  Space-based gravitational wave (GW) detectors will be able to observe signals from sources that are otherwise nearly impossible from current ground-based detection. Here, we develop a high-accuracy GW signal detection and extraction method for all space-based GW sources.
  arXiv  Detail & Related papers  (2022-07-15T11:48:15Z)
• Decision Forest Based EMG Signal Classification with Low Volume Dataset Augmented with Random Variance Gaussian Noise [51.76329821186873]
  We produce a model that can classify six different hand gestures with a limited number of samples that generalizes well to a wider audience. We appeal to a set of more elementary methods such as the use of random bounds on a signal, but desire to show the power these methods can carry in an online setting.
  arXiv  Detail & Related papers  (2022-06-29T23:22:18Z)
• Training Strategies for Deep Learning Gravitational-Wave Searches [43.55994393060723]
  We restrict our analysis to signals from non-spinning binary black holes. We systematically test different strategies by which training data is presented to the networks. We find that the deep learning algorithms can generalize low signal-to-noise ratio (SNR) signals to high SNR ones but not vice versa.
  arXiv  Detail & Related papers  (2021-06-07T16:04:29Z)
• Signal Processing and Machine Learning Techniques for Terahertz Sensing: An Overview [89.09270073549182]
  Terahertz (THz) signal generation and radiation methods are shaping the future of wireless systems. THz-specific signal processing techniques should complement this re-surged interest in THz sensing for efficient utilization of the THz band. We present an overview of these techniques, with an emphasis on signal pre-processing. We also address the effectiveness of deep learning techniques by exploring their promising sensing capabilities at the THz band.
  arXiv  Detail & Related papers  (2021-04-09T01:38:34Z)
• Discriminative Singular Spectrum Classifier with Applications on Bioacoustic Signal Recognition [67.4171845020675]
  We present a bioacoustic signal classifier equipped with a discriminative mechanism to extract useful features for analysis and classification efficiently. Unlike current bioacoustic recognition methods, which are task-oriented, the proposed model relies on transforming the input signals into vector subspaces. The validity of the proposed method is verified using three challenging bioacoustic datasets containing anuran, bee, and mosquito species.
  arXiv  Detail & Related papers  (2021-03-18T11:01:21Z)
• Detection of gravitational-wave signals from binary neutron star mergers using machine learning [52.77024349608834]
  We introduce a novel neural-network based machine learning algorithm that uses time series strain data from gravitational-wave detectors. We find an improvement by a factor of 6 in sensitivity to signals with signal-to-noise ratio below 25. A conservative estimate indicates that our algorithm introduces on average 10.2 s of latency between signal arrival and generating an alert.
  arXiv  Detail & Related papers  (2020-06-02T10:20:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.