Towards Simple Machine Learning Baselines for GNSS RFI Detection
- URL: http://arxiv.org/abs/2504.07993v2
- Date: Mon, 14 Apr 2025 06:59:33 GMT
- Title: Towards Simple Machine Learning Baselines for GNSS RFI Detection
- Authors: Viktor Ivanov, Richard C. Wilson, Maurizio Scaramuzza,
- Abstract summary: We show that state-of-the-art deep learning models frequently fail to outperform simple, well-engineered machine learning methods in the context of RFI detection.<n>We leverage a unique large-scale dataset collected by the Swiss Air Force and Swiss Air-Rescue.<n>We demonstrate that a simple baseline model achieves 91% accuracy in detecting RFI, outperforming more complex deep learning counterparts.
- Score: 2.470161703333703
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Machine learning research in GNSS radio frequency interference (RFI) detection often lacks a clear empirical justification for the choice of deep learning architectures over simpler machine learning approaches. In this work, we argue for a change in research direction-from developing ever more complex deep learning models to carefully assessing their real-world effectiveness in comparison to interpretable and lightweight machine learning baselines. Our findings reveal that state-of-the-art deep learning models frequently fail to outperform simple, well-engineered machine learning methods in the context of GNSS RFI detection. Leveraging a unique large-scale dataset collected by the Swiss Air Force and Swiss Air-Rescue (Rega), and preprocessed by Swiss Air Navigation Services Ltd. (Skyguide), we demonstrate that a simple baseline model achieves 91\% accuracy in detecting GNSS RFI, outperforming more complex deep learning counterparts. These results highlight the effectiveness of pragmatic solutions and offer valuable insights to guide future research in this critical application domain.
Related papers
- Advancing RFI-Detection in Radio Astronomy with Liquid State Machines [25.08630315149258]
Radio Frequency Interference (RFI) from anthropogenic radio sources poses significant challenges to current and future radio telescopes.
In this work, we apply Liquid State Machines (LSMs), a class of spiking networks, to RFI-detection.
We train LSMs on simulated data derived from the Hyrogen Epoch of Reionization Array (HERA), a known benchmark for RFI-detection.
Our model achieves a per-pixel accuracy of 98% and an F1-Integrate of 0.743, demonstrating competitive performance on this highly challenging task.
arXiv Detail & Related papers (2025-04-14T01:51:01Z) - What Really Matters for Learning-based LiDAR-Camera Calibration [50.2608502974106]
This paper revisits the development of learning-based LiDAR-Camera calibration.
We identify the critical limitations of regression-based methods with the widely used data generation pipeline.
We also investigate how the input data format and preprocessing operations impact network performance.
arXiv Detail & Related papers (2025-01-28T14:12:32Z) - Robust Neural Information Retrieval: An Adversarial and Out-of-distribution Perspective [111.58315434849047]
robustness of neural information retrieval models (IR) models has garnered significant attention.
We view the robustness of IR to be a multifaceted concept, emphasizing its necessity against adversarial attacks, out-of-distribution (OOD) scenarios and performance variance.
We provide an in-depth discussion of existing methods, datasets, and evaluation metrics, shedding light on challenges and future directions in the era of large language models.
arXiv Detail & Related papers (2024-07-09T16:07:01Z) - RFI Detection with Spiking Neural Networks [25.08630315149258]
This study introduces first exploratory application of Spiking Neural Networks (SNNs) to an astronomical dataprocessing task, specifically RFI detection.
We adapt the nearest-latentneighbours algorithm and auto-encoder architecture proposed by previous authors to SNN execution by direct ANN2SNN conversion.
Our approach remains competitive with existing methods in AUROC, AUPRC and F1 scores for the HERA dataset but exhibits difficulty in the LOFAR and Tabascal datasets.
arXiv Detail & Related papers (2023-11-24T06:27:08Z) - Learning-based NLOS Detection and Uncertainty Prediction of GNSS
Observations with Transformer-Enhanced LSTM Network [2.798138034569478]
This work proposes a deeplearning-based method to detect NLOS and predict errors by analyzing pseudo-temporal modeling problem.
We use datasets from Hong Kong and Aachen to train and evaluate the proposed network.
We show that the proposed method avoids trajectory divergence in real-world vehicle localization by classifying and excluding NLOS observations.
arXiv Detail & Related papers (2023-09-01T14:17:02Z) - Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue
with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems.
This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
arXiv Detail & Related papers (2023-08-14T16:48:57Z) - On-Device Domain Generalization [93.79736882489982]
Domain generalization is critical to on-device machine learning applications.
We find that knowledge distillation is a strong candidate for solving the problem.
We propose a simple idea called out-of-distribution knowledge distillation (OKD), which aims to teach the student how the teacher handles (synthetic) out-of-distribution data.
arXiv Detail & Related papers (2022-09-15T17:59:31Z) - Inducing Gaussian Process Networks [80.40892394020797]
We propose inducing Gaussian process networks (IGN), a simple framework for simultaneously learning the feature space as well as the inducing points.
The inducing points, in particular, are learned directly in the feature space, enabling a seamless representation of complex structured domains.
We report on experimental results for real-world data sets showing that IGNs provide significant advances over state-of-the-art methods.
arXiv Detail & Related papers (2022-04-21T05:27:09Z) - AirDet: Few-Shot Detection without Fine-tuning for Autonomous
Exploration [16.032316550612336]
We present AirDet, which is free of fine-tuning by learning class relation with support images.
AirDet achieves comparable or even better results than the exhaustively finetuned methods, reaching up to 40-60% improvements on the baseline.
We present evaluation results on real-world exploration tests from the DARPA Subterranean Challenge.
arXiv Detail & Related papers (2021-12-03T06:41:07Z) - Improving the sample-efficiency of neural architecture search with
reinforcement learning [0.0]
In this work, we would like to contribute to the area of Automated Machine Learning (AutoML)
Our focus is on one of the most promising research directions, reinforcement learning.
The validation accuracies of the child networks serve as a reward signal for training the controller.
We propose to modify this to a more modern and complex algorithm, PPO, which has demonstrated to be faster and more stable in other environments.
arXiv Detail & Related papers (2021-10-13T14:30:09Z) - ALT-MAS: A Data-Efficient Framework for Active Testing of Machine
Learning Algorithms [58.684954492439424]
We propose a novel framework to efficiently test a machine learning model using only a small amount of labeled test data.
The idea is to estimate the metrics of interest for a model-under-test using Bayesian neural network (BNN)
arXiv Detail & Related papers (2021-04-11T12:14:04Z) - A Comprehensive Survey of Machine Learning Applied to Radar Signal
Processing [7.758302353877527]
Modern radar systems have high requirements in terms of accuracy, robustness and real-time capability.
Traditional radar signal processing (RSP) methods have shown some limitations when meeting such requirements.
With the rapid development of machine learning (ML), especially deep learning, radar researchers have started integrating these new methods when solving RSP-related problems.
arXiv Detail & Related papers (2020-09-29T00:30:52Z) - AutoOD: Automated Outlier Detection via Curiosity-guided Search and
Self-imitation Learning [72.99415402575886]
Outlier detection is an important data mining task with numerous practical applications.
We propose AutoOD, an automated outlier detection framework, which aims to search for an optimal neural network model.
Experimental results on various real-world benchmark datasets demonstrate that the deep model identified by AutoOD achieves the best performance.
arXiv Detail & Related papers (2020-06-19T18:57:51Z) - Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and
On-Device Inference [49.88536971774444]
Inertial measurements units (IMUs) are small, cheap, energy efficient, and widely employed in smart devices and mobile robots.
Exploiting inertial data for accurate and reliable pedestrian navigation supports is a key component for emerging Internet-of-Things applications and services.
We present and release the Oxford Inertial Odometry dataset (OxIOD), a first-of-its-kind public dataset for deep learning based inertial navigation research.
arXiv Detail & Related papers (2020-01-13T04:41:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.