Generalist Vision-Language Models for Fast Radio Burst detection: a zero-shot benchmark against a specialized detector
- URL: http://arxiv.org/abs/2607.07382v1
- Date: Wed, 08 Jul 2026 13:15:29 GMT
- Title: Generalist Vision-Language Models for Fast Radio Burst detection: a zero-shot benchmark against a specialized detector
- Abstract summary: We evaluate whether small, open-weight, locally run Vision-Language Models (VLMs) can detect Fast Radio Bursts (FRBs) in dynamic spectra under a zero-shot, prompt-only regime.<n>We show that Gemma 4 2B reaches an accuracy of 93.65%, with no statistically significant difference from SwinYNet.<n>Rewriting the prompt alone reconfigures the same models for three-class FRB/RFI/noise classification on the full set of 3000 spectra, where they reach up to 86% accuracy without a single false FRB.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Fast Radio Bursts (FRBs) are millisecond-duration radio transients whose automated detection increasingly relies on highly specialized deep learning models. These detectors achieve exceptional performance, but they require large task-specific training datasets and cannot be redefined without retraining. In this work, we evaluate whether small, open-weight, locally run generalist Vision-Language Models (VLMs) can detect FRBs in dynamic spectra under a zero-shot, prompt-only regime, with no fine-tuning and no labeled examples, returning structured decisions with a natural-language justification. From a controlled set of 3000 simulated L-band dynamic spectra containing FRBs, structured Radio Frequency Interference (RFI), and noise, we draw a balanced binary benchmark of 2000 samples and compare two such VLMs (Gemma 4 2B and 4B), sample by sample, against the state-of-the-art specialized detector SwinYNet. At the default threshold, Gemma 4 2B reaches an accuracy of 93.65%, with no statistically significant difference from SwinYNet (92.90%), while showing a significantly lower false-positive rate on structured RFI (6.4% vs. 25.0%) and no false positives on pure noise. SwinYNet retains a perfect probabilistic ranking on this benchmark (ROC-AUC of 1.0000 vs. 0.9482), a ceiling that the zero-shot VLM approaches from general-purpose pretraining alone. Rewriting the prompt alone reconfigures the same models for three-class FRB/RFI/noise classification on the full set of 3000 spectra, where they reach up to 86% accuracy without a single false FRB.
Related papers
- Domain-Specific Hallucination Detection in Large Language Models [0.0]
Large language models generate fluent text that can contain unfaithful claims.<n>We present a multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo (MC) Dropout uncertainty quantification.
arXiv Detail & Related papers (2026-09-10T17:45:36Z) - Comparing Self-Supervised and Domain-Invariant Features for Cross-Domain Voice Phishing Detection [5.314238974401925]
Domain-invariant prosodic features and self-supervised representations are compared.<n>HuBERT achieves highest performance (94.2% F1, 5-shot), while wav2vec2.0 exhibits a precision-oriented detection profile (90.2% F1 with 99.4% precision, 5-shot)<n>These findings reveal fundamental trade-offs: domain-invariant features enable zero-shot deployment when no real data exists, while SSL methods achieve higher performance but require real samples and compute.
arXiv Detail & Related papers (2026-09-07T06:06:45Z) - From Inaudible Inputs to Model Failures: Low-Frequency Safety Risks in LALMs [46.76277198630859]
Large audio-language models (LALMs) have demonstrated strong capabilities in understanding diverse audio inputs.<n>This diversity includes low-frequency signals that are inaudible to humans but can still enter the model and influence its generation.<n>We propose Intermittent Low-Frequency Lockout (ILL), an inaudible red teaming method that evaluates this risk using a universal waveform template in a black box setting.
arXiv Detail & Related papers (2026-08-10T06:09:50Z) - Sub-Billion, Super-Frontier: Small Language Models Rival Zero-Shot Frontier LLMs on General and Literary Relation Extraction [5.070542698701158]
Large language models (LLMs) achieve strong relation extraction (RE)<n>We investigate how far small language models (SLMs) can close this gap across general-domain and literary text.
arXiv Detail & Related papers (2026-06-21T17:24:31Z) - GuardNet: Ensemble Strategies of Shallow Neural Networks for Robust Prompt Injection and Jailbreak Detection [0.0]
Large Language Models (LLMs) have transformed natural language processing, but they remain vulnerable to attacks.<n>This work presents GuardNet, a guardrail system based on an ensemble of shallow neural networks (BiLSTMs)<n>The system operates with an average latency of approximately 50 ms on CPU, making it suitable for deployment in production environments.
arXiv Detail & Related papers (2026-06-04T01:24:15Z) - Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion [0.0]
CAFNet performs ternary classification (real, fully-fake, or half-truth) and regresses the temporal boundaries of the synthesised region in a single forward pass.<n>On binary detection, it achieves 96.76% accuracy and 3.20% Equal Error Rate (EER), outperforming fine-tuned XLS-R 300M (78.31%) and AST 87M (93.03%) at over 500 times fewer parameters.
arXiv Detail & Related papers (2026-05-28T07:47:22Z) - Evaluation of gNB Monostatic Sensing for UAV Use Case [14.424133779785636]
This paper evaluates 5G New Radio (NR) base station (gNB)-based monostatic sensing for the Unmanned Aerial Vehicle (UAV) use case.<n>We present an end-to-end processing chain for multi-target detection and 3D localization, achieving more than 70% detection probability with less than 5% false alarm rate.
arXiv Detail & Related papers (2026-04-02T15:57:58Z) - Retrieval-Augmented Few-Shot Prompting Versus Fine-Tuning for Code Vulnerability Detection [0.8737375836744933]
Few-shot prompting has emerged as a practical alternative to fine-tuning for leveraging the capabilities of large language models.<n>We examine retrieval-augmented prompting as a strategy to improve few-shot performance in code vulnerability detection.
arXiv Detail & Related papers (2025-11-28T12:19:31Z) - RF-DETR: Neural Architecture Search for Real-Time Detection Transformers [42.015879164246805]
We introduce RF-DETR, a light-weight specialist detection transformer.<n>Our approach fine-tunes a pre-trained base network on a target dataset.<n>We revisit the "tunable knobs" for NAS to improve the transferability of DETRs to diverse target domains.
arXiv Detail & Related papers (2025-11-12T18:58:39Z) - Signal and Noise: A Framework for Reducing Uncertainty in Language Model Evaluation [103.66549325018741]
We introduce two key metrics that show differences in current benchmarks.<n>We demonstrate that benchmarks with a better signal-to-noise ratio are more reliable when making decisions at small scale.<n>We conclude by recommending that those creating new benchmarks, or selecting which existing benchmarks to use, aim for high signal and low noise.
arXiv Detail & Related papers (2025-08-18T17:56:04Z) - ConQueR: Query Contrast Voxel-DETR for 3D Object Detection [47.51610366092525]
ConQueR achieves new state-of-the-art (sota) 71.6 mAPH/L2 on the challenging Open dataset validation set.
Our single-frame ConQueR achieves new state-of-the-art (sota) 71.6 mAPH/L2 on the challenging Open dataset validation set.
arXiv Detail & Related papers (2022-12-14T15:44:12Z) - Meta-Generating Deep Attentive Metric for Few-shot Classification [53.07108067253006]
We present a novel deep metric meta-generation method to generate a specific metric for a new few-shot learning task.
In this study, we structure the metric using a three-layer deep attentive network that is flexible enough to produce a discriminative metric for each task.
We gain surprisingly obvious performance improvement over state-of-the-art competitors, especially in the challenging cases.
arXiv Detail & Related papers (2020-12-03T02:07:43Z) - Neural Network Virtual Sensors for Fuel Injection Quantities with
Provable Performance Specifications [71.1911136637719]
We show how provable guarantees can be naturally applied to other real world settings.
We show how specific intervals of fuel injection quantities can be targeted to maximize robustness for certain ranges.
arXiv Detail & Related papers (2020-06-30T23:33:17Z) - Generalized Focal Loss: Learning Qualified and Distributed Bounding
Boxes for Dense Object Detection [85.53263670166304]
One-stage detector basically formulates object detection as dense classification and localization.
Recent trend for one-stage detectors is to introduce an individual prediction branch to estimate the quality of localization.
This paper delves into the representations of the above three fundamental elements: quality estimation, classification and localization.
arXiv Detail & Related papers (2020-06-08T07:24:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.