Combining Textual and Spectral Features for Robust Classification of Pilot Communications

• URL: http://arxiv.org/abs/2509.09752v1
• Date: Thu, 11 Sep 2025 16:43:10 GMT
• Title: Combining Textual and Spectral Features for Robust Classification of Pilot Communications
• Abstract summary: This paper presents a novel dual pipeline machine learning framework that classifies pilot radio communications using both textual and spectral features.<n>To our knowledge, this is the first system to classify operational aircraft intent using a dual-pipeline ML framework on real-world air traffic audio.
• Score: 2.9346090159291283
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate estimation of aircraft operations, such as takeoffs and landings, is critical for effective airport management, yet remains challenging, especially at non-towered facilities lacking dedicated surveillance infrastructure. This paper presents a novel dual pipeline machine learning framework that classifies pilot radio communications using both textual and spectral features. Audio data collected from a non-towered U.S. airport was annotated by certified pilots with operational intent labels and preprocessed through automatic speech recognition and Mel-spectrogram extraction. We evaluate a wide range of traditional classifiers and deep learning models, including ensemble methods, LSTM, and CNN across both pipelines. To our knowledge, this is the first system to classify operational aircraft intent using a dual-pipeline ML framework on real-world air traffic audio. Our results demonstrate that spectral features combined with deep architectures consistently yield superior classification performance, with F1-scores exceeding 91%. Data augmentation further improves robustness to real-world audio variability. The proposed approach is scalable, cost-effective, and deployable without additional infrastructure, offering a practical solution for air traffic monitoring at general aviation airports.

Related papers

• V2TATC: A Joint Voice-Trajectory Embedding Framework and Dataset for Air Traffic Controller Situational Awareness [39.21497179369917]
  Voice-to-Trajectory for Air Traffic Control (V2TATC) is a joint voice communication-flight trajectory data embedding framework.<n>V2TATC maps a voice instruction and the trajectory of the addressed aircraft to nearby points in a single latent space that can be queried in both directions.<n>We show that V2TATC's effectiveness on the San Francisco Bay Area, for its concentration of major airports, and its mix of commercial and general aviation low altitude traffic.
  arXiv  Detail & Related papers  (2026-08-29T01:22:52Z)
• DESCENT: Directed Edge Scene Encoding for Airport Surface Movement Prediction [54.94692733670454]
  DESCENT is a transformer-based architecture designed to handle heterogeneous dynamics and strict topological constraints.<n>Our approach features a Potential Reachable Set (PRS) context sampling mechanism that adaptively collects airfield environment context.<n>Our evaluations on the Amelia-10 benchmark demonstrate significant performance improvements over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-08-26T16:49:50Z)
• SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoring [8.082279149607116]
  Air Traffic Control (ATC) voice instructions are a primary safeguard against miscommunication in air transportation.<n>Readback anomalies remain implicated in approximately 80% of aviation incidents.<n>Traditional rule-based and machine learning approaches struggle to generalize across the highly variable and evolving phraseology of ATC communications.<n>We propose a novel lightweight-training LLM framework that advances both the efficiency and accuracy of machine-based ATC readback monitoring.
  arXiv  Detail & Related papers  (2026-05-28T07:56:24Z)
• Towards Automated Air Traffic Safety Assessment Around Non-Towered Airports Using Large Language Models [37.909132464953196]
  We investigate frameworks for post-flight safety analysis at non-towered airports using large language models (LLMs)<n>We propose a general vision-language model (VLM) approach to analyze the transcribed CTAF radio communications in natural language.<n>We qualitatively evaluate our framework on real flight data using Gemini 2.5 Pro, demonstrating accurate identification of a right-of-way violation.
  arXiv  Detail & Related papers  (2026-05-12T16:15:15Z)
• History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigation [64.51891404034164]
  Aerial Vision-and-Language Navigation (AVLN) requires Unmanned Aerial Vehicle (UAV) agents to localize targets in large-scale urban environments.<n>Existing UAV agents typically adopt mono-granularity frameworks that struggle to balance these two aspects.<n>This work proposes a History-Enhanced Two-Stage Transformer (HETT) framework, which integrates the two aspects through a coarse-to-fine navigation pipeline.
  arXiv  Detail & Related papers  (2025-12-16T09:16:07Z)
• AerialMind: Towards Referring Multi-Object Tracking in UAV Scenarios [64.51320327698231]
  We introduce AerialMind, the first large-scale RMOT benchmark in UAV scenarios.<n>We develop an innovative semi-automated collaborative agent-based labeling assistant framework.<n>We also propose HawkEyeTrack, a novel method that collaboratively enhances vision-language representation learning.
  arXiv  Detail & Related papers  (2025-11-26T04:44:27Z)
• AIRHILT: A Human-in-the-Loop Testbed for Multimodal Conflict Detection in Aviation [0.0]
  We introduce AIRHILT (Aviation Integrated Reasoning, Human-in-the-Loop Testbed)<n>A modular and lightweight simulation environment designed to evaluate multimodal pilot and air traffic control assistance systems for aviation conflict detection.<n>Built on the open-source Godot engine, AIRHILT synchronizes pilot and ATC radio communications, visual scene understanding from camera streams, and ADS-B surveillance data within a unified platform.
  arXiv  Detail & Related papers  (2025-11-24T03:18:55Z)
• Bayesian-Driven Graph Reasoning for Active Radio Map Construction [96.08082552413117]
  We propose an uncertainty-aware radio map reconstruction framework that explicitly leverages graph-based reasoning tailored for waypoint navigation.<n>Our approach integrates two key deep learning components: (1) a Bayesian neural network that estimates spatial uncertainty in real time, and (2) an attention-based reinforcement learning policy that performs global reasoning.<n> Experimental results show that URAM improves reconstruction accuracy by up to 34% over existing baselines.
  arXiv  Detail & Related papers  (2025-07-29T03:32:01Z)
• A Transformer-Based Conditional GAN with Multiple Instance Learning for UAV Signal Detection and Classification [17.586093539522327]
  This paper proposes a novel framework that integrates a Transformer-based Generative Adversarial Network (GAN) with Multiple Instance Locally Explainable Learning (MILET)<n> Experimental results show that the proposed method achieves superior accuracy 96.5% on the DroneDetect dataset and 98.6% on the DroneRF dataset.<n>The framework also demonstrates strong computational efficiency and robust generalization across diverse UAV platforms and flight states.
  arXiv  Detail & Related papers  (2025-07-19T12:35:45Z)
• Adapting Automatic Speech Recognition for Accented Air Traffic Control Communications [0.0]
  This study presents the development of ASR models fine-tuned specifically for Southeast Asian accents.<n>Our research achieves significant improvements, achieving a Word Error Rate (WER) of 0.0982 or 9.82% on SEA-accented ATC speech.<n>The findings emphasize the need for noise-robust training techniques and region-specific datasets to improve transcription accuracy for non-Western accents in ATC communications.
  arXiv  Detail & Related papers  (2025-02-27T17:35:59Z)
• Joint vs Sequential Speaker-Role Detection and Automatic Speech Recognition for Air-traffic Control [60.35553925189286]
  We propose a transformer-based joint ASR-SRD system that solves both tasks jointly while relying on a standard ASR architecture. We compare this joint system against two cascaded approaches for ASR and SRD on multiple ATC datasets.
  arXiv  Detail & Related papers  (2024-06-19T21:11:01Z)
• A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers [0.797970449705065]
  We propose a novel virtual simulation-pilot engine for speeding up air traffic controller (ATCo) training. The engine receives spoken communications from ATCo trainees, and it performs automatic speech recognition and understanding. To the best of our knowledge, this is the first work fully based on open-source ATC resources and AI tools.
  arXiv  Detail & Related papers  (2023-04-16T17:45:21Z)
• Robust Semi-supervised Federated Learning for Images Automatic Recognition in Internet of Drones [57.468730437381076]
  We present a Semi-supervised Federated Learning (SSFL) framework for privacy-preserving UAV image recognition. There are significant differences in the number, features, and distribution of local data collected by UAVs using different camera modules. We propose an aggregation rule based on the frequency of the client's participation in training, namely the FedFreq aggregation rule.
  arXiv  Detail & Related papers  (2022-01-03T16:49:33Z)
• Wireless-Enabled Asynchronous Federated Fourier Neural Network for Turbulence Prediction in Urban Air Mobility (UAM) [101.80862265018033]
  Urban air mobility (UAM) has been proposed in which vertical takeoff and landing (VTOL) aircraft are used to provide a ride-hailing service. In UAM, aircraft can operate in designated air spaces known as corridors, that link the aerodromes. A reliable communication network between GBSs and aircraft enables UAM to adequately utilize the airspace.
  arXiv  Detail & Related papers  (2021-12-26T14:41:52Z)
• Rethinking Drone-Based Search and Rescue with Aerial Person Detection [79.76669658740902]
  The visual inspection of aerial drone footage is an integral part of land search and rescue (SAR) operations today. We propose a novel deep learning algorithm to automate this aerial person detection (APD) task. We present the novel Aerial Inspection RetinaNet (AIR) algorithm as the combination of these contributions.
  arXiv  Detail & Related papers  (2021-11-17T21:48:31Z)
• BERTraffic: A Robust BERT-Based Approach for Speaker Change Detection and Role Identification of Air-Traffic Communications [2.270534915073284]
  Speech Activity Detection (SAD) or diarization system fails and then two or more single speaker segments are in the same recording. We developed a system that combines the segmentation of a SAD module with a BERT-based model that performs Speaker Change Detection (SCD) and Speaker Role Identification (SRI) based on ASR transcripts (i.e., diarization + SRI) The proposed model reaches up to 0.90/0.95 F1-score on ATCO/pilot for SRI on several test sets.
  arXiv  Detail & Related papers  (2021-10-12T07:25:12Z)
• A Simplified Framework for Air Route Clustering Based on ADS-B Data [0.0]
  This paper presents a framework that can support to detect the typical air routes between airports based on ADS-B data. As a matter of fact, our framework can be taken into account to reduce practically the computational cost for air flow optimization.
  arXiv  Detail & Related papers  (2021-07-07T08:55:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.