ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots

• URL: http://arxiv.org/abs/2606.18319v2
• Date: Mon, 22 Jun 2026 12:15:05 GMT
• Title: ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots
• Abstract summary: ASTRA is an end-to-end training simulator that automates simpilot roles through a pipeline that transcribes ATCO speech, interprets instructions, and generates appropriate pilot and ATCO responses using locally adapted voice models.<n>ASTRA incorporates an AI-assisted performance evaluation framework that assesses trainee radiotelephony communications across accuracy, brevity, and completeness.
• Score: 0.30370026811994105
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Air Traffic Control Operators (ATCOs) are vital in ensuring the safe, orderly, and efficient flow of air traffic, yet training capacity is constrained by reliance on specialized human trainers known as simpilots, who must role-play both pilots and ATCOs in a simulated airspace. Existing automated solutions rely on Western-centric speech models that perform poorly in Singaporean operational contexts, with off-the-shelf systems exhibiting Word Error Rates (WER) of up to 107.80% on Singaporean-accented aviation speech. We introduce ASTRA, an end-to-end training simulator that automates these simpilot roles through a pipeline that transcribes ATCO speech, interprets instructions, and generates appropriate pilot and ATCO responses using locally adapted voice models. Our fine-tuned Automatic Speech Recognition (ASR) pipeline reduces WER to 23.45%, substantially outperforming existing approaches in this domain. Beyond traffic simulation, ASTRA incorporates an AI-assisted performance evaluation framework that assesses trainee radiotelephony communications across accuracy, brevity, and completeness, achieving post-optimization scores of 91.7%, 88.2%, and 86.9%, respectively. Built on open-source foundations such as DSPy and Unsloth, this approach enables scalable, standardized ATCO assessment while reducing instructor workload.

Related papers

• DESCENT: Directed Edge Scene Encoding for Airport Surface Movement Prediction [54.94692733670454]
  DESCENT is a transformer-based architecture designed to handle heterogeneous dynamics and strict topological constraints.<n>Our approach features a Potential Reachable Set (PRS) context sampling mechanism that adaptively collects airfield environment context.<n>Our evaluations on the Amelia-10 benchmark demonstrate significant performance improvements over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-08-26T16:49:50Z)
• Joint Air Traffic Flow and Capacity Management via Answer Set Programming [64.47906587579985]
  We introduce a joint ATFCM model with an encoding in Answer Set Programming (ASP)<n>Our results indicate that the ASP model outperforms the MIP model.<n>While DAC has the largest improvement on solving performance compared to rerouting, unrestricted variants of DAC or rerouting lead to search space thrashing.
  arXiv  Detail & Related papers  (2026-06-22T07:58:54Z)
• Adapting Automatic Speech Recognition for Accented Air Traffic Control Communications [0.0]
  This study presents the development of ASR models fine-tuned specifically for Southeast Asian accents.<n>Our research achieves significant improvements, achieving a Word Error Rate (WER) of 0.0982 or 9.82% on SEA-accented ATC speech.<n>The findings emphasize the need for noise-robust training techniques and region-specific datasets to improve transcription accuracy for non-Western accents in ATC communications.
  arXiv  Detail & Related papers  (2025-02-27T17:35:59Z)
• Autonomous Vehicle Controllers From End-to-End Differentiable Simulation [57.278726604424556]
  We propose a differentiable simulator and design an analytic policy gradients (APG) approach to training AV controllers.<n>Our proposed framework brings the differentiable simulator into an end-to-end training loop, where gradients of environment dynamics serve as a useful prior to help the agent learn a more grounded policy.<n>We find significant improvements in performance and robustness to noise in the dynamics, as well as overall more intuitive human-like handling.
  arXiv  Detail & Related papers  (2024-09-12T11:50:06Z)
• Joint vs Sequential Speaker-Role Detection and Automatic Speech Recognition for Air-traffic Control [60.35553925189286]
  We propose a transformer-based joint ASR-SRD system that solves both tasks jointly while relying on a standard ASR architecture. We compare this joint system against two cascaded approaches for ASR and SRD on multiple ATC datasets.
  arXiv  Detail & Related papers  (2024-06-19T21:11:01Z)
• A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers [0.797970449705065]
  We propose a novel virtual simulation-pilot engine for speeding up air traffic controller (ATCo) training. The engine receives spoken communications from ATCo trainees, and it performs automatic speech recognition and understanding. To the best of our knowledge, this is the first work fully based on open-source ATC resources and AI tools.
  arXiv  Detail & Related papers  (2023-04-16T17:45:21Z)
• Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula [48.58973705935691]
  We show that an agent trained using only a 10% subset of the data performs just as well as an agent trained on the entire dataset. We then demonstrate that this difficulty score can be used in a zero-shot transfer to generate curricula for an imitation-learning based planning agent.
  arXiv  Detail & Related papers  (2022-12-02T18:57:21Z)
• ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications [51.24043482906732]
  We introduce the ATCO2 corpus, a dataset that aims at fostering research on the challenging air traffic control (ATC) field. The ATCO2 corpus is split into three subsets. We expect the ATCO2 corpus will foster research on robust ASR and NLU.
  arXiv  Detail & Related papers  (2022-11-08T07:26:45Z)
• BERTraffic: A Robust BERT-Based Approach for Speaker Change Detection and Role Identification of Air-Traffic Communications [2.270534915073284]
  Speech Activity Detection (SAD) or diarization system fails and then two or more single speaker segments are in the same recording. We developed a system that combines the segmentation of a SAD module with a BERT-based model that performs Speaker Change Detection (SCD) and Speaker Role Identification (SRI) based on ASR transcripts (i.e., diarization + SRI) The proposed model reaches up to 0.90/0.95 F1-score on ATCO/pilot for SRI on several test sets.
  arXiv  Detail & Related papers  (2021-10-12T07:25:12Z)
• Grammar Based Identification Of Speaker Role For Improving ATCO And Pilot ASR [1.1391158217994781]
  Assistant Based Speech Recognition (ABSR) for air traffic control is generally trained by pooling both Air Traffic Controller (ATCO) and pilot data. Due to data imbalance of ATCO and pilot and varying acoustic conditions, the ASR performance is usually significantly better for ATCOs than pilots.
  arXiv  Detail & Related papers  (2021-08-27T08:40:08Z)
• The USYD-JD Speech Translation System for IWSLT 2021 [85.64797317290349]
  This paper describes the University of Sydney& JD's joint submission of the IWSLT 2021 low resource speech translation task. We trained our models with the officially provided ASR and MT datasets. To achieve better translation performance, we explored the most recent effective strategies, including back translation, knowledge distillation, multi-feature reranking and transductive finetuning.
  arXiv  Detail & Related papers  (2021-07-24T09:53:34Z)
• Automatic Speech Recognition Benchmark for Air-Traffic Communications [1.175956452196938]
  CleanSky EC-H2020 ATCO2 aims to develop an ASR-based platform to collect, organize and automatically pre-process ATCo speech-data from air space. Cross-accent flaws due to speakers' accents are minimized due to the amount of data, making the system feasible for ATC environments.
  arXiv  Detail & Related papers  (2020-06-18T06:49:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.