Comparative Analysis of Topic Modeling Techniques on ATSB Text Narratives Using Natural Language Processing

• URL: http://arxiv.org/abs/2501.01227v1
• Date: Thu, 02 Jan 2025 12:21:07 GMT
• Title: Comparative Analysis of Topic Modeling Techniques on ATSB Text Narratives Using Natural Language Processing
• Authors: Aziida Nanyonga, Hassan Wasswa, Ugur Turhan, Keith Joiner, Graham Wild,
• Abstract summary: This paper explores the application of four prominent topic modelling techniques, namely Probabilistic Latent Semantic Analysis (pLSA), Latent Semantic Analysis (LSA), Latent Dirichlet Allocation (LDA), and Non-negative Matrix Factorization (NMF) The study examines each technique's ability to unveil latent thematic structures within the data, providing safety professionals with a systematic approach to gain actionable insights.
• Score: 0.0
• License:
• Abstract: Improvements in aviation safety analysis call for innovative techniques to extract valuable insights from the abundance of textual data available in accident reports. This paper explores the application of four prominent topic modelling techniques, namely Probabilistic Latent Semantic Analysis (pLSA), Latent Semantic Analysis (LSA), Latent Dirichlet Allocation (LDA), and Non-negative Matrix Factorization (NMF), to dissect aviation incident narratives using the Australian Transport Safety Bureau (ATSB) dataset. The study examines each technique's ability to unveil latent thematic structures within the data, providing safety professionals with a systematic approach to gain actionable insights. Through a comparative analysis, this research not only showcases the potential of these methods in aviation safety but also elucidates their distinct advantages and limitations.

Related papers

• Computational Safety for Generative AI: A Signal Processing Perspective [65.268245109828]
  computational safety is a mathematical framework that enables the quantitative assessment, formulation, and study of safety challenges in GenAI. We show how sensitivity analysis and loss landscape analysis can be used to detect malicious prompts with jailbreak attempts. We discuss key open research challenges, opportunities, and the essential role of signal processing in computational AI safety.
  arXiv  Detail & Related papers  (2025-02-18T02:26:50Z)
• Exploring Aviation Incident Narratives Using Topic Modeling and Clustering Techniques [0.0]
  This study applies advanced natural language processing (NLP) techniques to the National Transportation Safety Board (NTSB) dataset. Main objectives are identifying latent themes, exploring semantic relationships, assessing probabilistic connections, and cluster incidents based on shared characteristics. Comparative analysis reveals that LDA performed best with a coherence value of 0.597, pLSA of 0.583, LSA of 0.542, and NMF of 0.437.
  arXiv  Detail & Related papers  (2025-01-14T08:23:15Z)
• Analyzing Aviation Safety Narratives with LDA, NMF and PLSA: A Case Study Using Socrata Datasets [0.0]
  This study explores the application of topic modelling techniques on the Socrata dataset spanning from 1908 to 2009. The analysis identified key themes such as pilot error, mechanical failure, weather conditions, and training deficiencies. Future directions include integrating additional contextual variables, leveraging neural topic models, and enhancing aviation safety protocols.
  arXiv  Detail & Related papers  (2025-01-03T08:14:39Z)
• Applications of natural language processing in aviation safety: A review and qualitative analysis [0.0]
  This study explores using Natural Language Processing in aviation safety. It focuses on machine learning algorithms to enhance safety measures. There are currently 34 Scopus results from the keyword search natural language processing and aviation safety.
  arXiv  Detail & Related papers  (2025-01-03T07:36:10Z)
• Topic Modeling Analysis of Aviation Accident Reports: A Comparative Study between LDA and NMF Models [0.0]
  This paper compares two prominent topic modeling techniques, Latent Dirichlet Allocation (LDA) and Non-negative Matrix Factorization (NMF) LDA demonstrates higher topic coherence, indicating stronger semantic relevance among words within topics. NMF excelled in producing distinct and granular topics, enabling a more focused analysis of specific aspects of aviation accidents.
  arXiv  Detail & Related papers  (2024-03-04T01:41:07Z)
• Enhancing Explainability in Mobility Data Science through a combination of methods [0.08192907805418582]
  This paper introduces a comprehensive framework that harmonizes pivotal XAI techniques. LIMEInterpretable Model-a-gnostic Explanations, SHAP, Saliency maps, attention mechanisms, direct trajectory visualization, and Permutation Feature (PFI) To validate our framework, we undertook a survey to gauge preferences and reception among various user demographics.
  arXiv  Detail & Related papers  (2023-12-01T07:09:21Z)
• A Study of Situational Reasoning for Traffic Understanding [63.45021731775964]
  We devise three novel text-based tasks for situational reasoning in the traffic domain. We adopt four knowledge-enhanced methods that have shown generalization capability across language reasoning tasks in prior work. We provide in-depth analyses of model performance on data partitions and examine model predictions categorically.
  arXiv  Detail & Related papers  (2023-06-05T01:01:12Z)
• Artificial Text Detection via Examining the Topology of Attention Maps [58.46367297712477]
  We propose three novel types of interpretable topological features for this task based on Topological Data Analysis (TDA) We empirically show that the features derived from the BERT model outperform count- and neural-based baselines up to 10% on three common datasets. The probing analysis of the features reveals their sensitivity to the surface and syntactic properties.
  arXiv  Detail & Related papers  (2021-09-10T12:13:45Z)
• SMT-Based Safety Verification of Data-Aware Processes under Ontologies (Extended Version) [71.12474112166767]
  We introduce a variant of one of the most investigated models in this spectrum, namely simple artifact systems (SASs) This DL, enjoying suitable model-theoretic properties, allows us to define SASs to which backward reachability can still be applied, leading to decidability in PSPACE of the corresponding safety problems.
  arXiv  Detail & Related papers  (2021-08-27T15:04:11Z)
• Counterfactual Explanations as Interventions in Latent Space [62.997667081978825]
  Counterfactual explanations aim to provide to end users a set of features that need to be changed in order to achieve a desired outcome. Current approaches rarely take into account the feasibility of actions needed to achieve the proposed explanations. We present Counterfactual Explanations as Interventions in Latent Space (CEILS), a methodology to generate counterfactual explanations.
  arXiv  Detail & Related papers  (2021-06-14T20:48:48Z)
• SAMBA: Safe Model-Based & Active Reinforcement Learning [59.01424351231993]
  SAMBA is a framework for safe reinforcement learning that combines aspects from probabilistic modelling, information theory, and statistics. We evaluate our algorithm on a variety of safe dynamical system benchmarks involving both low and high-dimensional state representations. We provide intuition as to the effectiveness of the framework by a detailed analysis of our active metrics and safety constraints.
  arXiv  Detail & Related papers  (2020-06-12T10:40:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.