Hierarchical Multi-label Classification for Fine-level Event Extraction from Aviation Accident Reports
- URL: http://arxiv.org/abs/2403.17914v1
- Date: Tue, 26 Mar 2024 17:51:06 GMT
- Title: Hierarchical Multi-label Classification for Fine-level Event Extraction from Aviation Accident Reports
- Authors: Xinyu Zhao, Hao Yan, Yongming Liu,
- Abstract summary: This article argues that we can identify the events more accurately by leveraging the event taxonomy.
We achieve this hierarchical classification task by incorporating a novel hierarchical attention module into BERT.
It has been shown that fine-level prediction accuracy is highly improved, and the regularization term can be beneficial to the rare event identification problem.
- Score: 18.005377921658308
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: A large volume of accident reports is recorded in the aviation domain, which greatly values improving aviation safety. To better use those reports, we need to understand the most important events or impact factors according to the accident reports. However, the increasing number of accident reports requires large efforts from domain experts to label those reports. In order to make the labeling process more efficient, many researchers have started developing algorithms to identify the underlying events from accident reports automatically. This article argues that we can identify the events more accurately by leveraging the event taxonomy. More specifically, we consider the problem a hierarchical classification task where we first identify the coarse-level information and then predict the fine-level information. We achieve this hierarchical classification process by incorporating a novel hierarchical attention module into BERT. To further utilize the information from event taxonomy, we regularize the proposed model according to the relationship and distribution among labels. The effectiveness of our framework is evaluated with the data collected by National Transportation Safety Board (NTSB). It has been shown that fine-level prediction accuracy is highly improved, and the regularization term can be beneficial to the rare event identification problem.
Related papers
- The Accuracy Cost of Weakness: A Theoretical Analysis of Fixed-Segment Weak Labeling for Events in Time [11.312115846980602]
We model a common weak labeling process where annotators assign presence or absence labels to fixed-length data segments.
We compare this fixed-length labeling approach with an oracle method that uses the true event activations to construct the segments.
Our findings provide a theoretical justification for adaptive weak labeling strategies that mimic the oracle process.
arXiv Detail & Related papers (2025-02-13T14:31:49Z) - Natural Language Processing and Deep Learning Models to Classify Phase of Flight in Aviation Safety Occurrences [14.379311972506791]
Researchers applied natural language processing (NLP) and artificial intelligence (AI) models to process text narratives to classify the flight phases of safety occurrences.
The classification performance of two deep learning models, ResNet and sRNN was evaluated, using an initial dataset of 27,000 safety occurrence reports from the NTSB.
arXiv Detail & Related papers (2025-01-11T15:02:49Z) - Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses [76.59021017301127]
We propose a large-scale traffic crash language dataset, named CrashEvent, summarizing 19,340 real-world crash reports.
We further formulate the crash event feature learning as a novel text reasoning problem and further fine-tune various large language models (LLMs) to predict detailed accident outcomes.
Our experiments results show that our LLM-based approach not only predicts the severity of accidents but also classifies different types of accidents and predicts injury outcomes.
arXiv Detail & Related papers (2024-06-16T03:10:16Z) - Natural Language Processing of Aviation Occurrence Reports for Safety
Management [7.008490462870145]
This paper explores various Natural Language Processing (NLP) methods to support the analysis of aviation safety occurrence reports.
Under the right conditions the labeling of occurrence reports can be effectively automated with a transformer-based classifier.
arXiv Detail & Related papers (2023-01-13T17:00:09Z) - Cognitive Accident Prediction in Driving Scenes: A Multimodality
Benchmark [77.54411007883962]
We propose a Cognitive Accident Prediction (CAP) method that explicitly leverages human-inspired cognition of text description on the visual observation and the driver attention to facilitate model training.
CAP is formulated by an attentive text-to-vision shift fusion module, an attentive scene context transfer module, and the driver attention guided accident prediction module.
We construct a new large-scale benchmark consisting of 11,727 in-the-wild accident videos with over 2.19 million frames.
arXiv Detail & Related papers (2022-12-19T11:43:02Z) - An Ordinal Latent Variable Model of Conflict Intensity [59.49424978353101]
The Goldstein scale is a widely-used expert-based measure that scores events on a conflictual-cooperative scale.
This paper takes a latent variable-based approach to measuring conflict intensity.
arXiv Detail & Related papers (2022-10-08T08:59:17Z) - ERGO: Event Relational Graph Transformer for Document-level Event
Causality Identification [24.894074201193927]
Event-level Event Causality Identification (DECI) aims to identify causal relations between event pairs in a document.
We propose a novel Graph TransfOrmer (ERGO) framework for DECI.
arXiv Detail & Related papers (2022-04-15T12:12:16Z) - Event-Related Bias Removal for Real-time Disaster Events [67.2965372987723]
Social media has become an important tool to share information about crisis events such as natural disasters and mass attacks.
Detecting actionable posts that contain useful information requires rapid analysis of huge volume of data in real-time.
We train an adversarial neural model to remove latent event-specific biases and improve the performance on tweet importance classification.
arXiv Detail & Related papers (2020-11-02T02:03:07Z) - Predicting Themes within Complex Unstructured Texts: A Case Study on
Safeguarding Reports [66.39150945184683]
We focus on the problem of automatically identifying the main themes in a safeguarding report using supervised classification approaches.
Our results show the potential of deep learning models to simulate subject-expert behaviour even for complex tasks with limited labelled data.
arXiv Detail & Related papers (2020-10-27T19:48:23Z) - Structured Prediction with Partial Labelling through the Infimum Loss [85.4940853372503]
The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect.
This is a type of incomplete annotation where, for each datapoint, supervision is cast as a set of labels containing the real one.
This paper provides a unified framework based on structured prediction and on the concept of infimum loss to deal with partial labelling.
arXiv Detail & Related papers (2020-03-02T13:59:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.