A Multimodal Text- and Graph-Based Approach for Open-Domain Event Extraction from Documents

• URL: http://arxiv.org/abs/2604.21885v1
• Date: Thu, 23 Apr 2026 17:33:44 GMT
• Title: A Multimodal Text- and Graph-Based Approach for Open-Domain Event Extraction from Documents
• Abstract summary: We present MODEE, a novel approach for open-domain event extraction.<n>It combines graph-based learning with text-based representation from LLMs to model document-level reasoning.<n> Empirical evaluations on large datasets demonstrate that MODEE outperforms state-of-the-art open-domain event extraction approaches.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Event extraction is essential for event understanding and analysis. It supports tasks such as document summarization and decision-making in emergency scenarios. However, existing event extraction approaches have limitations: (1) closed-domain algorithms are restricted to predefined event types and thus rarely generalize to unseen types and (2) open-domain event extraction algorithms, capable of handling unconstrained event types, have largely overlooked the potential of large language models (LLMs) despite their advanced abilities. Additionally, they do not explicitly model document-level contextual, structural, and semantic reasoning, which are crucial for effective event extraction but remain challenging for LLMs due to lost-in-the-middle phenomenon and attention dilution. To address these limitations, we propose multimodal open-domain event extraction, MODEE , a novel approach for open-domain event extraction that combines graph-based learning with text-based representation from LLMs to model document-level reasoning. Empirical evaluations on large datasets demonstrate that MODEE outperforms state-of-the-art open-domain event extraction approaches and can be generalized to closed-domain event extraction, where it outperforms existing algorithms.

Related papers

• A Multi-Domain and Multi-Task Generative Framework with Explicit Task and Domain Conditioning for Cross-Domain Event Extraction [4.169293754839175]
  Event extraction aims to identify event triggers, classify event types, and extract arguments to construct structured event representations.<n>We propose a unified multi-domain and multi-task training framework that models heterogeneous event schemas within a single model.
  arXiv  Detail & Related papers  (2026-08-24T13:24:24Z)
• EVENT5Ws: A Large Dataset for Open-Domain Event Extraction from Documents [0.15749416770494704]
  EVENT5Ws is a large, manually annotated, and statistically verified open-domain event extraction dataset.<n>We evaluate state-of-the-art pre-trained large language models and establish a benchmark for future research.
  arXiv  Detail & Related papers  (2026-04-23T17:42:07Z)
• Event Extraction in Large Language Model [99.94321497574805]
  We argue that EE should be viewed as a system component that provides a cognitive scaffold for LLM centered solutions.<n>This survey covers EE in text and multimodal settings, organizing tasks and taxonomy, tracing method evolution from rule based and neural models to instruction driven and generative frameworks.
  arXiv  Detail & Related papers  (2025-12-22T16:22:14Z)
• Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURA [49.10341970643037]
  Amodal segmentation aims to infer the complete shape of occluded objects, even when the occluded region's appearance is unavailable.<n>Current amodal segmentation methods lack the capability to interact with users through text input.<n>We propose a novel task named amodal reasoning segmentation, aiming to predict the complete amodal shape of occluded objects.
  arXiv  Detail & Related papers  (2025-03-13T10:08:18Z)
• Grounding Partially-Defined Events in Multimodal Data [61.0063273919745]
  We introduce a multimodal formulation for partially-defined events and cast the extraction of these events as a three-stage span retrieval task. We propose a benchmark for this task, MultiVENT-G, that consists of 14.5 hours of densely annotated current event videos and 1,168 text documents, containing 22.8K labeled event-centric entities. Results illustrate the challenges that abstract event understanding poses and demonstrates promise in event-centric video-language systems.
  arXiv  Detail & Related papers  (2024-10-07T17:59:48Z)
• Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction [19.51890490853855]
  We propose a multiple-event argument extraction model DEEIA. It is capable of extracting arguments from all events within a document simultaneously. Our method achieves new state-of-the-art performance on four public datasets.
  arXiv  Detail & Related papers  (2024-05-03T07:04:35Z)
• Token-Event-Role Structure-based Multi-Channel Document-Level Event Extraction [15.02043375212839]
  This paper introduces a novel framework for document-level event extraction, incorporating a new data structure called token-event-role. The proposed data structure enables our model to uncover the primary role of tokens in multiple events, facilitating a more comprehensive understanding of event relationships. The results demonstrate that our approach outperforms the state-of-the-art method by 9.5 percentage points in terms of the F1 score.
  arXiv  Detail & Related papers  (2023-06-30T15:22:57Z)
• Zero-Shot On-the-Fly Event Schema Induction [61.91468909200566]
  We present a new approach in which large language models are utilized to generate source documents that allow predicting, given a high-level event definition, the specific events, arguments, and relations between them. Using our model, complete schemas on any topic can be generated on-the-fly without any manual data collection, i.e., in a zero-shot manner.
  arXiv  Detail & Related papers  (2022-10-12T14:37:00Z)
• PILED: An Identify-and-Localize Framework for Few-Shot Event Detection [79.66042333016478]
  In our study, we employ cloze prompts to elicit event-related knowledge from pretrained language models. We minimize the number of type-specific parameters, enabling our model to quickly adapt to event detection tasks for new types.
  arXiv  Detail & Related papers  (2022-02-15T18:01:39Z)
• Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding [51.57864297948228]
  We propose a novel event extraction framework that takes event types and argument roles as natural language queries. Our framework benefits from the attention mechanisms to better capture the semantic correlation between the event types or argument roles and the input text.
  arXiv  Detail & Related papers  (2021-10-14T15:49:40Z)
• Document-level Event Extraction with Efficient End-to-end Learning of Cross-event Dependencies [37.96254956540803]
  We propose an end-to-end model leveraging Deep Value Networks (DVN), a structured prediction algorithm, to efficiently capture cross-event dependencies for document-level event extraction. Our approach achieves comparable performance to CRF-based models on ACE05, while enjoys significantly higher computational efficiency.
  arXiv  Detail & Related papers  (2020-10-24T05:28:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.