Harvesting Event Schemas from Large Language Models

• URL: http://arxiv.org/abs/2305.07280v1
• Date: Fri, 12 May 2023 06:51:05 GMT
• Title: Harvesting Event Schemas from Large Language Models
• Authors: Jialong Tang, Hongyu Lin, Zhuoqun Li, Yaojie Lu, Xianpei Han and Le Sun
• Abstract summary: Event schema provides a conceptual, structural and formal language to represent events and model the world event knowledge. It is challenging to automatically induce high-quality and high-coverage event schemas due to the open nature of real-world events, the diversity of event expressions, and the sparsity of event knowledge. We propose a new paradigm for event schema induction -- knowledge harvesting from large-scale pre-trained language models.
• Score: 38.56772862516626
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Event schema provides a conceptual, structural and formal language to represent events and model the world event knowledge. Unfortunately, it is challenging to automatically induce high-quality and high-coverage event schemas due to the open nature of real-world events, the diversity of event expressions, and the sparsity of event knowledge. In this paper, we propose a new paradigm for event schema induction -- knowledge harvesting from large-scale pre-trained language models, which can effectively resolve the above challenges by discovering, conceptualizing and structuralizing event schemas from PLMs. And an Event Schema Harvester (ESHer) is designed to automatically induce high-quality event schemas via in-context generation-based conceptualization, confidence-aware schema structuralization and graph-based schema aggregation. Empirical results show that ESHer can induce high-quality and high-coverage event schemas on varying domains.

Related papers

• Prompt-based Graph Model for Joint Liberal Event Extraction and Event Schema Induction [1.3154296174423619]
  Events are essential components of speech and texts, describing the changes in the state of entities. The event extraction task aims to identify and classify events and find their participants according to event schemas. The researchers propose Liberal Event Extraction (LEE), which aims to extract events and discover event schemas simultaneously.
  arXiv  Detail & Related papers  (2024-03-19T07:56:42Z)
• Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification [81.17473088621209]
  We treat event schemas as a form of commonsense knowledge that can be derived from large language models (LLMs) We design an incremental prompting and verification method to break down the construction of a complex event graph into three stages. Compared to directly using LLMs to generate a linearized graph, our method can generate large and complex schemas with 7.2% F1 improvement in temporal relations and 31.0% F1 improvement in hierarchical relations.
  arXiv  Detail & Related papers  (2023-07-05T01:00:44Z)
• Drafting Event Schemas using Language Models [48.81285141287434]
  We look at the process of creating such schemas to describe complex events. Our focus is on whether we can achieve sufficient diversity and recall of key events. We show that large language models are able to achieve moderate recall against schemas taken from two different datasets.
  arXiv  Detail & Related papers  (2023-05-24T07:57:04Z)
• SPEECH: Structured Prediction with Energy-Based Event-Centric Hyperspheres [60.79901400258962]
  Event-centric structured prediction involves predicting structured outputs of events. We propose Structured Prediction with Energy-based Event-Centric Hyperspheres (SPEECH)
  arXiv  Detail & Related papers  (2023-05-23T02:28:09Z)
• Zero-Shot On-the-Fly Event Schema Induction [61.91468909200566]
  We present a new approach in which large language models are utilized to generate source documents that allow predicting, given a high-level event definition, the specific events, arguments, and relations between them. Using our model, complete schemas on any topic can be generated on-the-fly without any manual data collection, i.e., in a zero-shot manner.
  arXiv  Detail & Related papers  (2022-10-12T14:37:00Z)
• Mining Logical Event Schemas From Pre-Trained Language Models [0.0]
  We present NESL (the Neuro-Episodic Learner), an event schema learning system that combines large language models, FrameNet parsing, and a set of simple behavioral schemas. We show that careful sampling from the language model can help emphasize stereotypical properties of situations and de-emphasize irrelevant details.
  arXiv  Detail & Related papers  (2022-04-12T16:41:18Z)
• Future is not One-dimensional: Graph Modeling based Complex Event Schema Induction for Event Prediction [90.75260063651763]
  We introduce the concept of Temporal Complex Event: a graph-based schema representation that encompasses events, arguments, temporal connections and argument relations. We release a new schema learning corpus containing 6,399 documents accompanied with event graphs, and manually constructed gold schemas.
  arXiv  Detail & Related papers  (2021-04-13T16:41:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.