DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles

• URL: http://arxiv.org/abs/2110.07827v1
• Date: Fri, 15 Oct 2021 02:50:09 GMT
• Title: DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articles
• Abstract summary: This paper introduces DirectQuote, a corpus containing 19,760 paragraphs and 10,279 direct quotations manually annotated from online news media. For the first time, we propose several sequence labeling models as baseline methods to extract and attribute quotations simultaneously in an end-to-end manner.
• Score: 6.006936459950188
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Quotation extraction and attribution are challenging tasks, aiming at determining the spans containing quotations and attributing each quotation to the original speaker. Applying this task to news data is highly related to fact-checking, media monitoring and news tracking. Direct quotations are more traceable and informative, and therefore of great significance among different types of quotations. Therefore, this paper introduces DirectQuote, a corpus containing 19,760 paragraphs and 10,279 direct quotations manually annotated from online news media. To the best of our knowledge, this is the largest and most complete corpus that focuses on direct quotations in news texts. We ensure that each speaker in the annotation can be linked to a specific named entity on Wikidata, benefiting various downstream tasks. In addition, for the first time, we propose several sequence labeling models as baseline methods to extract and attribute quotations simultaneously in an end-to-end manner.

Related papers

• CRISP: Characterizing Relative Impact of Scholarly Publications [70.25915589244961]
  We propose CRISP, which jointly ranks all cited papers within a citing paper using large language models (LLMs)<n>To mitigate LLMs' positional bias, we rank each list three times in a randomized order and aggregate the impact labels through majority voting.<n>CRISP outperforms a prior state-of-the-art impact classifier by +9.5% accuracy and +8.3% F1 on a dataset of human-annotated citations.
  arXiv  Detail & Related papers  (2026-03-25T16:42:30Z)
• What Makes an Ideal Quote? Recommending "Unexpected yet Rational" Quotations via Novelty [66.51974095399409]
  We formalize quote recommendation as choosing contextually novel but semantically coherent quotations.<n>A generative label agent first interprets each quotation and its surrounding context into multi-dimensional deep-meaning labels.<n>A token-level novelty estimator then reranks candidates while mitigating auto-regressive continuation bias.
  arXiv  Detail & Related papers  (2025-12-15T12:19:37Z)
• Rule-driven News Captioning [33.145889362997316]
  News captioning task aims to generate sentences by describing named entities or concrete events for an image with its news article. Existing methods have achieved remarkable results by relying on the large-scale pre-trained models. We propose the rule-driven news captioning method, which can generate image descriptions following designated rule signal.
  arXiv  Detail & Related papers  (2024-03-08T07:06:43Z)
• Quantifying the redundancy between prosody and text [67.07817268372743]
  We use large language models to estimate how much information is redundant between prosody and the words themselves. We find a high degree of redundancy between the information carried by the words and prosodic information across several prosodic features. Still, we observe that prosodic features can not be fully predicted from text, suggesting that prosody carries information above and beyond the words.
  arXiv  Detail & Related papers  (2023-11-28T21:15:24Z)
• FRACAS: A FRench Annotated Corpus of Attribution relations in newS [0.0]
  We present a manually annotated corpus of 1676 newswire texts in French for quotation extraction and source attribution. We first describe the composition of our corpus and the choices that were made in selecting the data. We then detail our inter-annotator agreement between the 8 annotators who worked on manual labelling.
  arXiv  Detail & Related papers  (2023-09-19T13:19:54Z)
• Towards Corpus-Scale Discovery of Selection Biases in News Coverage: Comparing What Sources Say About Entities as a Start [65.28355014154549]
  This paper investigates the challenges of building scalable NLP systems for discovering patterns of media selection biases directly from news content in massive-scale news corpora. We show the capabilities of the framework through a case study on NELA-2020, a corpus of 1.8M news articles in English from 519 news sources worldwide.
  arXiv  Detail & Related papers  (2023-04-06T23:36:45Z)
• Improving Keyphrase Extraction with Data Augmentation and Information Filtering [67.43025048639333]
  Keyphrase extraction is one of the essential tasks for document understanding in NLP. We present a novel corpus and method for keyphrase extraction from the videos streamed on the Behance platform.
  arXiv  Detail & Related papers  (2022-09-11T22:38:02Z)
• Monolingual alignment of word senses and definitions in lexicographical resources [0.0]
  The focus of this thesis is broadly on the alignment of lexicographical data, particularly dictionaries. The first task aims to find an optimal alignment given the sense definitions of a headword in two different monolingual dictionaries. This benchmark can be used for evaluation purposes of word-sense alignment systems.
  arXiv  Detail & Related papers  (2022-09-06T13:09:52Z)
• Quote Erat Demonstrandum: A Web Interface for Exploring the Quotebank Corpus [11.863216366085105]
  We present an adaptive web interface for searching Quotebank, a massive collection of quotes from the news. Quotes play a central role in the conception, reception, and analysis of news stories.
  arXiv  Detail & Related papers  (2022-07-07T21:41:03Z)
• Towards generating citation sentences for multiple references with intent control [86.53829532976303]
  We build a novel generation model with the Fusion-in-Decoder approach to cope with multiple long inputs. Experiments demonstrate that the proposed approaches provide much more comprehensive features for generating citation sentences.
  arXiv  Detail & Related papers  (2021-12-02T15:32:24Z)
• Context-Based Quotation Recommendation [60.93257124507105]
  We propose a novel context-aware quote recommendation system. It generates a ranked list of quotable paragraphs and spans of tokens from a given source document. We conduct experiments on a collection of speech transcripts and associated news articles.
  arXiv  Detail & Related papers  (2020-05-17T17:49:53Z)
• Diverse, Controllable, and Keyphrase-Aware: A Corpus and Method for News Multi-Headline Generation [98.98411895250774]
  We propose generating multiple headlines with keyphrases of user interests. The proposed method achieves state-of-the-art results in terms of quality and diversity.
  arXiv  Detail & Related papers  (2020-04-08T08:30:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.