Chinese Discourse Annotation Reference Manual
- URL: http://arxiv.org/abs/2212.06037v1
- Date: Tue, 11 Oct 2022 11:02:42 GMT
- Title: Chinese Discourse Annotation Reference Manual
- Abstract summary: This document provides extensive guidelines and examples for Rhetorical Structure Theory (RST) annotation in Mandarin Chinese.
We first introduce preprocessing steps to prepare data for RST annotation.
Secondly, we discuss syntactic criteria to segment texts into Elementary Discourse Units (EDUs)
Finally, we provide examples to define and distinguish discourse relations in different genres.
- Score: 9.367612782346207
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This document provides extensive guidelines and examples for Rhetorical
Structure Theory (RST) annotation in Mandarin Chinese. The guideline is divided
into three sections. We first introduce preprocessing steps to prepare data for
RST annotation. Secondly, we discuss syntactic criteria to segment texts into
Elementary Discourse Units (EDUs). Lastly, we provide examples to define and
distinguish discourse relations in different genres. We hope that this
reference manual can facilitate RST annotations in Chinese and accelerate the
development of the RST framework across languages.
Related papers
- From Inline Notes to Collected Commentaries: Toward Context-Preserving Organization of Exegetical Knowledge in Classical Chinese Texts [10.770681421788085]
Inline notes and collected commentaries are important forms of scholarly communication that evolved within the Confucian exegetical tradition.<n>This paper formulates collected commentary compilation as an NLP task and proposes a computational framework.
arXiv Detail & Related papers (2026-07-31T05:49:27Z) - KOMBO: Korean Character Representations Based on the Combination Rules of Subcharacters [20.335880983366508]
The Korean writing system, textitHangeul, has a unique character representation rigidly following the invention principles recorded in textitHunminjeongeum.footnotetextitHunminjeongeum.<n>We introduce a novel framework for Korean pre-trained language models (PLMs) called KOMBO.<n>Our proposed method, KOMBO, exhibits notable experimental proficiency across diverse NLP tasks.
arXiv Detail & Related papers (2026-04-27T01:53:52Z) - Developing a Guideline for the Labovian-Structural Analysis of Oral Narratives in Japanese [11.653694258102275]
We introduce the first systematic guidelines for Labovian narrative analysis of Japanese data.<n>Our guidelines retain all six Labovian categories and extend the framework by providing explicit rules for clause segmentation tailored to Japanese constructions.<n>Using these guidelines, annotators achieved high agreement in clause segmentation and moderate agreement in two structural classification tasks.
arXiv Detail & Related papers (2026-03-31T07:19:04Z) - Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech [61.00008468914252]
We recast paragraph segmentation as the missing structuring step and fill three gaps at the intersection of speech processing and text segmentation.<n> benchmarks focus on the underexplored speech domain, where paragraph segmentation has traditionally not been part of post-processing.<n>Second, we propose a constrained-decoding formulation that lets large language models insert paragraph breaks while preserving the original transcript.<n>Third, we show that a compact model (MiniSeg) attains state-of-the-art accuracy and, when extended hierarchically, jointly predicts chapters and paragraphs with minimal computational cost.
arXiv Detail & Related papers (2025-12-30T23:29:51Z) - Beyond Chunking: Discourse-Aware Hierarchical Retrieval for Long Document Question Answering [51.7493726399073]
We present a discourse-aware hierarchical framework to enhance long document question answering.<n>The framework involves three key innovations: specialized discourse parsing for lengthy documents, LLM-based enhancement of discourse relation nodes, and structure-guided hierarchical retrieval.
arXiv Detail & Related papers (2025-05-26T14:45:12Z) - Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues [56.038123093599815]
Our objective is to translate continuous sign language into spoken language text.
We incorporate additional contextual cues together with the signing video.
We show that our contextual approach significantly enhances the quality of the translations.
arXiv Detail & Related papers (2025-01-16T18:59:03Z) - K-UD: Revising Korean Universal Dependencies Guidelines [6.292929354303524]
We aim to refine the definition of syntactic dependency of UDs within the context of analyzing the Korean language.
Our aim is not only to achieve a consensus within UDs but also to garner agreement beyond the UD framework for analyzing Korean sentences using dependency structure.
arXiv Detail & Related papers (2024-12-01T15:41:05Z) - Bilingual Rhetorical Structure Parsing with Large Parallel Annotations [5.439020425819001]
We introduce a parallel Russian annotation for the large and diverse English GUM RST corpus.
Our end-to-end RST achieves state-of-the-art results on both English and Russian corpora.
To the best of our knowledge, this work is the first to evaluate the potential of cross-lingual end-to-end RST parsing on a manually annotated parallel corpus.
arXiv Detail & Related papers (2024-09-23T12:40:33Z) - MaiBaam Annotation Guidelines [21.10847426724405]
This document provides the annotation guidelines for MaiBaam, a Bavarian corpus manually annotated with part-of-speech (POS) tags, syntactic dependencies, and German lemmas.
MaiBaam belongs to the Universal Dependencies (UD) project, and our annotations elaborate on the general and German UD version 2 guidelines.
arXiv Detail & Related papers (2024-03-09T12:46:53Z) - FRACAS: A FRench Annotated Corpus of Attribution relations in newS [0.0]
We present a manually annotated corpus of 1676 newswire texts in French for quotation extraction and source attribution.
We first describe the composition of our corpus and the choices that were made in selecting the data.
We then detail our inter-annotator agreement between the 8 annotators who worked on manual labelling.
arXiv Detail & Related papers (2023-09-19T13:19:54Z) - Is Argument Structure of Learner Chinese Understandable: A Corpus-Based
Analysis [8.883799596036484]
This paper presents a corpus-based analysis of argument structure errors in learner Chinese.
The data for analysis includes sentences produced by language learners as well as their corrections by native speakers.
We couple the data with semantic role labeling annotations that are manually created by two senior students.
arXiv Detail & Related papers (2023-08-17T21:10:04Z) - Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language
Modelling [70.23876429382969]
We propose a benchmark that can evaluate intra-sentence discourse properties across a diverse set of NLP tasks.
Disco-Bench consists of 9 document-level testsets in the literature domain, which contain rich discourse phenomena.
For linguistic analysis, we also design a diagnostic test suite that can examine whether the target models learn discourse knowledge.
arXiv Detail & Related papers (2023-07-16T15:18:25Z) - Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language
Pre-training [50.100992353488174]
We introduce CDBERT, a new learning paradigm that enhances the semantics understanding ability of the Chinese PLMs with dictionary knowledge and structure of Chinese characters.
We name the two core modules of CDBERT as Shuowen and Jiezi, where Shuowen refers to the process of retrieving the most appropriate meaning from Chinese dictionaries.
Our paradigm demonstrates consistent improvements on previous Chinese PLMs across all tasks.
arXiv Detail & Related papers (2023-05-30T05:48:36Z) - Discourse Analysis via Questions and Answers: Parsing Dependency
Structures of Questions Under Discussion [57.43781399856913]
This work adopts the linguistic framework of Questions Under Discussion (QUD) for discourse analysis.
We characterize relationships between sentences as free-form questions, in contrast to exhaustive fine-grained questions.
We develop the first-of-its-kind QUD that derives a dependency structure of questions over full documents.
arXiv Detail & Related papers (2022-10-12T03:53:12Z) - AUTOLEX: An Automatic Framework for Linguistic Exploration [93.89709486642666]
We propose an automatic framework that aims to ease linguists' discovery and extraction of concise descriptions of linguistic phenomena.
Specifically, we apply this framework to extract descriptions for three phenomena: morphological agreement, case marking, and word order.
We evaluate the descriptions with the help of language experts and propose a method for automated evaluation when human evaluation is infeasible.
arXiv Detail & Related papers (2022-03-25T20:37:30Z) - Discourse Analysis for Evaluating Coherence in Video Paragraph Captions [99.37090317971312]
We are exploring a novel discourse based framework to evaluate the coherence of video paragraphs.
Central to our approach is the discourse representation of videos, which helps in modeling coherence of paragraphs conditioned on coherence of videos.
Our experiment results have shown that the proposed framework evaluates coherence of video paragraphs significantly better than all the baseline methods.
arXiv Detail & Related papers (2022-01-17T04:23:08Z) - SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language
Model Pretraining [48.880840711568425]
We study the influences of three main factors on the Chinese tokenization for pretrained language models.
We propose three kinds of tokenizers: SHUOWEN (meaning Talk Word), the pronunciation-based tokenizers; 2) JIEZI (meaning Solve Character), the glyph-based tokenizers.
We find that SHUOWEN and JIEZI tokenizers can generally outperform conventional single-character tokenizers.
arXiv Detail & Related papers (2021-06-01T11:20:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.