TalkTag: Fine-Grained Morphosyntactic Error Annotation for Transcribed Speech

• URL: http://arxiv.org/abs/2606.01820v1
• Date: Mon, 01 Jun 2026 07:34:24 GMT
• Title: TalkTag: Fine-Grained Morphosyntactic Error Annotation for Transcribed Speech
• Abstract summary: We present TalkTag, an LLM-based lightweight tool fine-tuned to automate CHAT-style error annotation in spoken-language transcripts.<n>Our evaluation demonstrates that TalkTag produces encouragingly precise annotation while effectively identifying instances where linguistic ambiguity makes automated tagging genuinely complex.
• Score: 3.9890189460506966
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fine-grained morphosyntactic error annotation is important in clinical and developmental language research, yet it is labour-intensive, expert-dependent, and difficult to scale. We present TalkTag, an LLM-based lightweight tool fine-tuned to automate CHAT-style error annotation in spoken-language transcripts. Developed under conditions of extreme data scarcity using children's narrative data, the system shows the feasibility of linguistic analysis in low-resource settings. Our evaluation demonstrates that TalkTag produces encouragingly precise annotation while effectively identifying instances where linguistic ambiguity makes automated tagging genuinely complex. In summary, with TalkTag, we provide a scalable alternative to manual error annotation and practically viable support for morphosyntactic error annotation.

Related papers

• Automated Quality Control for Language Documentation: Detecting Phonotactic Inconsistencies in a Kokborok Wordlist [0.0]
  Unsupervised anomaly detection methods are applied to a multilingual dataset of Kokborok varieties with Bangla.<n>Character-level and syllable-level phonotactic features are used to identify potential transcription errors and borrowings.<n>The high-recall approach provides fieldworkers with a systematic method to flag entries requiring verification.
  arXiv  Detail & Related papers  (2025-10-24T15:51:10Z)
• Synthetic Data Generation for Phrase Break Prediction with Large Language Model [5.483546934298434]
  Large language models (LLMs) have shown success in addressing data challenges in NLP.<n>We explore leveraging LLM to generate synthetic phrase break annotations.<n>Our findings suggest that LLM-based synthetic data generation effectively mitigates data challenges in phrase break prediction.
  arXiv  Detail & Related papers  (2025-07-24T02:45:03Z)
• Smooth Operators: LLMs Translating Imperfect Hints into Disfluency-Rich Transcripts [5.439020425819001]
  Large language models (LLMs) are versatile learners capable of processing both lexical and non-lexical inputs.<n>We propose a novel approach to disfluencies as explicit tokens with timestamps, enabling the generation of fully annotated disfluency-rich transcripts.
  arXiv  Detail & Related papers  (2025-06-23T11:04:20Z)
• Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translation [79.96416609433724]
  Zero-shot translation (ZST) aims to translate between unseen language pairs in training data. The common practice to guide the zero-shot language mapping during inference is to deliberately insert the source and target language IDs. Recent studies have shown that language IDs sometimes fail to navigate the ZST task, making them suffer from the off-target problem.
  arXiv  Detail & Related papers  (2023-09-28T17:02:36Z)
• Assessing the potential of LLM-assisted annotation for corpus-based pragmatics and discourse analysis: The case of apology [9.941695905504282]
  This study explores the possibility of using large language models (LLMs) to automate pragma-discursive corpus annotation.<n>We find that GPT-4 outperformed GPT-3.5, with accuracy approaching that of a human coder.
  arXiv  Detail & Related papers  (2023-05-15T04:10:13Z)
• Towards preserving word order importance through Forced Invalidation [80.33036864442182]
  We show that pre-trained language models are insensitive to word order. We propose Forced Invalidation to help preserve the importance of word order. Our experiments demonstrate that Forced Invalidation significantly improves the sensitivity of the models to word order.
  arXiv  Detail & Related papers  (2023-04-11T13:42:10Z)
• Annotation Curricula to Implicitly Train Non-Expert Annotators [56.67768938052715]
  voluntary studies often require annotators to familiarize themselves with the task, its annotation scheme, and the data domain. This can be overwhelming in the beginning, mentally taxing, and induce errors into the resulting annotations. We propose annotation curricula, a novel approach to implicitly train annotators.
  arXiv  Detail & Related papers  (2021-06-04T09:48:28Z)
• On the Robustness of Language Encoders against Grammatical Errors [66.05648604987479]
  We collect real grammatical errors from non-native speakers and conduct adversarial attacks to simulate these errors on clean text data. Results confirm that the performance of all tested models is affected but the degree of impact varies.
  arXiv  Detail & Related papers  (2020-05-12T11:01:44Z)
• Improving Training on Noisy Stuctured Labels [17.835042432662846]
  We propose a novel framework of Error-Correcting Networks (ECN) to address the challenge of learning in the presence structured error in fine-grained annotations. ECN substantially improves the prediction of fine-grained annotations compared to standard approaches for training on noisy data.
  arXiv  Detail & Related papers  (2020-03-08T22:55:11Z)
• On the Importance of Word Order Information in Cross-lingual Sequence Labeling [80.65425412067464]
  Cross-lingual models that fit into the word order of the source language might fail to handle target languages. We investigate whether making models insensitive to the word order of the source language can improve the adaptation performance in target languages.
  arXiv  Detail & Related papers  (2020-01-30T03:35:44Z)
• Towards Minimal Supervision BERT-based Grammar Error Correction [81.90356787324481]
  We try to incorporate contextual information from pre-trained language model to leverage annotation and benefit multilingual scenarios. Results show strong potential of Bidirectional Representations from Transformers (BERT) in grammatical error correction task.
  arXiv  Detail & Related papers  (2020-01-10T15:45:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.