Chinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble

• URL: http://arxiv.org/abs/2604.14167v1
• Date: Tue, 24 Mar 2026 07:58:05 GMT
• Title: Chinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble
• Abstract summary: Rhetoric recognition is a critical component in automated essay scoring.<n>We leverage Large Language Models (LLMs) for the Chinese rhetoric recognition task.<n>Our method achieves the best performance on all three tracks of CCL 2025 Chinese essay rhetoric recognition evaluation task.
• Score: 5.633877879389439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Rhetoric recognition is a critical component in automated essay scoring. By identifying rhetorical elements in student writing, AI systems can better assess linguistic and higher-order thinking skills, making it an essential task in the area of AI for education. In this paper, we leverage Large Language Models (LLMs) for the Chinese rhetoric recognition task. Specifically, we explore Low-Rank Adaptation (LoRA) based fine-tuning and in-context learning to integrate rhetoric knowledge into LLMs. We formulate the outputs as JSON to obtain structural outputs and translate keys to Chinese. To further enhance the performance, we also investigate several model ensemble methods. Our method achieves the best performance on all three tracks of CCL 2025 Chinese essay rhetoric recognition evaluation task, winning the first prize.

Related papers

• Aesthetic Assessment of Chinese Handwritings Based on Vision Language Models [14.72561407532963]
  We leverage vision-language models (VLMs) to analyze the quality of handwritten Chinese characters and generate multi-level feedback.<n>We explore both low-rank adaptation (LoRA)-based fine-tuning strategies and in-context learning methods to integrate aesthetic assessment knowledge into VLMs.
  arXiv  Detail & Related papers  (2026-03-24T07:57:26Z)
• Detecting AI-Generated Essays in Writing Assessment: Responsible Use and Generalizability Across LLMs [0.0]
  Writing assessment plays a vital role in evaluating language proficiency, communicative effectiveness, and analytical reasoning.<n>The rapid advancement of large language models (LLMs) has made it increasingly easy to generate coherent, high-quality essays.<n>This chapter first provides an overview of the current landscape of detectors for AI-generated and AI-assisted essays, along with guidelines for their responsible use.
  arXiv  Detail & Related papers  (2026-03-02T19:51:01Z)
• SpeechIQ: Speech Intelligence Quotient Across Cognitive Levels in Voice Understanding Large Language Models [76.07833875692722]
  Speech-based Intelligence Quotient (SIQ) is a new form of human cognition-inspired evaluation pipeline for voice understanding large language models.<n>Our framework represents a first-of-its-kind intelligence examination that bridges cognitive principles with voice-oriented benchmarks.
  arXiv  Detail & Related papers  (2025-07-25T15:12:06Z)
• EssayBench: Evaluating Large Language Models in Multi-Genre Chinese Essay Writing [47.704427451419456]
  benchName is a multi-genre benchmark specifically designed for Chinese essay writing across four major genres: Argumentative, Narrative, Descriptive, and Expository.<n>We develop a fine-grained, genre-specific scoring framework that hierarchically aggregates scores.<n>We benchmark 15 large-sized LLMs, analyzing their strengths and limitations across genres and instruction types.
  arXiv  Detail & Related papers  (2025-06-03T08:14:46Z)
• Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs [50.0874045899661]
  We introduce CharacterBot, a model designed to replicate both the linguistic patterns and distinctive thought patterns as manifested in the textual works of a character.<n>Using Lu Xun, a renowned Chinese writer as a case study, we propose four training tasks derived from his 17 essay collections.<n>These include a pre-training task focused on mastering external linguistic structures and knowledge, as well as three fine-tuning tasks.<n>We evaluate CharacterBot on three tasks for linguistic accuracy and opinion comprehension, demonstrating that it significantly outperforms the baselines on our adapted metrics.
  arXiv  Detail & Related papers  (2025-02-18T16:11:54Z)
• Prompting ChatGPT for Chinese Learning as L2: A CEFR and EBCL Level Study [0.45060992929802196]
  This study explores how learners can use specific prompts to engage Large Language Models (LLM) as personalized chatbots.<n>Our goal is to develop prompts that integrate oral and written skills, using high-frequency character lists and controlling oral lexical productions.<n>The results indicate that incorporating level A1 and A1+ characters, along with the associated reference list, significantly enhances compliance with the EBCL character set.
  arXiv  Detail & Related papers  (2025-01-25T15:30:13Z)
• Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks [68.33068005789116]
  We introduce ReDial, a benchmark containing 1.2K+ parallel query pairs in Standardized English and AAVE.<n>We evaluate widely used models, including GPT, Claude, Llama, Mistral, and the Phi model families.<n>Our work establishes a systematic and objective framework for analyzing LLM bias in dialectal queries.
  arXiv  Detail & Related papers  (2024-10-14T18:44:23Z)
• Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attribution [48.86322922826514]
  This paper defines a new task of Knowledge-aware Language Model Attribution (KaLMA) First, we extend attribution source from unstructured texts to Knowledge Graph (KG), whose rich structures benefit both the attribution performance and working scenarios. Second, we propose a new Conscious Incompetence" setting considering the incomplete knowledge repository. Third, we propose a comprehensive automatic evaluation metric encompassing text quality, citation quality, and text citation alignment.
  arXiv  Detail & Related papers  (2023-10-09T11:45:59Z)
• Disco-Bench: A Discourse-Aware Evaluation Benchmark for Language Modelling [70.23876429382969]
  We propose a benchmark that can evaluate intra-sentence discourse properties across a diverse set of NLP tasks. Disco-Bench consists of 9 document-level testsets in the literature domain, which contain rich discourse phenomena. For linguistic analysis, we also design a diagnostic test suite that can examine whether the target models learn discourse knowledge.
  arXiv  Detail & Related papers  (2023-07-16T15:18:25Z)
• Zero-shot Cross-lingual Conversational Semantic Role Labeling [30.28068025468505]
  We present an effective approach to perform zero-shot cross-lingual CSRL. Our model implicitly learns language-agnostic, conversational structure-aware and semantically rich representations with the hierarchical encoders. We confirm the usefulness of CSRL to non-Chinese conversational tasks such as the question-in-context rewriting task in English and the multi-turn dialogue response generation tasks in English, German and Japanese.
  arXiv  Detail & Related papers  (2022-04-11T07:29:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.