Multi-Level Narrative Evaluation Outperforms Lexical Features for Mental Health

• URL: http://arxiv.org/abs/2604.27846v1
• Date: Thu, 30 Apr 2026 13:31:56 GMT
• Title: Multi-Level Narrative Evaluation Outperforms Lexical Features for Mental Health
• Abstract summary: Computational approaches to therapeutic writing have evolved from lexical counting to neural methods, yet remain fragmented.<n>No existing framework maps these techniques onto the hierarchical processes through which narratives are constructed.<n>This framework identifies macro-structural organization as the primary locus of clinical signal.
• Score: 23.379143894811566
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: How people narrate their experiences offers a window into how the mind organizes them. Computational approaches to therapeutic writing have evolved from lexical counting to neural methods, yet remain fragmented: dictionary tools miss discourse structure, while embeddings conflate local coherence with global organization. No existing framework maps these techniques onto the hierarchical processes through which narratives are constructed. Here we introduce a three-level framework - micro-level lexical features, meso-level semantic embeddings, and macro-level LLM narrative evaluation - and show, across 830 Chinese therapeutic texts spanning depression, anxiety, and trauma, that macro-level evaluation substantially outperforms lexical and embedding features for mental health prediction. This challenges the field's emphasis on word-counting: formal structural features (Labov's story grammar, RST coherence, propositional composition) demonstrate that narrative organization per se carries predictive signal, while clinically-grounded narrative dimensions capture how psychological states are expressed through discourse. Semantic embeddings add minimal independent value but yield incremental gains in multi-level classification. By grounding computational levels in discourse processing theory, this framework identifies macro-structural organization as the primary locus of clinical signal and generates testable hypotheses for intervention design and longitudinal research.

Related papers

• HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space [50.603248889968306]
  We propose a hyperbolic surgical video-language pre-training framework that explicitly preserves the hierarchical structure.<n>Experiments on multiple surgical benchmarks show consistent gains in zero- and few-shot phase recognition.
  arXiv  Detail & Related papers  (2026-06-30T07:21:06Z)
• Automated ICD Classification of Psychiatric Diagnoses: From Classical NLP to Large Language Models [67.51123543731806]
  Mental health has become a global priority, leading to a massive administrative burden in the coding of clinical diagnoses.<n>This study proposes the automation of psychiatric diagnostic analysis by mapping free-text descriptions to the International Classification of Diseases (ICD) using Natural Language Processing (NLP) and Machine Learning (ML) techniques.
  arXiv  Detail & Related papers  (2026-05-20T13:26:05Z)
• Measuring Psychological States Through Semantic Projection: A Theory-Driven Approach to Language-Based Assessment [0.0]
  The present study introduces a theory-driven and fully unsupervised framework for measuring psychological states directly from natural language using semantic projection.<n> Psychological constructs were operationalized as interpretable semantic axes derived from lexical anchors and items from validated clinical scales assessing depression, anxiety, and worry.<n>Results showed strong associations between projection scores and clinical measures, particularly for structured formats such as selected words, written words, and phrases.
  arXiv  Detail & Related papers  (2026-05-06T13:07:29Z)
• Towards a Linguistic Evaluation of Narratives: A Quantitative Stylistic Framework [51.56484100374058]
  This work proposes a quantitative approach to narrative assessment by focusing on the linguistic dimension as a primary indicator of quality.<n>The paper presents a methodology for the automatic evaluation of narrative based on the extraction of a comprehensive set of 33 quantitative linguistic features.
  arXiv  Detail & Related papers  (2026-04-21T09:21:40Z)
• Anonpsy: A Graph-Based Framework for Structure-Preserving De-identification of Psychiatric Narratives [1.4652274443334974]
  We introduce Anonpsy, a de-identification framework that reformulates the task as graph-guided semantic rewriting.<n>Anonpsy converts each narrative into a semantic graph encoding clinical entities, temporal anchors, and typed relations.<n>It preserves diagnostic fidelity while achieving consistently low re-identification risk under expert, semantic, and GPT-5-based evaluations.
  arXiv  Detail & Related papers  (2026-01-20T01:37:44Z)
• PsycholexTherapy: Simulating Reasoning in Psychotherapy with Small Language Models in Persian [2.166951056466717]
  PsychoLexTherapy is a framework for simulating psychotherapeutic reasoning in Persian using small language models (SLMs)<n>PsychoLexTherapy is optimized for on-device deployment, enabling use without external servers.
  arXiv  Detail & Related papers  (2025-10-04T19:40:10Z)
• CLI-RAG: A Retrieval-Augmented Framework for Clinically Structured and Context Aware Text Generation with LLMs [0.1578515540930834]
  We introduce CLI-RAG (Clinically Informed Retrieval-Augmented Generation), a domain-specific framework for structured and clinically grounded text generation.<n>It incorporates a novel hierarchical chunking strategy that respects clinical document structure and introduces a task-specific dual-stage retrieval mechanism.<n>We apply the system to generate structured progress notes for individual hospital visits using 15 clinical note types from the MIMIC-III dataset.
  arXiv  Detail & Related papers  (2025-07-09T10:13:38Z)
• Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives [83.15653194899126]
  Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management.<n>Current VSN-based NCD detection methods primarily focus on linguistic microstructures closely tied to bottom-up, stimulus-driven cognitive processes.<n>We propose two novel macrostructural approaches: a Dynamic Topic Model (DTM) to track topic evolution over time, and a Text-Image Temporal Alignment Network (TITAN) to measure cross-modal consistency between narrative and visual stimuli.
  arXiv  Detail & Related papers  (2025-01-07T12:16:26Z)
• Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries [56.31117605097345]
  Large language models (LLMs) have shown the potential to generate accurate clinical text summaries, but still struggle with issues regarding grounding and evaluation.<n>Here, we explore a general mitigation framework using Attribute Structuring (AS), which structures the summary evaluation process.<n>AS consistently improves the correspondence between human annotations and automated metrics in clinical text summarization.
  arXiv  Detail & Related papers  (2024-03-01T21:59:03Z)
• Hierarchical Annotation for Building A Suite of Clinical Natural Language Processing Tasks: Progress Note Understanding [4.5939673461957335]
  This work introduces a hierarchical annotation schema with three stages to address clinical text understanding, clinical reasoning, and summarization. We created an annotated corpus based on an extensive collection of publicly available daily progress notes. We also define a new suite of tasks, Progress Note Understanding, with three tasks utilizing the three annotation stages.
  arXiv  Detail & Related papers  (2022-04-06T18:38:08Z)
• Design considerations for a hierarchical semantic compositional framework for medical natural language understanding [3.7003326903946756]
  We describe a framework inspired by mechanisms of human cognition in an attempt to jump the NLP performance curve. The paper describes insights from four key aspects including semantic memory, semantic composition, semantic activation. We discuss the design of a generative semantic model and an associated semantic used to transform a free-text sentence into a logical representation of its meaning.
  arXiv  Detail & Related papers  (2022-04-05T09:04:34Z)
• Self-supervised Answer Retrieval on Clinical Notes [68.87777592015402]
  We introduce CAPR, a rule-based self-supervision objective for training Transformer language models for domain-specific passage matching. We apply our objective in four Transformer-based architectures: Contextual Document Vectors, Bi-, Poly- and Cross-encoders. We report that CAPR outperforms strong baselines in the retrieval of domain-specific passages and effectively generalizes across rule-based and human-labeled passages.
  arXiv  Detail & Related papers  (2021-08-02T10:42:52Z)
• Clinical Named Entity Recognition using Contextualized Token Representations [49.036805795072645]
  This paper introduces the technique of contextualized word embedding to better capture the semantic meaning of each word based on its context. We pre-train two deep contextualized language models, Clinical Embeddings from Language Model (C-ELMo) and Clinical Contextual String Embeddings (C-Flair) Explicit experiments show that our models gain dramatic improvements compared to both static word embeddings and domain-generic language models.
  arXiv  Detail & Related papers  (2021-06-23T18:12:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.