Psychosis involves a deficit of information compression in connected speech
- URL: http://arxiv.org/abs/2609.15522v1
- Date: Mon, 14 Sep 2026 13:13:30 GMT
- Title: Psychosis involves a deficit of information compression in connected speech
- Abstract summary: Large language models (LLMs) with human-like performance on linguistic tasks have transformed the study of language in neurodiverse conditions.<n>Previous crosslinguistic evidence suggests a complexity reduction in the form of both lower intrinsic dimensionality (ID) of LLM representations and higher mean surprisal (prediction error) in psychosis.<n>We operationalized surprisal difference as the difference between surprisal as estimated from word frequency and surprisal as based on a contextual LM, which is sensitive to grammatical organization over and above lexical concepts.
- Score: 4.907371324386136
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Large language models (LLMs) with human-like performance on linguistic tasks have transformed the study of language in neurodiverse conditions. LLMs provide representations of linguistic input in the form of high-dimensional vectors (embeddings), and next-token predictions computed from these embeddings. Previous crosslinguistic evidence suggests a complexity reduction in the form of both lower intrinsic dimensionality (ID) of LLM representations and higher mean surprisal (prediction error) in psychosis. We hypothesized that these metrics reflect a general deficit of information compression in psychosis, linked to grammatical organization as what enables predictions in language.We operationalized surprisal difference as the difference between surprisal as estimated from word frequency and surprisal as based on a contextual LM, which is sensitive to grammatical organization over and above lexical concepts. Using a dataset of 144 Turkish speakers, including 106 patients with schizophrenia-spectrum disorders (SSD) - 56 with chronic schizophrenia (SZH), 33 with first-episode psychosis (FEP), and 17 with schizoaffective disorder (SZA) - and 38 healthy controls. We report: (1) Surprisal difference is attenuated in all clinical groups relative to controls, independently of word count; (2) Compressibility (intrinsic dimension) is reduced in SZH and FEP; (3) Syntactic complexity and compressibility both predict surprisal difference. These results, further refining an alteration in the geometry of the semantic space in psychosis as previously attested, suggest a broader deficit in information compression in this disorder, with a mechanistic underpinning in the operations of grammar.
Related papers
- Interpretable Symptom Vectors for Depression in a Large Language Model [1.3546242205182983]
We analyzed the residual stream of Gemma-3-27B-PT using mechanistic interpretability techniques.<n>Recording activations across symptom descriptions drawn from validated clinical instruments, we found that symptom groups geometrically separated the most.<n>Using Semantic Projection, we then projected held-out naturalistic text onto Symptom Vectors constructed from these instruments.
arXiv Detail & Related papers (2026-09-01T20:07:03Z) - Depression Markers in Speech: An Approach based on Tract Variables Dynamics [52.72895760734978]
This study identifies new depression biomarkers based on the dynamical properties of tract variables.<n>The proposed biomarkers effectively discriminate between the depressed and control speakers, as evidenced by the high Cliffs delta values across both read and spontaneous speech.
arXiv Detail & Related papers (2026-07-28T15:48:07Z) - Automated ICD Classification of Psychiatric Diagnoses: From Classical NLP to Large Language Models [67.51123543731806]
Mental health has become a global priority, leading to a massive administrative burden in the coding of clinical diagnoses.<n>This study proposes the automation of psychiatric diagnostic analysis by mapping free-text descriptions to the International Classification of Diseases (ICD) using Natural Language Processing (NLP) and Machine Learning (ML) techniques.
arXiv Detail & Related papers (2026-05-20T13:26:05Z) - The grip of grammar on meaning uncertainty: cross-linguistic evidence, neural correlates, and clinical relevance [11.630388936897218]
Isolated word meanings are inherently uncertain.<n>This uncertainty reduces when they are combined and anchored in context.<n>We propose that grammar compresses meaning uncertainty cross-linguistically, which is reflected in brain and selectively disrupted in disorders.
arXiv Detail & Related papers (2026-05-02T17:03:27Z) - Lyapunov Spectral Analysis of Speech Embedding Trajectories in Psychosis [63.56564189749175]
We analyze speech embeddings from structured clinical interviews of psychotic patients and healthy controls.<n>Lyapunov exponent (LE) spectra are computed from word-level and answer-level embeddings.
arXiv Detail & Related papers (2026-02-18T08:46:46Z) - DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection [54.209716321122194]
We present DepFlow, a depression-conditioned text-to-speech framework.<n>A Depression Acoustic Camouflage learns speaker- and content-invariant depression embeddings through adversarial training.<n>A flow-matching TTS model with FiLM modulation injects these embeddings into synthesis, enabling control over depressive severity.<n>A prototype-based severity mapping mechanism provides smooth and interpretable manipulation across the depression continuum.
arXiv Detail & Related papers (2026-01-01T10:44:38Z) - A Computational Approach to Analyzing Disrupted Language in Schizophrenia: Integrating Surprisal and Coherence Measures [3.9389809100079614]
Language disruptions are one of the well-known effects of schizophrenia symptoms.<n>This study focuses on how these language disruptions can be characterized in terms of two computational linguistic measures: surprisal and semantic coherence.
arXiv Detail & Related papers (2025-11-05T00:27:02Z) - Bigger But Not Better: Small Neural Language Models Outperform Large Language Models in Detection of Thought Disorder [7.585589727435719]
We investigate whether smaller neural language models can serve as effective alternatives for detecting positive formal thought disorder.<n>Surprisingly, our results show that smaller models are more sensitive to linguistic differences associated with formal thought disorder than their larger counterparts.
arXiv Detail & Related papers (2025-03-25T22:55:58Z) - Uncertainty Modeling in Multimodal Speech Analysis Across the Psychosis Spectrum [4.631774919831163]
Speech disruptions characteristic of psychosis appear across the spectrum, including in non-clinical individuals.<n>We develop an uncertainty-aware model integrating acoustic and linguistic features to predict symptom severity and psychosis-related traits.
arXiv Detail & Related papers (2025-02-25T15:19:21Z) - Information-Restricted Neural Language Models Reveal Different Brain
Regions' Sensitivity to Semantics, Syntax and Context [87.31930367845125]
We trained a lexical language model, Glove, and a supra-lexical language model, GPT-2, on a text corpus.
We then assessed to what extent these information-restricted models were able to predict the time-courses of fMRI signal of humans listening to naturalistic text.
Our analyses show that, while most brain regions involved in language are sensitive to both syntactic and semantic variables, the relative magnitudes of these effects vary a lot across these regions.
arXiv Detail & Related papers (2023-02-28T08:16:18Z) - On Hallucination and Predictive Uncertainty in Conditional Language
Generation [76.18783678114325]
Higher predictive uncertainty corresponds to a higher chance of hallucination.
Epistemic uncertainty is more indicative of hallucination than aleatoric or total uncertainties.
It helps to achieve better results of trading performance in standard metric for less hallucination with the proposed beam search variant.
arXiv Detail & Related papers (2021-03-28T00:32:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.