Automated speech- and text-based classification of neuropsychiatric
conditions in a multidiagnostic setting
- URL: http://arxiv.org/abs/2301.06916v1
- Date: Fri, 13 Jan 2023 08:24:21 GMT
- Title: Automated speech- and text-based classification of neuropsychiatric
conditions in a multidiagnostic setting
- Authors: Lasse Hansen, Roberta Rocca, Arndis Simonsen, Alberto Parola, Vibeke
Bliksted, Nicolai Ladegaard, Dan Bang, Kristian Tyl\'en, Ethan Weed, S{\o}ren
Dinesen {\O}stergaard, Riccardo Fusaroli
- Abstract summary: Speech patterns have been identified as potential diagnostic markers for neuropsychiatric conditions.
We tested the performance of a range of machine learning models and advanced Transformer models on both binary and multiclass classification.
Our results indicate that models trained on binary classification may learn to rely on markers of generic differences between clinical and non-clinical populations.
- Score: 2.0972270756982536
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Speech patterns have been identified as potential diagnostic markers for
neuropsychiatric conditions. However, most studies only compare a single
clinical group to healthy controls, whereas clinical practice often requires
differentiating between multiple potential diagnoses (multiclass settings). To
address this, we assembled a dataset of repeated recordings from 420
participants (67 with major depressive disorder, 106 with schizophrenia and 46
with autism, as well as matched controls), and tested the performance of a
range of conventional machine learning models and advanced Transformer models
on both binary and multiclass classification, based on voice and text features.
While binary models performed comparably to previous research (F1 scores
between 0.54-0.75 for autism spectrum disorder, ASD; 0.67-0.92 for major
depressive disorder, MDD; and 0.71-0.83 for schizophrenia); when
differentiating between multiple diagnostic groups performance decreased
markedly (F1 scores between 0.35-0.44 for ASD, 0.57-0.75 for MDD, 0.15-0.66 for
schizophrenia, and 0.38-0.52 macro F1). Combining voice and text-based models
yielded increased performance, suggesting that they capture complementary
diagnostic information.
Our results indicate that models trained on binary classification may learn
to rely on markers of generic differences between clinical and non-clinical
populations, or markers of clinical features that overlap across conditions,
rather than identifying markers specific to individual conditions. We provide
recommendations for future research in the field, suggesting increased focus on
developing larger transdiagnostic datasets that include more fine-grained
clinical features, and that can support the development of models that better
capture the complexity of neuropsychiatric conditions and naturalistic
diagnostic assessment.
Related papers
- Still Not Quite There! Evaluating Large Language Models for Comorbid Mental Health Diagnosis [9.738105623317601]
We introduce AN GST, a novel, first-of-its kind benchmark for depression-anxiety comorbidity classification from social media posts.
We benchmark AN GST using various state-of-the-art language models, ranging from Mental-BERT to GPT-4.
While GPT-4 generally outperforms other models, none achieve an F1 score exceeding 72% in multi-class comorbid classification.
arXiv Detail & Related papers (2024-10-04T20:24:11Z) - Improving Multiple Sclerosis Lesion Segmentation Across Clinical Sites:
A Federated Learning Approach with Noise-Resilient Training [75.40980802817349]
Deep learning models have shown promise for automatically segmenting MS lesions, but the scarcity of accurately annotated data hinders progress in this area.
We introduce a Decoupled Hard Label Correction (DHLC) strategy that considers the imbalanced distribution and fuzzy boundaries of MS lesions.
We also introduce a Centrally Enhanced Label Correction (CELC) strategy, which leverages the aggregated central model as a correction teacher for all sites.
arXiv Detail & Related papers (2023-08-31T00:36:10Z) - A Transformer-based representation-learning model with unified
processing of multimodal input for clinical diagnostics [63.106382317917344]
We report a Transformer-based representation-learning model as a clinical diagnostic aid that processes multimodal input in a unified manner.
The unified model outperformed an image-only model and non-unified multimodal diagnosis models in the identification of pulmonary diseases.
arXiv Detail & Related papers (2023-06-01T16:23:47Z) - Transformer-based normative modelling for anomaly detection of early
schizophrenia [1.291405125557051]
We trained our model on 3D MRI scans of neurotypical individuals.
We obtained the likelihood of neurotypical controls and psychiatric patients with early-stage schizophrenia.
arXiv Detail & Related papers (2022-12-08T18:22:36Z) - Diagnosis of Schizophrenia: A comprehensive evaluation [1.174402845822043]
We evaluated different classification algorithms based on support vector machine (SVM), random forest, kernel ridge regression and randomized neural networks.
Based on the evaluation, SVM based models with Gaussian kernel proved better compared to other classification models.
In terms of data modality the performance on integration of the grey matter and white matter proved better compared to the performance on the grey and white matter individually.
arXiv Detail & Related papers (2022-03-22T10:55:51Z) - Multi-class versus One-class classifier in spontaneous speech analysis
oriented to Alzheimer Disease diagnosis [58.720142291102135]
The aim of our project is to contribute to earlier diagnosis of AD and better estimates of its severity by using automatic analysis performed through new biomarkers extracted from speech signal.
The use of information about outlier and Fractal Dimension features improves the system performance.
arXiv Detail & Related papers (2022-03-21T09:57:20Z) - Differential Diagnosis of Frontotemporal Dementia and Alzheimer's
Disease using Generative Adversarial Network [0.0]
Frontotemporal dementia and Alzheimer's disease are two common forms of dementia and are easily misdiagnosed as each other.
Differentiating between the two dementia types is crucial for determining disease-specific intervention and treatment.
Recent development of Deep-learning-based approaches in the field of medical image computing are delivering some of the best performance for many binary classification tasks.
arXiv Detail & Related papers (2021-09-12T22:40:50Z) - Artificial Intelligence Methods Based Hierarchical Classification of
Frontotemporal Dementia to Improve Diagnostic Predictability [0.0]
Patients with Frontotemporal Dementia (FTD) have impaired cognitive abilities, executive and behavioral traits, loss of language ability, and decreased memory capabilities.
The purpose of this study is to classify MRI images of every single subject into one of the spectrums of the FTD in a hierarchical order by applying data-driven techniques of Artificial Intelligence (AI) on cortical thickness data.
Our proposed automated classification model yielded classification accuracy of 86.5, 76, and 72.7 with support vector machine (SVM), linear discriminant analysis (LDA), and Naive Bayes methods, respectively, in 10-fold cross-validation analysis.
arXiv Detail & Related papers (2021-04-12T07:04:11Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z) - Inheritance-guided Hierarchical Assignment for Clinical Automatic
Diagnosis [50.15205065710629]
Clinical diagnosis, which aims to assign diagnosis codes for a patient based on the clinical note, plays an essential role in clinical decision-making.
We propose a novel framework to combine the inheritance-guided hierarchical assignment and co-occurrence graph propagation for clinical automatic diagnosis.
arXiv Detail & Related papers (2021-01-27T13:16:51Z) - Predicting Clinical Diagnosis from Patients Electronic Health Records
Using BERT-based Neural Networks [62.9447303059342]
We show the importance of this problem in medical community.
We present a modification of Bidirectional Representations from Transformers (BERT) model for classification sequence.
We use a large-scale Russian EHR dataset consisting of about 4 million unique patient visits.
arXiv Detail & Related papers (2020-07-15T09:22:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.