A Multi-modal Machine Learning Approach and Toolkit to Automate
Recognition of Early Stages of Dementia among British Sign Language Users
- URL: http://arxiv.org/abs/2010.00536v1
- Date: Thu, 1 Oct 2020 16:35:48 GMT
- Title: A Multi-modal Machine Learning Approach and Toolkit to Automate
Recognition of Early Stages of Dementia among British Sign Language Users
- Authors: Xing Liang, Anastassia Angelopoulou, Epaminondas Kapetanios, Bencie
Woll, Reda Al-batat, Tyron Woolfe
- Abstract summary: A timely diagnosis helps in obtaining necessary support and appropriate medication.
Deep learning based approaches for image and video analysis and understanding are promising.
We show that our approach is not over-fitted and has the potential to scale up.
- Score: 5.8720142291102135
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The ageing population trend is correlated with an increased prevalence of
acquired cognitive impairments such as dementia. Although there is no cure for
dementia, a timely diagnosis helps in obtaining necessary support and
appropriate medication. Researchers are working urgently to develop effective
technological tools that can help doctors undertake early identification of
cognitive disorder. In particular, screening for dementia in ageing Deaf
signers of British Sign Language (BSL) poses additional challenges as the
diagnostic process is bound up with conditions such as quality and availability
of interpreters, as well as appropriate questionnaires and cognitive tests. On
the other hand, deep learning based approaches for image and video analysis and
understanding are promising, particularly the adoption of Convolutional Neural
Network (CNN), which require large amounts of training data. In this paper,
however, we demonstrate novelty in the following way: a) a multi-modal machine
learning based automatic recognition toolkit for early stages of dementia among
BSL users in that features from several parts of the body contributing to the
sign envelope, e.g., hand-arm movements and facial expressions, are combined,
b) universality in that it is possible to apply our technique to users of any
sign language, since it is language independent, c) given the trade-off between
complexity and accuracy of machine learning (ML) prediction models as well as
the limited amount of training and testing data being available, we show that
our approach is not over-fitted and has the potential to scale up.
Related papers
- Identification of Cognitive Decline from Spoken Language through Feature
Selection and the Bag of Acoustic Words Model [0.0]
The early identification of symptoms of memory disorders plays a significant role in ensuring the well-being of populations.
The lack of standardized speech tests in clinical settings has led to a growing emphasis on developing automatic machine learning techniques for analyzing naturally spoken language.
The work presents an approach related to feature selection, allowing for the automatic selection of the essential features required for diagnosis from the Geneva minimalistic acoustic parameter set and relative speech pauses.
arXiv Detail & Related papers (2024-02-02T17:06:03Z) - Language Generation from Brain Recordings [68.97414452707103]
We propose a generative language BCI that utilizes the capacity of a large language model and a semantic brain decoder.
The proposed model can generate coherent language sequences aligned with the semantic content of visual or auditory language stimuli.
Our findings demonstrate the potential and feasibility of employing BCIs in direct language generation.
arXiv Detail & Related papers (2023-11-16T13:37:21Z) - Assessing Language Disorders using Artificial Intelligence: a Paradigm
Shift [0.13393465195776774]
Speech, language, and communication deficits are present in most neurodegenerative syndromes.
We argue that using machine learning methodologies, natural language processing, and modern artificial intelligence (AI) for Language Assessment is an improvement over conventional manual assessment.
arXiv Detail & Related papers (2023-05-31T17:20:45Z) - Leveraging Pretrained Representations with Task-related Keywords for
Alzheimer's Disease Detection [69.53626024091076]
Alzheimer's disease (AD) is particularly prominent in older adults.
Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations.
This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features.
arXiv Detail & Related papers (2023-03-14T16:03:28Z) - Multilingual Alzheimer's Dementia Recognition through Spontaneous
Speech: a Signal Processing Grand Challenge [18.684024762601215]
This Signal Processing Grand Challenge (SPGC) targets a difficult automatic prediction problem of societal and medical relevance.
The Challenge has been designed to assess the extent to which predictive models built based on speech in one language (English) generalise to another language (Greek)
arXiv Detail & Related papers (2023-01-13T14:09:13Z) - AutoPrognosis 2.0: Democratizing Diagnostic and Prognostic Modeling in
Healthcare with Automated Machine Learning [72.2614468437919]
We present a machine learning framework, AutoPrognosis 2.0, to develop diagnostic and prognostic models.
We provide an illustrative application where we construct a prognostic risk score for diabetes using the UK Biobank.
Our risk score has been implemented as a web-based decision support tool and can be publicly accessed by patients and clinicians worldwide.
arXiv Detail & Related papers (2022-10-21T16:31:46Z) - Detecting Shortcut Learning for Fair Medical AI using Shortcut Testing [62.9062883851246]
Machine learning holds great promise for improving healthcare, but it is critical to ensure that its use will not propagate or amplify health disparities.
One potential driver of algorithmic unfairness, shortcut learning, arises when ML models base predictions on improper correlations in the training data.
Using multi-task learning, we propose the first method to assess and mitigate shortcut learning as a part of the fairness assessment of clinical ML systems.
arXiv Detail & Related papers (2022-07-21T09:35:38Z) - Using Deep Learning to Identify Patients with Cognitive Impairment in
Electronic Health Records [0.0]
Only one in four people who suffer from dementia are diagnosed.
Dementia is under-diagnosed by healthcare professionals.
Deep learning NLP can successfully identify dementia patients without dementia-related ICD codes or medications.
arXiv Detail & Related papers (2021-11-13T01:44:10Z) - NUVA: A Naming Utterance Verifier for Aphasia Treatment [49.114436579008476]
Assessment of speech performance using picture naming tasks is a key method for both diagnosis and monitoring of responses to treatment interventions by people with aphasia (PWA)
Here we present NUVA, an utterance verification system incorporating a deep learning element that classifies 'correct' versus'incorrect' naming attempts from aphasic stroke patients.
When tested on eight native British-English speaking PWA the system's performance accuracy ranged between 83.6% to 93.6%, with a 10-fold cross-validation mean of 89.5%.
arXiv Detail & Related papers (2021-02-10T13:00:29Z) - Predicting Early Indicators of Cognitive Decline from Verbal Utterances [2.387625146176821]
Dementia is a group of irreversible, chronic, and progressive neurodegenerative disorders resulting in impaired memory, communication, and thought processes.
We measure the feasibility of using the linguistic characteristics of verbal utterances elicited during neuropsychological exams to distinguish between elderly control groups, people with MCI, people diagnosed with possible Alzheimer's disease (AD), and probable AD.
Our experiments show that a combination of contextual and psycholinguistic features extracted by a Support Vector Machine improved distinguishing the verbal utterances of elderly controls, people with MCI, possible AD, and probable AD.
arXiv Detail & Related papers (2020-11-19T02:24:11Z) - Detecting Parkinsonian Tremor from IMU Data Collected In-The-Wild using
Deep Multiple-Instance Learning [59.74684475991192]
Parkinson's Disease (PD) is a slowly evolving neuro-logical disease that affects about 1% of the population above 60 years old.
PD symptoms include tremor, rigidity and braykinesia.
We present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device.
arXiv Detail & Related papers (2020-05-06T09:02:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.