Dynamically enhanced static handwriting representation for Parkinson's disease detection

• URL: http://arxiv.org/abs/2405.13438v1
• Date: Wed, 22 May 2024 08:28:42 GMT
• Title: Dynamically enhanced static handwriting representation for Parkinson's disease detection
• Authors: Moises Diaz, Miguel Angel Ferrer, Donato Impedovo, Giuseppe Pirlo, Gennaro Vessio,
• Abstract summary: Handwriting plays a special role in the context of Parkinson's disease (PD) assessment. In this paper, the discriminating power of "dynamically enhanced" static images of handwriting is investigated.
• Score: 8.26914435242875
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Computer aided diagnosis systems can provide non-invasive, low-cost tools to support clinicians. These systems have the potential to assist the diagnosis and monitoring of neurodegenerative disorders, in particular Parkinson's disease (PD). Handwriting plays a special role in the context of PD assessment. In this paper, the discriminating power of "dynamically enhanced" static images of handwriting is investigated. The enhanced images are synthetically generated by exploiting simultaneously the static and dynamic properties of handwriting. Specifically, we propose a static representation that embeds dynamic information based on: (i) drawing the points of the samples, instead of linking them, so as to retain temporal/velocity information; and (ii) adding pen-ups for the same purpose. To evaluate the effectiveness of the new handwriting representation, a fair comparison between this approach and state-of-the-art methods based on static and dynamic handwriting is conducted on the same dataset, i.e. PaHaW. The classification workflow employs transfer learning to extract meaningful features from multiple representations of the input data. An ensemble of different classifiers is used to achieve the final predictions. Dynamically enhanced static handwriting is able to outperform the results obtained by using static and dynamic handwriting separately.

Related papers

• Evaluation of handwriting kinematics and pressure for differential diagnosis of Parkinson's disease [0.3806074545662052]
  The PaHaW Parkinson's disease handwriting database contains handwriting samples from Parkinson's disease (PD) patients and healthy controls. We show that kinematic features and pressure features in handwriting can be used for the differential diagnosis of PD.
  arXiv  Detail & Related papers  (2024-11-05T12:27:24Z)
• Hybrid Transformer for Early Alzheimer's Detection: Integration of Handwriting-Based 2D Images and 1D Signal Features [2.606124959056959]
  Alzheimer's Disease (AD) is a prevalent neurodegenerative condition where early detection is vital. Handwriting, often affected early in AD, offers a non-invasive and cost-effective way to capture subtle motor changes. We propose a learnable multimodal hybrid attention model that integrates simultaneously 2D handwriting images with 1D dynamic handwriting signals. Our model achieved state-of-the-art performance on the DARWIN dataset, with an F1-score of 90.32% and accuracy of 90.91% in Task 8 ('L' writing)
  arXiv  Detail & Related papers  (2024-10-14T14:26:52Z)
• Contrastive Learning with Counterfactual Explanations for Radiology Report Generation [83.30609465252441]
  We propose a textbfCountertextbfFactual textbfExplanations-based framework (CoFE) for radiology report generation. Counterfactual explanations serve as a potent tool for understanding how decisions made by algorithms can be changed by asking what if'' scenarios. Experiments on two benchmarks demonstrate that leveraging the counterfactual explanations enables CoFE to generate semantically coherent and factually complete reports.
  arXiv  Detail & Related papers  (2024-07-19T17:24:25Z)
• Hierarchical Text-to-Vision Self Supervised Alignment for Improved Histopathology Representation Learning [64.1316997189396]
  We present a novel language-tied self-supervised learning framework, Hierarchical Language-tied Self-Supervision (HLSS) for histopathology images. Our resulting model achieves state-of-the-art performance on two medical imaging benchmarks, OpenSRH and TCGA datasets.
  arXiv  Detail & Related papers  (2024-03-21T17:58:56Z)
• How word semantics and phonology affect handwriting of Alzheimer's patients: a machine learning based analysis [20.36565712578267]
  We investigated how word semantics and phonology affect the handwriting of people affected by Alzheimer's disease. We used the data from six handwriting tasks, each requiring copying a word belonging to one of the following categories. The experimental results showed that the feature selection allowed us to derive a different set of highly distinctive features for each word type.
  arXiv  Detail & Related papers  (2023-07-06T13:35:06Z)
• Conversational Semantic Parsing using Dynamic Context Graphs [68.72121830563906]
  We consider the task of conversational semantic parsing over general purpose knowledge graphs (KGs) with millions of entities, and thousands of relation-types. We focus on models which are capable of interactively mapping user utterances into executable logical forms.
  arXiv  Detail & Related papers  (2023-05-04T16:04:41Z)
• Learning to Exploit Temporal Structure for Biomedical Vision-Language Processing [53.89917396428747]
  Self-supervised learning in vision-language processing exploits semantic alignment between imaging and text modalities. We explicitly account for prior images and reports when available during both training and fine-tuning. Our approach, named BioViL-T, uses a CNN-Transformer hybrid multi-image encoder trained jointly with a text model.
  arXiv  Detail & Related papers  (2023-01-11T16:35:33Z)
• DyTed: Disentangled Representation Learning for Discrete-time Dynamic Graph [59.583555454424]
  We propose a novel disenTangled representation learning framework for discrete-time Dynamic graphs, namely DyTed. We specially design a temporal-clips contrastive learning task together with a structure contrastive learning to effectively identify the time-invariant and time-varying representations respectively.
  arXiv  Detail & Related papers  (2022-10-19T14:34:12Z)
• Contribution of Different Handwriting Modalities to Differential Diagnosis of Parkinson's Disease [0.0]
  In this paper, we evaluate the contribution of different handwriting modalities to the diagnosis of Parkinson's disease. We show that pressure and in-air movement also possess information that is relevant for diagnosis of Parkinson's Disease from handwriting.
  arXiv  Detail & Related papers  (2022-03-18T10:51:37Z)
• Sequence-based Dynamic Handwriting Analysis for Parkinson's Disease Detection with One-dimensional Convolutions and BiGRUs [5.936804438746453]
  Parkinsons disease (PD) is commonly characterized by several motor symptoms such as bradykinesia akinesia, rigidity, and tremor. The analysis of patients' fine motor control, particularly handwriting, is a powerful tool to support PD assessment. This paper proposes a novel classification model based on one-directional convolutions and Bi Gated Recurrent Units (GRUs)
  arXiv  Detail & Related papers  (2021-01-23T09:25:13Z)
• Temporal Embeddings and Transformer Models for Narrative Text Understanding [72.88083067388155]
  We present two approaches to narrative text understanding for character relationship modelling. The temporal evolution of these relations is described by dynamic word embeddings, that are designed to learn semantic changes over time. A supervised learning approach based on the state-of-the-art transformer model BERT is used instead to detect static relations between characters.
  arXiv  Detail & Related papers  (2020-03-19T14:23:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.