Towards Accessible Learning: Deep Learning-Based Potential Dysgraphia Detection and OCR for Potentially Dysgraphic Handwriting

• URL: http://arxiv.org/abs/2411.13595v1
• Date: Mon, 18 Nov 2024 13:28:26 GMT
• Title: Towards Accessible Learning: Deep Learning-Based Potential Dysgraphia Detection and OCR for Potentially Dysgraphic Handwriting
• Authors: Vydeki D, Divyansh Bhandari, Pranav Pratap Patil, Aarush Anand Kulkarni,
• Abstract summary: Dysgraphia is a learning disorder that affects handwriting abilities. Early detection and monitoring are crucial for providing timely support and interventions. This study applies deep learning techniques to address the dual tasks of dysgraphia detection and optical character recognition.
• Score: 1.9575346216959502
• License:
• Abstract: Dysgraphia is a learning disorder that affects handwriting abilities, making it challenging for children to write legibly and consistently. Early detection and monitoring are crucial for providing timely support and interventions. This study applies deep learning techniques to address the dual tasks of dysgraphia detection and optical character recognition (OCR) on handwriting samples from children with potential dysgraphic symptoms. Using a dataset of handwritten samples from Malaysian schoolchildren, we developed a custom Convolutional Neural Network (CNN) model, alongside VGG16 and ResNet50, to classify handwriting as dysgraphic or non-dysgraphic. The custom CNN model outperformed the pre-trained models, achieving a test accuracy of 91.8% with high precision, recall, and AUC, demonstrating its robustness in identifying dysgraphic handwriting features. Additionally, an OCR pipeline was created to segment and recognize individual characters in dysgraphic handwriting, achieving a character recognition accuracy of approximately 43.5%. This research highlights the potential of deep learning in supporting dysgraphia assessment, laying a foundation for tools that could assist educators and clinicians in identifying dysgraphia and tracking handwriting progress over time. The findings contribute to advancements in assistive technologies for learning disabilities, offering hope for more accessible and accurate diagnostic tools in educational and clinical settings.

Related papers

• Assessment of Developmental Dysgraphia Utilising a Display Tablet [0.3064887031776843]
  The aim of this study is to explore whether the quantitative analysis of online handwriting recorded via a display screen tablet could sufficiently support the assessment of developmental dysgraphia (DD) Using machine learning models based on a gradient algorithm, we were able to support a DD diagnosis with up to 83.6% accuracy. Children with DD spent significantly higher time in-air, they had a higher number of pen elevations, a bigger height on-surface strokes, a lower in-air tempo, and a variation in the angular velocity.
  arXiv  Detail & Related papers  (2024-10-23T19:24:58Z)
• Explainable AI in Handwriting Detection for Dyslexia Using Transfer Learning [0.0]
  We propose an explainable AI (XAI) framework for dyslexia detection through handwriting analysis. Our approach surpasses state-of-the-art methods, achieving a test accuracy of 0.9958. This framework not only improves diagnostic accuracy but also fosters trust and understanding among educators, clinicians, and parents.
  arXiv  Detail & Related papers  (2024-10-18T11:14:54Z)
• Neural Sign Actors: A diffusion model for 3D sign language production from text [51.81647203840081]
  Sign Languages (SL) serve as the primary mode of communication for the Deaf and Hard of Hearing communities. This work makes an important step towards realistic neural sign avatars, bridging the communication gap between Deaf and hearing communities.
  arXiv  Detail & Related papers  (2023-12-05T12:04:34Z)
• Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting [64.80538055623842]
  sociodemographic prompting is a technique that steers the output of prompt-based models towards answers that humans with specific sociodemographic profiles would give. We show that sociodemographic information affects model predictions and can be beneficial for improving zero-shot learning in subjective NLP tasks.
  arXiv  Detail & Related papers  (2023-09-13T15:42:06Z)
• Multimodal brain age estimation using interpretable adaptive population-graph learning [58.99653132076496]
  We propose a framework that learns a population graph structure optimized for the downstream task. An attention mechanism assigns weights to a set of imaging and non-imaging features. By visualizing the attention weights that were the most important for the graph construction, we increase the interpretability of the graph.
  arXiv  Detail & Related papers  (2023-07-10T15:35:31Z)
• NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants [73.85768093666582]
  We propose an explainable geometric deep network dubbed NeuroExplainer. NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
  arXiv  Detail & Related papers  (2023-01-01T12:48:12Z)
• Few-Shot Meta Learning for Recognizing Facial Phenotypes of Genetic Disorders [55.41644538483948]
  Automated classification and similarity retrieval aid physicians in decision-making to diagnose possible genetic conditions as early as possible. Previous work has addressed the problem as a classification problem and used deep learning methods. In this study, we used a facial recognition model trained on a large corpus of healthy individuals as a pre-task and transferred it to facial phenotype recognition.
  arXiv  Detail & Related papers  (2022-10-23T11:52:57Z)
• Automated dysgraphia detection by deep learning with SensoGrip [0.0]
  Early detection of dysgraphia allows for an early start of a targeted intervention. In this work, we investigated fine grading of handwriting capabilities by predicting SEMS score (between 0 and 12) with deep learning. Our approach provide accuracy more than 99% and root mean square error lower than one, with automatic instead of manual feature extraction and selection.
  arXiv  Detail & Related papers  (2022-10-14T09:21:27Z)
• Automated Systems For Diagnosis of Dysgraphia in Children: A Survey and Novel Framework [2.326866956890798]
  Learning disabilities, which primarily interfere with the basic learning skills such as reading, writing and math, are known to affect around 10% of children in the world. The poor motor skills and motor coordination as part of the neurodevelopmental disorder can become a causative factor for the difficulty in learning to write (dysgraphia) The signs and symptoms of dysgraphia include but are not limited to irregular handwriting, improper handling of writing medium, slow or labored writing, unusual hand position, etc.
  arXiv  Detail & Related papers  (2022-06-27T04:44:34Z)
• Dyslexia and Dysgraphia prediction: A new machine learning approach [7.754230120409288]
  Learning disabilities like dysgraphia, dyslexia, dyspraxia, etc. interfere with academic achievements but have long terms consequences beyond the academic time. For assessing such disabilities in early childhood, children have to solve a battery of tests. Human experts score these tests, and decide whether the children require specific education strategy on the basis of their marks. In this paper, we investigate how Artificial Intelligence can help in automating this assessment.
  arXiv  Detail & Related papers  (2020-04-15T09:31:51Z)
• A Developmental Neuro-Robotics Approach for Boosting the Recognition of Handwritten Digits [91.3755431537592]
  Recent evidence shows that a simulation of the children's embodied strategies can improve the machine intelligence too. This article explores the application of embodied strategies to convolutional neural network models in the context of developmental neuro-robotics.
  arXiv  Detail & Related papers  (2020-03-23T14:55:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.