Human Gesture and Gait Analysis for Autism Detection
- URL: http://arxiv.org/abs/2304.08368v1
- Date: Mon, 17 Apr 2023 15:31:22 GMT
- Title: Human Gesture and Gait Analysis for Autism Detection
- Authors: Sania Zahan, Zulqarnain Gilani, Ghulam Mubashar Hassan and Ajmal Mian
- Abstract summary: Atypical gait and gesture patterns are dominant behavioral characteristics of autism.
We present an analysis of gesture and gait activity in videos to identify children with autism.
- Score: 23.77172199742202
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Autism diagnosis presents a major challenge due to the vast heterogeneity of
the condition and the elusive nature of early detection. Atypical gait and
gesture patterns are dominant behavioral characteristics of autism and can
provide crucial insights for diagnosis. Furthermore, these data can be
collected efficiently in a non-intrusive way, facilitating early intervention
to optimize positive outcomes. Existing research mainly focuses on associating
facial and eye-gaze features with autism. However, very few studies have
investigated movement and gesture patterns which can reveal subtle variations
and characteristics that are specific to autism. To address this gap, we
present an analysis of gesture and gait activity in videos to identify children
with autism and quantify the severity of their condition by regressing autism
diagnostic observation schedule scores. Our proposed architecture addresses two
key factors: (1) an effective feature representation to manifest irregular
gesture patterns and (2) a two-stream co-learning framework to enable a
comprehensive understanding of its relation to autism from diverse perspectives
without explicitly using additional data modality. Experimental results
demonstrate the efficacy of utilizing gesture and gait-activity videos for
autism analysis.
Related papers
- Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition [47.550391816383794]
We introduce a novel problem of audio-visual autism behavior recognition.
Social behavior recognition is an essential aspect previously omitted in AI-assisted autism screening research.
We will release our dataset, code, and pre-trained models.
arXiv Detail & Related papers (2024-03-22T22:52:35Z) - Accurate Autism Spectrum Disorder prediction using Support Vector
Classifier based on Federated Learning (SVCFL) [0.0]
We have achieved 99% accuracy for predicting autism spectrum disorder and we have achieved 13% improvement in the results.
In this article, we have achieved 99% accuracy for predicting autism spectrum disorder and we have achieved 13% improvement in the results.
arXiv Detail & Related papers (2023-11-08T11:14:29Z) - Leveraging Pretrained Representations with Task-related Keywords for
Alzheimer's Disease Detection [69.53626024091076]
Alzheimer's disease (AD) is particularly prominent in older adults.
Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations.
This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features.
arXiv Detail & Related papers (2023-03-14T16:03:28Z) - Language-Assisted Deep Learning for Autistic Behaviors Recognition [13.200025637384897]
We show that a vision-based problem behaviors recognition system can achieve high accuracy and outperform the previous methods by a large margin.
We propose a two-branch multimodal deep learning framework by incorporating the "freely available" language description for each type of problem behavior.
Experimental results demonstrate that incorporating additional language supervision can bring an obvious performance boost for the autism problem behaviors recognition task.
arXiv Detail & Related papers (2022-11-17T02:58:55Z) - Action-based Early Autism Diagnosis Using Contrastive Feature Learning [2.922007656878633]
Autism, also known as Autism Spectrum Disorder (or ASD), is a neurological disorder.
Its main symptoms include difficulty in (verbal and/or non-verbal) communication, and rigid/repetitive behavior.
We present a learning based approach to automate autism diagnosis using simple and small action video clips of subjects.
arXiv Detail & Related papers (2022-09-12T16:31:34Z) - Vision-Based Activity Recognition in Children with Autism-Related
Behaviors [15.915410623440874]
We demonstrate the effect of a region-based computer vision system to help clinicians and parents analyze a child's behavior.
The data is pre-processed by detecting the target child in the video to reduce the impact of background noise.
Motivated by the effectiveness of temporal convolutional models, we propose both light-weight and conventional models capable of extracting action features from video frames.
arXiv Detail & Related papers (2022-08-08T15:12:27Z) - Attention-Based Applications in Extended Reality to Support Autistic
Users: A Systematic Review [10.527821704930371]
Extended reality (XR) technology has been shown to be effective in improving attention in autistic users.
We conducted a systematic review of 59 research articles that explored the role of attention in XR interventions for autistic users.
arXiv Detail & Related papers (2022-04-01T23:41:54Z) - Factored Attention and Embedding for Unstructured-view Topic-related
Ultrasound Report Generation [70.7778938191405]
We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation.
The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
arXiv Detail & Related papers (2022-03-12T15:24:03Z) - Non-contact Pain Recognition from Video Sequences with Remote
Physiological Measurements Prediction [53.03469655641418]
We present a novel multi-task learning framework which encodes both appearance changes and physiological cues in a non-contact manner for pain recognition.
We establish the state-of-the-art performance of non-contact pain recognition on publicly available pain databases.
arXiv Detail & Related papers (2021-05-18T20:47:45Z) - Emotion pattern detection on facial videos using functional statistics [62.997667081978825]
We propose a technique based on Functional ANOVA to extract significant patterns of face muscles movements.
We determine if there are time-related differences on expressions among emotional groups by using a functional F-test.
arXiv Detail & Related papers (2021-03-01T08:31:08Z) - Early Autism Spectrum Disorders Diagnosis Using Eye-Tracking Technology [62.997667081978825]
Lack of money, absence of qualified specialists, and low level of trust to the correction methods are the main issues that affect the in-time diagnoses of ASD.
Our team developed the algorithm that will be able to predict the chances of ASD according to the information from the gaze activity of the child.
arXiv Detail & Related papers (2020-08-21T20:22:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.