A Personalized Video-Based Hand Taxonomy: Application for Individuals with Spinal Cord Injury

• URL: http://arxiv.org/abs/2403.18094v1
• Date: Tue, 26 Mar 2024 20:30:55 GMT
• Title: A Personalized Video-Based Hand Taxonomy: Application for Individuals with Spinal Cord Injury
• Authors: Mehdy Dousty, David J. Fleet, José Zariffa,
• Abstract summary: Spinal cord injuries (SCI) can impair hand function, reducing independence. This study aims to automatically identify the dominant distinct hand grasps in egocentric video using semantic clustering. A deep learning model integrating posture and appearance data was employed to create a personalized hand taxonomy.
• Score: 14.062874246796687
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Hand function is critical for our interactions and quality of life. Spinal cord injuries (SCI) can impair hand function, reducing independence. A comprehensive evaluation of function in home and community settings requires a hand grasp taxonomy for individuals with impaired hand function. Developing such a taxonomy is challenging due to unrepresented grasp types in standard taxonomies, uneven data distribution across injury levels, and limited data. This study aims to automatically identify the dominant distinct hand grasps in egocentric video using semantic clustering. Egocentric video recordings collected in the homes of 19 individual with cervical SCI were used to cluster grasping actions with semantic significance. A deep learning model integrating posture and appearance data was employed to create a personalized hand taxonomy. Quantitative analysis reveals a cluster purity of 67.6% +- 24.2% with with 18.0% +- 21.8% redundancy. Qualitative assessment revealed meaningful clusters in video content. This methodology provides a flexible and effective strategy to analyze hand function in the wild. It offers researchers and clinicians an efficient tool for evaluating hand function, aiding sensitive assessments and tailored intervention plans.

Related papers

• Explaining Human Activity Recognition with SHAP: Validating Insights with Perturbation and Quantitative Measures [0.1398098625978622]
  This study uses SHapley Additive exPlanations to explain the decision-making process of Graph Convolution Networks (GCNs) We employ SHAP to explain two real-world datasets: one for cerebral palsy (CP) classification and the widely used NTU RGB+D 60 action recognition dataset. Results on both datasets show that body key points identified as important through SHAP have the largest influence on the accuracy, specificity, and sensitivity metrics.
  arXiv  Detail & Related papers  (2024-11-06T07:28:57Z)
• Feature graphs for interpretable unsupervised tree ensembles: centrality, interaction, and application in disease subtyping [0.24578723416255746]
  Feature selection assumes a pivotal role in enhancing model interpretability. The accuracy gained from aggregating decision trees comes at the expense of interpretability. The study introduces novel methods to construct feature graphs from unsupervised random forests.
  arXiv  Detail & Related papers  (2024-04-27T12:47:37Z)
• Evaluating the Fairness of the MIMIC-IV Dataset and a Baseline Algorithm: Application to the ICU Length of Stay Prediction [65.268245109828]
  This paper uses the MIMIC-IV dataset to examine the fairness and bias in an XGBoost binary classification model predicting the ICU length of stay. The research reveals class imbalances in the dataset across demographic attributes and employs data preprocessing and feature extraction. The paper concludes with recommendations for fairness-aware machine learning techniques for mitigating biases and the need for collaborative efforts among healthcare professionals and data scientists.
  arXiv  Detail & Related papers  (2023-12-31T16:01:48Z)
• Sensitivity, Performance, Robustness: Deconstructing the Effect of Sociodemographic Prompting [64.80538055623842]
  sociodemographic prompting is a technique that steers the output of prompt-based models towards answers that humans with specific sociodemographic profiles would give. We show that sociodemographic information affects model predictions and can be beneficial for improving zero-shot learning in subjective NLP tasks.
  arXiv  Detail & Related papers  (2023-09-13T15:42:06Z)
• Explainable AI and Machine Learning Towards Human Gait Deterioration Analysis [0.0]
  We objectively analyze gait data and associate findings with clinically relevant biomarkers. We achieve classification accuracies of 98% F1 sc ores for each PhysioNet.org dataset and 95.5% F1 scores for the combined PhysioNet dataset.
  arXiv  Detail & Related papers  (2023-06-12T14:53:00Z)
• Dataset Bias in Human Activity Recognition [57.91018542715725]
  This contribution statistically curates the training data to assess to what degree the physical characteristics of humans influence HAR performance. We evaluate the performance of a state-of-the-art convolutional neural network on two HAR datasets that vary in the sensors, activities, and recording for time-series HAR.
  arXiv  Detail & Related papers  (2023-01-19T12:33:50Z)
• Recognizing Hand Use and Hand Role at Home After Stroke from Egocentric Video [0.0]
  Egocentric video can capture hand-object interactions in context, as well as show how more-affected hands are used. To use artificial intelligence-based computer vision to classify hand use and hand role from egocentric videos recorded at home after stroke.
  arXiv  Detail & Related papers  (2022-07-18T20:15:29Z)
• Measuring hand use in the home after cervical spinal cord injury using egocentric video [2.1064122195521926]
  Egocentric video has emerged as a potential solution for monitoring hand function in individuals living with tetraplegia in the community. We develop and validate a wearable vision-based system for measuring hand use in the home among individuals living with tetraplegia.
  arXiv  Detail & Related papers  (2022-03-31T12:43:23Z)
• Bootstrapping Your Own Positive Sample: Contrastive Learning With Electronic Health Record Data [62.29031007761901]
  This paper proposes a novel contrastive regularized clinical classification model. We introduce two unique positive sampling strategies specifically tailored for EHR data. Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
  arXiv  Detail & Related papers  (2021-04-07T06:02:04Z)
• Deep learning-based COVID-19 pneumonia classification using chest CT images: model generalizability [54.86482395312936]
  Deep learning (DL) classification models were trained to identify COVID-19-positive patients on 3D computed tomography (CT) datasets from different countries. We trained nine identical DL-based classification models by using combinations of the datasets with a 72% train, 8% validation, and 20% test data split. The models trained on multiple datasets and evaluated on a test set from one of the datasets used for training performed better.
  arXiv  Detail & Related papers  (2021-02-18T21:14:52Z)
• ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes [64.87637128500889]
  Region of Interest Active Learning (ROIAL) framework actively learns each user's underlying utility function over a region of interest. ROIAL learns from ordinal and preference feedback, which are more reliable feedback mechanisms than absolute numerical scores. Results demonstrate the feasibility of recovering gait utility landscapes from limited human trials.
  arXiv  Detail & Related papers  (2020-11-09T22:45:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.