Towards Creating a Deployable Grasp Type Probability Estimator for a
Prosthetic Hand
- URL: http://arxiv.org/abs/2101.05357v1
- Date: Wed, 13 Jan 2021 21:39:41 GMT
- Title: Towards Creating a Deployable Grasp Type Probability Estimator for a
Prosthetic Hand
- Authors: Mehrshad Zandigohar, Mo Han, Deniz Erdogmus, and Gunar Schirner
- Abstract summary: InceptionV3 achieves highest accuracy with 0.95 angular similarity followed by 1.4 MobileNetV2 with 0.93 at 20% the amount of operations.
Our work enables augmenting EMG intent inference with physical state probability through machine learning and computer vision method.
- Score: 11.008123712007402
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: For lower arm amputees, prosthetic hands promise to restore most of physical
interaction capabilities. This requires to accurately predict hand gestures
capable of grabbing varying objects and execute them timely as intended by the
user. Current approaches often rely on physiological signal inputs such as
Electromyography (EMG) signal from residual limb muscles to infer the intended
motion. However, limited signal quality, user diversity and high variability
adversely affect the system robustness. Instead of solely relying on EMG
signals, our work enables augmenting EMG intent inference with physical state
probability through machine learning and computer vision method. To this end,
we: (1) study state-of-the-art deep neural network architectures to select a
performant source of knowledge transfer for the prosthetic hand, (2) use a
dataset containing object images and probability distribution of grasp types as
a new form of labeling where instead of using absolute values of zero and one
as the conventional classification labels, our labels are a set of
probabilities whose sum is 1. The proposed method generates probabilistic
predictions which could be fused with EMG prediction of probabilities over
grasps by using the visual information from the palm camera of a prosthetic
hand. Our results demonstrate that InceptionV3 achieves highest accuracy with
0.95 angular similarity followed by 1.4 MobileNetV2 with 0.93 at ~20% the
amount of operations.
Related papers
- Physical formula enhanced multi-task learning for pharmacokinetics prediction [54.13787789006417]
A major challenge for AI-driven drug discovery is the scarcity of high-quality data.
We develop a formula enhanced mul-ti-task learning (PEMAL) method that predicts four key parameters of pharmacokinetics simultaneously.
Our experiments reveal that PEMAL significantly lowers the data demand, compared to typical Graph Neural Networks.
arXiv Detail & Related papers (2024-04-16T07:42:55Z) - Agile gesture recognition for capacitive sensing devices: adapting
on-the-job [55.40855017016652]
We demonstrate a hand gesture recognition system that uses signals from capacitive sensors embedded into the etee hand controller.
The controller generates real-time signals from each of the wearer five fingers.
We use a machine learning technique to analyse the time series signals and identify three features that can represent 5 fingers within 500 ms.
arXiv Detail & Related papers (2023-05-12T17:24:02Z) - Palm Vein Recognition via Multi-task Loss Function and Attention Layer [3.265773263570237]
In this paper, a convolutional neural network based on VGG-16 transfer learning fused attention mechanism is used as the feature extraction network on the infrared palm vein dataset.
In order to verify the robustness of the model, some experiments were carried out on datasets from different sources.
At the same time, the matching is with high efficiency which takes an average of 0.13 seconds per palm vein pair.
arXiv Detail & Related papers (2022-11-11T02:32:49Z) - Decision Forest Based EMG Signal Classification with Low Volume Dataset
Augmented with Random Variance Gaussian Noise [51.76329821186873]
We produce a model that can classify six different hand gestures with a limited number of samples that generalizes well to a wider audience.
We appeal to a set of more elementary methods such as the use of random bounds on a signal, but desire to show the power these methods can carry in an online setting.
arXiv Detail & Related papers (2022-06-29T23:22:18Z) - Neurosymbolic hybrid approach to driver collision warning [64.02492460600905]
There are two main algorithmic approaches to autonomous driving systems.
Deep learning alone has achieved state-of-the-art results in many areas.
But sometimes it can be very difficult to debug if the deep learning model doesn't work.
arXiv Detail & Related papers (2022-03-28T20:29:50Z) - An End-to-End Deep Learning Approach for Epileptic Seizure Prediction [4.094649684498489]
We propose an end-to-end deep learning solution using a convolutional neural network (CNN)
Overall sensitivity, false prediction rate, and area under receiver operating characteristic curve reaches 93.5%, 0.063/h, 0.981 and 98.8%, 0.074/h, 0.988 on two datasets respectively.
arXiv Detail & Related papers (2021-08-17T05:49:43Z) - Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle
Activity for Enhanced Myoelectric Control of Hand Prostheses [78.120734120667]
We introduce a novel method, based on a long short-term memory (LSTM) network, to continuously map forearm EMG activity onto hand kinematics.
Ours is the first reported work on the prediction of hand kinematics that uses this challenging dataset.
Our results suggest that the presented method is suitable for the generation of control signals for the independent and proportional actuation of the multiple DOFs of state-of-the-art hand prostheses.
arXiv Detail & Related papers (2021-04-29T00:11:32Z) - Multimodal Fusion of EMG and Vision for Human Grasp Intent Inference in
Prosthetic Hand Control [11.400385533782204]
We present a Bayesian evidence fusion framework for grasp intent inference using eye-view video, eye-gaze, and EMG from the forearm.
We analyze individual and fused performance as a function of time as the hand approaches the object to grasp it.
arXiv Detail & Related papers (2021-04-08T17:01:19Z) - Bootstrapping Your Own Positive Sample: Contrastive Learning With
Electronic Health Record Data [62.29031007761901]
This paper proposes a novel contrastive regularized clinical classification model.
We introduce two unique positive sampling strategies specifically tailored for EHR data.
Our framework yields highly competitive experimental results in predicting the mortality risk on real-world COVID-19 EHR data.
arXiv Detail & Related papers (2021-04-07T06:02:04Z) - From Hand-Perspective Visual Information to Grasp Type Probabilities:
Deep Learning via Ranking Labels [6.772076545800592]
We build a novel probabilistic classifier according to the Plackett-Luce model to predict the probability distribution over grasps.
We indicate that the proposed model is applicable to the most popular and productive convolutional neural network frameworks.
arXiv Detail & Related papers (2021-03-08T16:12:38Z) - Effect of Analysis Window and Feature Selection on Classification of
Hand Movements Using EMG Signal [0.20999222360659603]
Recently, research on myoelectric control based on pattern recognition (PR) shows promising results with the aid of machine learning classifiers.
By offering multiple class movements and intuitive control, this method has the potential to power an amputated subject to perform everyday life movements.
We show that effective data preprocessing and optimum feature selection helps to improve the classification accuracy of hand movements.
arXiv Detail & Related papers (2020-02-02T19:03:23Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.