Feature Extraction and Prediction for Hand Hygiene Gestures with KNN
Algorithm
- URL: http://arxiv.org/abs/2112.15085v1
- Date: Thu, 30 Dec 2021 14:56:07 GMT
- Title: Feature Extraction and Prediction for Hand Hygiene Gestures with KNN
Algorithm
- Authors: Rashmi Bakshi
- Abstract summary: This work focuses upon the analysis of hand gestures involved in the process of hand washing.
Hand features such as contours of hands, the centroid of the hands, and extreme hand points along the largest contour are extracted.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This work focuses upon the analysis of hand gestures involved in the process
of hand washing. There are six standard hand hygiene gestures for washing hands
as provided by World Health Organisation hand hygiene guidelines. In this
paper, hand features such as contours of hands, the centroid of the hands, and
extreme hand points along the largest contour are extracted with the use of the
computer vision library, OpenCV. These hand features are extracted for each
data frame in a hand hygiene video. A robust hand hygiene dataset of video
recordings was created in the project. A subset of this dataset is used in this
work. Extracted hand features are further grouped into classes based on the KNN
algorithm with a cross-fold validation technique for the classification and
prediction of the unlabelled data. A mean accuracy score of >95% is achieved
and proves that the KNN algorithm with an appropriate input value of K=5 is
efficient for classification. A complete dataset with six distinct hand hygiene
classes will be used with the KNN classifier for future work.
Related papers
- HandReader: Advanced Techniques for Efficient Fingerspelling Recognition [75.38606213726906]
This paper introduces HandReader, a group of three architectures designed to address the fingerspelling recognition task.<n>HandReader$_RGB$ employs the novel Adaptive Shift-Temporal Module (TSAM) to process RGB features from videos of varying lengths.<n>HandReader$_KP$ is built on the proposed Temporal Pose (TPE) operated on keypoints as tensors.<n>Each HandReader model possesses distinct advantages and achieves state-of-the-art results on the ChicagoFSWild and ChicagoFSWild+ datasets.
arXiv Detail & Related papers (2025-05-15T13:18:37Z) - HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud [60.47544798202017]
Hand pose estimation is a critical task in various human-computer interaction applications.
This paper proposes HandDiff, a diffusion-based hand pose estimation model that iteratively denoises accurate hand pose conditioned on hand-shaped image-point clouds.
Experimental results demonstrate that the proposed HandDiff significantly outperforms the existing approaches on four challenging hand pose benchmark datasets.
arXiv Detail & Related papers (2024-04-04T02:15:16Z) - Interacting Hand-Object Pose Estimation via Dense Mutual Attention [97.26400229871888]
3D hand-object pose estimation is the key to the success of many computer vision applications.
We propose a novel dense mutual attention mechanism that is able to model fine-grained dependencies between the hand and the object.
Our method is able to produce physically plausible poses with high quality and real-time inference speed.
arXiv Detail & Related papers (2022-11-16T10:01:33Z) - Hand Hygiene Assessment via Joint Step Segmentation and Key Action
Scorer [32.29065180155029]
Hand hygiene is a standard six-step hand-washing action proposed by the World Health Organization (WHO)
We propose a novel fine-grained learning framework to perform step segmentation and key action scorer in a joint manner for accurate hand hygiene assessment.
Under the supervision of medical staff, we contribute a video dataset that contains 300 video sequences with fine-grained annotations.
arXiv Detail & Related papers (2022-09-25T13:47:21Z) - HAR-GCNN: Deep Graph CNNs for Human Activity Recognition From Highly
Unlabeled Mobile Sensor Data [61.79595926825511]
Acquiring balanced datasets containing accurate activity labels requires humans to correctly annotate and potentially interfere with the subjects' normal activities in real-time.
We propose HAR-GCCN, a deep graph CNN model that leverages the correlation between chronologically adjacent sensor measurements to predict the correct labels for unclassified activities.
Har-GCCN shows superior performance relative to previously used baseline methods, improving classification accuracy by about 25% and up to 68% on different datasets.
arXiv Detail & Related papers (2022-03-07T01:23:46Z) - Keypoint Message Passing for Video-based Person Re-Identification [106.41022426556776]
Video-based person re-identification (re-ID) is an important technique in visual surveillance systems which aims to match video snippets of people captured by different cameras.
Existing methods are mostly based on convolutional neural networks (CNNs), whose building blocks either process local neighbor pixels at a time, or, when 3D convolutions are used to model temporal information, suffer from the misalignment problem caused by person movement.
In this paper, we propose to overcome the limitations of normal convolutions with a human-oriented graph method. Specifically, features located at person joint keypoints are extracted and connected as a spatial-temporal graph
arXiv Detail & Related papers (2021-11-16T08:01:16Z) - CvS: Classification via Segmentation For Small Datasets [52.821178654631254]
This paper presents CvS, a cost-effective classifier for small datasets that derives the classification labels from predicting the segmentation maps.
We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.
arXiv Detail & Related papers (2021-10-29T18:41:15Z) - Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene [3.588453140011797]
This paper contributes a new high-quality dataset for hand gesture recognition in hand hygiene systems, named "MFH"
To address the aforementioned issues, the MFH dataset is proposed to contain a total of 731147 samples obtained by different camera views in 6 non-overlapping locations.
arXiv Detail & Related papers (2021-09-07T08:14:15Z) - Hand Hygiene Video Classification Based on Deep Learning [0.0]
A subset of robust dataset that consist of handwashing gestures with two hands as well as one-hand gestures utilized.
A pretrained neural network model, RES Net 50, with image net weights used for the classification of 3 categories: Linear hand movement, rub hands palm to palm and rub hands with fingers interlaced movement.
arXiv Detail & Related papers (2021-08-18T12:56:07Z) - Feature Identification and Matching for Hand Hygiene Pose [0.0]
The experiment demonstrated that ORB algorithm outperforms by giving the high number of correct matches in less amount of time.
OpenCV utilized to apply the algorithms within python scripts.
arXiv Detail & Related papers (2021-08-14T13:34:42Z) - Hand Pose Classification Based on Neural Networks [0.0]
This work demonstrates the classification of presence of one hand, two hands and no hand in the scene based on transfer learning.
The pre-trained model; simplest NN from Keras library is utilized to train the network with 704 images of hand gestures.
arXiv Detail & Related papers (2021-08-10T09:14:51Z) - HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural
Networks [71.09275975580009]
HandVoxNet++ is a voxel-based deep network with 3D and graph convolutions trained in a fully supervised manner.
HandVoxNet++ relies on two hand shape representations. The first one is the 3D voxelized grid of hand shape, which does not preserve the mesh topology.
We combine the advantages of both representations by aligning the hand surface to the voxelized hand shape either with a new neural Graph-Convolutions-based Mesh Registration (GCN-MeshReg) or classical segment-wise Non-Rigid Gravitational Approach (NRGA++) which
arXiv Detail & Related papers (2021-07-02T17:59:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.