A Deep Learning Based Automated Hand Hygiene Training System

• URL: http://arxiv.org/abs/2112.05667v1
• Date: Fri, 10 Dec 2021 17:01:44 GMT
• Title: A Deep Learning Based Automated Hand Hygiene Training System
• Authors: Mobina Shahbandeh, Fatemeh Ghaffarpour, Sina Vali, Mohammad Amin Haghpanah, Amin Mousavi Torkamani, Mehdi Tale Masouleh, Ahmad Kalhor
• Abstract summary: WHO recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean. Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality. In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented.
• Score: 0.12313056815753944
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hand hygiene is crucial for preventing viruses and infections. Due to the pervasive outbreak of COVID-19, wearing a mask and hand hygiene appear to be the most effective ways for the public to curb the spread of these viruses. The World Health Organization (WHO) recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean. As these steps involve complex gestures, human assessment of them lacks enough accuracy. However, Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality for the purposes of training and feedback. In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented. The system evaluates the compliance with the 8-step guideline using a DNN architecture trained on a dataset of videos collected from volunteers with various skin tones and hand characteristics following the hand rubbing guideline. Various DNN architectures were tested, and an Inception-ResNet model led to the best results with 97% test accuracy. In the proposed system, an NVIDIA Jetson AGX Xavier embedded board runs the software. The efficacy of the system is evaluated in a concrete situation of being used by various users, and challenging steps are identified. In this experiment, the average time taken by the hand rubbing steps among volunteers is 27.2 seconds, which conforms to the WHO guidelines.

Related papers

• Learning Visuotactile Skills with Two Multifingered Hands [80.99370364907278]
  We explore learning from human demonstrations using a bimanual system with multifingered hands and visuotactile data. Our results mark a promising step forward in bimanual multifingered manipulation from visuotactile data.
  arXiv  Detail & Related papers  (2024-04-25T17:59:41Z)
• COVID-Net USPro: An Open-Source Explainable Few-Shot Deep Prototypical Network to Monitor and Detect COVID-19 Infection from Point-of-Care Ultrasound Images [66.63200823918429]
  COVID-Net USPro monitors and detects COVID-19 positive cases with high precision and recall from minimal ultrasound images. The network achieves 99.65% overall accuracy, 99.7% recall and 99.67% precision for COVID-19 positive cases when trained with only 5 shots.
  arXiv  Detail & Related papers  (2023-01-04T16:05:51Z)
• Handwashing Action Detection System for an Autonomous Social Robot [0.0]
  Young children are at an increased risk of contracting contagious diseases such as COVID-19 due to improper hand hygiene. An autonomous social agent that observes children while handwashing and encourages good hand washing practices could provide an opportunity for handwashing behavior to become a habit. We present a human action recognition system, which is part of the vision system of a social robot platform, to assist children in developing a correct handwashing technique.
  arXiv  Detail & Related papers  (2022-10-27T23:46:56Z)
• You Can Wash Hands Better: Accurate Daily Handwashing Assessment with Smartwatches [21.502362740250174]
  We propose UWash, a wearable solution with smartwatches, to assess handwashing procedures. We address the task of handwashing assessment from readings of motion sensors similar to the action segmentation problem in computer vision. Experiments over 51 subjects show that UWash achieves an accuracy of 92.27% on handwashing gesture recognition.
  arXiv  Detail & Related papers  (2021-12-09T12:23:06Z)
• Feature Detection for Hand Hygiene Stages [0.0]
  There are six principal sequential steps for washing hands as per the World Health Organisation (WHO) guidelines. In this work, a detailed description of an aluminium rig construction for creating a robust hand-washing dataset is discussed. Preliminary results with the help of image processing and computer vision algorithms for hand pose extraction and feature detection are demonstrated.
  arXiv  Detail & Related papers  (2021-08-06T09:21:03Z)
• HandVoxNet++: 3D Hand Shape and Pose Estimation using Voxel-Based Neural Networks [71.09275975580009]
  HandVoxNet++ is a voxel-based deep network with 3D and graph convolutions trained in a fully supervised manner. HandVoxNet++ relies on two hand shape representations. The first one is the 3D voxelized grid of hand shape, which does not preserve the mesh topology. We combine the advantages of both representations by aligning the hand surface to the voxelized hand shape either with a new neural Graph-Convolutions-based Mesh Registration (GCN-MeshReg) or classical segment-wise Non-Rigid Gravitational Approach (NRGA++) which
  arXiv  Detail & Related papers  (2021-07-02T17:59:54Z)
• Where is my hand? Deep hand segmentation for visual self-recognition in humanoid robots [129.46920552019247]
  We propose the use of a Convolution Neural Network (CNN) to segment the robot hand from an image in an egocentric view. We fine-tuned the Mask-RCNN network for the specific task of segmenting the hand of the humanoid robot Vizzy.
  arXiv  Detail & Related papers  (2021-02-09T10:34:32Z)
• Automated Quality Assessment of Hand Washing Using Deep Learning [1.8920934738244022]
  We present neural networks for automatically recognizing the different washing movements defined by the WHO. We train the neural network on a part of a large (2000+ videos) real-world labeled dataset with the different washing movements. Using pre-trained neural network models such as MobileNetV2 and Xception for the task, it is possible to achieve >64 % accuracy in recognizing the different washing movements.
  arXiv  Detail & Related papers  (2020-11-23T13:22:53Z)
• Physics-Based Dexterous Manipulations with Estimated Hand Poses and Residual Reinforcement Learning [52.37106940303246]
  We learn a model that maps noisy input hand poses to target virtual poses. The agent is trained in a residual setting by using a model-free hybrid RL+IL approach. We test our framework in two applications that use hand pose estimates for dexterous manipulations: hand-object interactions in VR and hand-object motion reconstruction in-the-wild.
  arXiv  Detail & Related papers  (2020-08-07T17:34:28Z)
• CovidDeep: SARS-CoV-2/COVID-19 Test Based on Wearable Medical Sensors and Efficient Neural Networks [51.589769497681175]
  The novel coronavirus (SARS-CoV-2) has led to a pandemic. The current testing regime based on Reverse Transcription-Polymerase Chain Reaction for SARS-CoV-2 has been unable to keep up with testing demands. We propose a framework called CovidDeep that combines efficient DNNs with commercially available WMSs for pervasive testing of the virus.
  arXiv  Detail & Related papers  (2020-07-20T21:47:28Z)
• Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network [0.0]
  Hand hygiene is one of the most significant factors in preventing hospital acquired infections (HAI) Recent progress in understanding with convolutional neural net (CNN) has increased the application of recognition and detection of human actions. We propose a fully automated hand hygiene monitoring tool of the alcohol-based hand rubbing action of anesthesiologists on OR video usingtemporal features with 3D CNN.
  arXiv  Detail & Related papers  (2020-03-20T03:18:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.