Automated Quality Assessment of Hand Washing Using Deep Learning
- URL: http://arxiv.org/abs/2011.11383v2
- Date: Tue, 1 Dec 2020 16:05:27 GMT
- Title: Automated Quality Assessment of Hand Washing Using Deep Learning
- Authors: Maksims Ivanovs, Roberts Kadikis, Martins Lulla, Aleksejs Rutkovskis,
and Atis Elsts
- Abstract summary: We present neural networks for automatically recognizing the different washing movements defined by the WHO.
We train the neural network on a part of a large (2000+ videos) real-world labeled dataset with the different washing movements.
Using pre-trained neural network models such as MobileNetV2 and Xception for the task, it is possible to achieve >64 % accuracy in recognizing the different washing movements.
- Score: 1.8920934738244022
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Washing hands is one of the most important ways to prevent infectious
diseases, including COVID-19. Unfortunately, medical staff does not always
follow the World Health Organization (WHO) hand washing guidelines in their
everyday work. To this end, we present neural networks for automatically
recognizing the different washing movements defined by the WHO. We train the
neural network on a part of a large (2000+ videos) real-world labeled dataset
with the different washing movements. The preliminary results show that using
pre-trained neural network models such as MobileNetV2 and Xception for the
task, it is possible to achieve >64 % accuracy in recognizing the different
washing movements. We also describe the collection and the structure of the
above open-access dataset created as part of this work. Finally, we describe
how the neural network can be used to construct a mobile phone application for
automatic quality control and real-time feedback for medical professionals.
Related papers
- Verified Neural Compressed Sensing [58.98637799432153]
We develop the first (to the best of our knowledge) provably correct neural networks for a precise computational task.
We show that for modest problem dimensions (up to 50), we can train neural networks that provably recover a sparse vector from linear and binarized linear measurements.
We show that the complexity of the network can be adapted to the problem difficulty and solve problems where traditional compressed sensing methods are not known to provably work.
arXiv Detail & Related papers (2024-05-07T12:20:12Z) - Handwashing Action Detection System for an Autonomous Social Robot [0.0]
Young children are at an increased risk of contracting contagious diseases such as COVID-19 due to improper hand hygiene.
An autonomous social agent that observes children while handwashing and encourages good hand washing practices could provide an opportunity for handwashing behavior to become a habit.
We present a human action recognition system, which is part of the vision system of a social robot platform, to assist children in developing a correct handwashing technique.
arXiv Detail & Related papers (2022-10-27T23:46:56Z) - When Accuracy Meets Privacy: Two-Stage Federated Transfer Learning
Framework in Classification of Medical Images on Limited Data: A COVID-19
Case Study [77.34726150561087]
COVID-19 pandemic has spread rapidly and caused a shortage of global medical resources.
CNN has been widely utilized and verified in analyzing medical images.
arXiv Detail & Related papers (2022-03-24T02:09:41Z) - A Deep Learning Based Automated Hand Hygiene Training System [0.12313056815753944]
WHO recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean.
Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality.
In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented.
arXiv Detail & Related papers (2021-12-10T17:01:44Z) - You Can Wash Hands Better: Accurate Daily Handwashing Assessment with Smartwatches [21.502362740250174]
We propose UWash, a wearable solution with smartwatches, to assess handwashing procedures.
We address the task of handwashing assessment from readings of motion sensors similar to the action segmentation problem in computer vision.
Experiments over 51 subjects show that UWash achieves an accuracy of 92.27% on handwashing gesture recognition.
arXiv Detail & Related papers (2021-12-09T12:23:06Z) - Overcoming the Domain Gap in Neural Action Representations [60.47807856873544]
3D pose data can now be reliably extracted from multi-view video sequences without manual intervention.
We propose to use it to guide the encoding of neural action representations together with a set of neural and behavioral augmentations.
To reduce the domain gap, during training, we swap neural and behavioral data across animals that seem to be performing similar actions.
arXiv Detail & Related papers (2021-12-02T12:45:46Z) - COVID-Net MLSys: Designing COVID-Net for the Clinical Workflow [101.45411528425939]
This study takes a machine learning and systems (MLSys) perspective to design a system for COVID-19 patient screening.
The COVID-Net system is comprised of the continuously evolving COVIDx dataset, COVID-Net deep neural network for COVID-19 patient detection, and COVID-Net S deep neural networks for disease severity scoring.
The deep neural networks within the COVID-Net system possess state-of-the-art performance, and are designed to be integrated within a user interface (UI) for clinical decision support.
arXiv Detail & Related papers (2021-09-14T04:13:24Z) - Hand Hygiene Video Classification Based on Deep Learning [0.0]
A subset of robust dataset that consist of handwashing gestures with two hands as well as one-hand gestures utilized.
A pretrained neural network model, RES Net 50, with image net weights used for the classification of 3 categories: Linear hand movement, rub hands palm to palm and rub hands with fingers interlaced movement.
arXiv Detail & Related papers (2021-08-18T12:56:07Z) - Hand Pose Classification Based on Neural Networks [0.0]
This work demonstrates the classification of presence of one hand, two hands and no hand in the scene based on transfer learning.
The pre-trained model; simplest NN from Keras library is utilized to train the network with 704 images of hand gestures.
arXiv Detail & Related papers (2021-08-10T09:14:51Z) - Where is my hand? Deep hand segmentation for visual self-recognition in
humanoid robots [129.46920552019247]
We propose the use of a Convolution Neural Network (CNN) to segment the robot hand from an image in an egocentric view.
We fine-tuned the Mask-RCNN network for the specific task of segmenting the hand of the humanoid robot Vizzy.
arXiv Detail & Related papers (2021-02-09T10:34:32Z) - Domain Generalization for Medical Imaging Classification with
Linear-Dependency Regularization [59.5104563755095]
We introduce a simple but effective approach to improve the generalization capability of deep neural networks in the field of medical imaging classification.
Motivated by the observation that the domain variability of the medical images is to some extent compact, we propose to learn a representative feature space through variational encoding.
arXiv Detail & Related papers (2020-09-27T12:30:30Z) - Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D
Convolutional Neural Network [0.0]
Hand hygiene is one of the most significant factors in preventing hospital acquired infections (HAI)
Recent progress in understanding with convolutional neural net (CNN) has increased the application of recognition and detection of human actions.
We propose a fully automated hand hygiene monitoring tool of the alcohol-based hand rubbing action of anesthesiologists on OR video usingtemporal features with 3D CNN.
arXiv Detail & Related papers (2020-03-20T03:18:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.