Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer

• URL: http://arxiv.org/abs/2209.12221v4
• Date: Tue, 20 Jun 2023 09:23:11 GMT
• Title: Hand Hygiene Assessment via Joint Step Segmentation and Key Action Scorer
• Authors: Chenglong Li, Qiwen Zhu, Tubiao Liu, Jin Tang, and Yu Su
• Abstract summary: Hand hygiene is a standard six-step hand-washing action proposed by the World Health Organization (WHO) We propose a novel fine-grained learning framework to perform step segmentation and key action scorer in a joint manner for accurate hand hygiene assessment. Under the supervision of medical staff, we contribute a video dataset that contains 300 video sequences with fine-grained annotations.
• Score: 32.29065180155029
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hand hygiene is a standard six-step hand-washing action proposed by the World Health Organization (WHO). However, there is no good way to supervise medical staff to do hand hygiene, which brings the potential risk of disease spread. Existing action assessment works usually make an overall quality prediction on an entire video. However, the internal structures of hand hygiene action are important in hand hygiene assessment. Therefore, we propose a novel fine-grained learning framework to perform step segmentation and key action scorer in a joint manner for accurate hand hygiene assessment. Existing temporal segmentation methods usually employ multi-stage convolutional network to improve the segmentation robustness, but easily lead to over-segmentation due to the lack of the long-range dependence. To address this issue, we design a multi-stage convolution-transformer network for step segmentation. Based on the observation that each hand-washing step involves several key actions which determine the hand-washing quality, we design a set of key action scorers to evaluate the quality of key actions in each step. In addition, there lacks a unified dataset in hand hygiene assessment. Therefore, under the supervision of medical staff, we contribute a video dataset that contains 300 video sequences with fine-grained annotations. Extensive experiments on the dataset suggest that our method well assesses hand hygiene videos and achieves outstanding performance.

Related papers

• Weakly Supervised Video Individual CountingWeakly Supervised Video Individual Counting [126.75545291243142]
  Video Individual Counting aims to predict the number of unique individuals in a single video. We introduce a weakly supervised VIC task, wherein trajectory labels are not provided. In doing so, we devise an end-to-end trainable soft contrastive loss to drive the network to distinguish inflow, outflow, and the remaining.
  arXiv  Detail & Related papers  (2023-12-10T16:12:13Z)
• Adaptive Semi-Supervised Segmentation of Brain Vessels with Ambiguous Labels [63.415444378608214]
  Our approach incorporates innovative techniques including progressive semi-supervised learning, adaptative training strategy, and boundary enhancement. Experimental results on 3DRA datasets demonstrate the superiority of our method in terms of mesh-based segmentation metrics.
  arXiv  Detail & Related papers  (2023-08-07T14:16:52Z)
• Rethinking Semi-Supervised Medical Image Segmentation: A Variance-Reduction Perspective [51.70661197256033]
  We propose ARCO, a semi-supervised contrastive learning framework with stratified group theory for medical image segmentation. We first propose building ARCO through the concept of variance-reduced estimation and show that certain variance-reduction techniques are particularly beneficial in pixel/voxel-level segmentation tasks. We experimentally validate our approaches on eight benchmarks, i.e., five 2D/3D medical and three semantic segmentation datasets, with different label settings.
  arXiv  Detail & Related papers  (2023-02-03T13:50:25Z)
• Feature Extraction and Prediction for Hand Hygiene Gestures with KNN Algorithm [0.0]
  This work focuses upon the analysis of hand gestures involved in the process of hand washing. Hand features such as contours of hands, the centroid of the hands, and extreme hand points along the largest contour are extracted.
  arXiv  Detail & Related papers  (2021-12-30T14:56:07Z)
• A Deep Learning Based Automated Hand Hygiene Training System [0.12313056815753944]
  WHO recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean. Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality. In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented.
  arXiv  Detail & Related papers  (2021-12-10T17:01:44Z)
• You Can Wash Hands Better: Accurate Daily Handwashing Assessment with Smartwatches [21.502362740250174]
  We propose UWash, a wearable solution with smartwatches, to assess handwashing procedures. We address the task of handwashing assessment from readings of motion sensors similar to the action segmentation problem in computer vision. Experiments over 51 subjects show that UWash achieves an accuracy of 92.27% on handwashing gesture recognition.
  arXiv  Detail & Related papers  (2021-12-09T12:23:06Z)
• WHO-Hand Hygiene Gesture Classification System [0.0]
  More than one million cases of hospital-acquired infections occur in Europe annually. Hand hygiene compliance may reduce the risk of transmission. Future aim is to deploy a hand hygiene prediction system for healthcare workers in real-time.
  arXiv  Detail & Related papers  (2021-10-06T15:15:10Z)
• Tracking Hand Hygiene Gestures with Leap Motion Controller [0.0]
  The process of hand washing, according to the WHO, is divided into stages with clearly defined two handed dynamic gestures. In this paper, videos of hand washing experts are segmented and analyzed with the goal of extracting their corresponding features. A 3D gesture tracker, the Leap Motion Controller (LEAP), was used to track and detect the hand features associated with these stages.
  arXiv  Detail & Related papers  (2021-08-11T08:48:39Z)
• Adversarial Motion Modelling helps Semi-supervised Hand Pose Estimation [116.07661813869196]
  We propose to combine ideas from adversarial training and motion modelling to tap into unlabeled videos. We show that an adversarial leads to better properties of the hand pose estimator via semi-supervised training on unlabeled video sequences. The main advantage of our approach is that we can make use of unpaired videos and joint sequence data both of which are much easier to attain than paired training data.
  arXiv  Detail & Related papers  (2021-06-10T17:50:19Z)
• Cascaded Robust Learning at Imperfect Labels for Chest X-ray Segmentation [61.09321488002978]
  We present a novel cascaded robust learning framework for chest X-ray segmentation with imperfect annotation. Our model consists of three independent network, which can effectively learn useful information from the peer networks. Our methods could achieve a significant improvement on the accuracy in segmentation tasks compared to the previous methods.
  arXiv  Detail & Related papers  (2021-04-05T15:50:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.