Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network

• URL: http://arxiv.org/abs/2003.09087v1
• Date: Fri, 20 Mar 2020 03:18:15 GMT
• Title: Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network
• Authors: Minjee Kim, Joonmyeong Choi, Namkug Kim
• Abstract summary: Hand hygiene is one of the most significant factors in preventing hospital acquired infections (HAI) Recent progress in understanding with convolutional neural net (CNN) has increased the application of recognition and detection of human actions. We propose a fully automated hand hygiene monitoring tool of the alcohol-based hand rubbing action of anesthesiologists on OR video usingtemporal features with 3D CNN.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hand hygiene is one of the most significant factors in preventing hospital acquired infections (HAI) which often be transmitted by medical staffs in contact with patients in the operating room (OR). Hand hygiene monitoring could be important to investigate and reduce the outbreak of infections within the OR. However, an effective monitoring tool for hand hygiene compliance is difficult to develop due to the visual complexity of the OR scene. Recent progress in video understanding with convolutional neural net (CNN) has increased the application of recognition and detection of human actions. Leveraging this progress, we proposed a fully automated hand hygiene monitoring tool of the alcohol-based hand rubbing action of anesthesiologists on OR video using spatio-temporal features with 3D CNN. First, the region of interest (ROI) of anesthesiologists' upper body were detected and cropped. A temporal smoothing filter was applied to the ROIs. Then, the ROIs were given to a 3D CNN and classified into two classes: rubbing hands or other actions. We observed that a transfer learning from Kinetics-400 is beneficial and the optical flow stream was not helpful in our dataset. The final accuracy, precision, recall and F1 score in testing is 0.76, 0.85, 0.65 and 0.74, respectively.

Related papers

• A Multi-View Pipeline and Benchmark Dataset for 3D Hand Pose Estimation in Surgery [1.120882117110929]
  We propose a robust pipeline for 3D hand pose estimation in surgical contexts.<n>The pipeline integrates reliable person detection, whole-body pose estimation, and state-of-the-art 2D hand keypoint prediction.<n>We introduce a novel surgical benchmark dataset comprising over 68,000 frames and 3,000 manually annotated 2D hand poses.
  arXiv  Detail & Related papers  (2026-01-22T12:48:24Z)
• Automatic Tissue Differentiation in Parotidectomy using Hyperspectral Imaging [43.158227137013874]
  A 3D Convolutional Neural Network with hyperspectral data in the range of $400-1000$ nm is used in this work.<n>The acquisition system consisted of two multispectral snapshot cameras creating a stereo-HSI-system.
  arXiv  Detail & Related papers  (2024-12-06T09:20:59Z)
• CSI-Based Efficient Self-Quarantine Monitoring System Using Branchy Convolution Neural Network [2.609279398946235]
  We propose a Wi-Fi-based device-free self-quarantine monitoring system. We exploit channel state information (CSI) derived from Wi-Fi signals as human activity features. Our experimental results indicate that the proposed model can achieve an average accuracy of 98.19% for classifying five different human activities.
  arXiv  Detail & Related papers  (2023-05-24T04:02:49Z)
• Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
  We propose a framework for autonomous robotic navigation for subretinal injection. Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target. Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
  arXiv  Detail & Related papers  (2023-01-17T21:41:21Z)
• AI-based Clinical Assessment of Optic Nerve Head Robustness Superseding Biomechanical Testing [54.306443917863355]
  We propose an AI-driven approach that can assess the robustness of a given ONH solely from a single OCT scan of the ONH. Longitudinal studies should establish whether ONH robustness could help us identify fast visual field loss progressors.
  arXiv  Detail & Related papers  (2022-06-09T11:29:28Z)
• Artificial Intelligence Enables Real-Time and Intuitive Control of Prostheses via Nerve Interface [25.870454492249863]
  The next generation prosthetic hand that moves and feels like a real hand requires a robust neural interconnection between the human minds and machines. Here we present a neuroprosthetic system to demonstrate that principle by employing an artificial intelligence (AI) agent to translate the amputee's movement intent through a peripheral nerve interface.
  arXiv  Detail & Related papers  (2022-03-16T14:33:38Z)
• A Deep Learning Based Automated Hand Hygiene Training System [0.12313056815753944]
  WHO recommends a guideline for alcohol-based hand rub in eight steps to ensure that all surfaces of hands are entirely clean. Deep Neural Network (DNN) and machine vision have made it possible to accurately evaluate hand rubbing quality. In this paper, an automated deep learning based hand rub assessment system with real-time feedback is presented.
  arXiv  Detail & Related papers  (2021-12-10T17:01:44Z)
• Overcoming the Domain Gap in Neural Action Representations [60.47807856873544]
  3D pose data can now be reliably extracted from multi-view video sequences without manual intervention. We propose to use it to guide the encoding of neural action representations together with a set of neural and behavioral augmentations. To reduce the domain gap, during training, we swap neural and behavioral data across animals that seem to be performing similar actions.
  arXiv  Detail & Related papers  (2021-12-02T12:45:46Z)
• A Deep Learning Approach to Predicting Collateral Flow in Stroke Patients Using Radiomic Features from Perfusion Images [58.17507437526425]
  Collateral circulation results from specialized anastomotic channels which provide oxygenated blood to regions with compromised blood flow. The actual grading is mostly done through manual inspection of the acquired images. We present a deep learning approach to predicting collateral flow grading in stroke patients based on radiomic features extracted from MR perfusion data.
  arXiv  Detail & Related papers  (2021-10-24T18:58:40Z)
• 3D Convolutional Neural Networks for Stalled Brain Capillary Detection [72.21315180830733]
  Brain vasculature dysfunctions such as stalled blood flow in cerebral capillaries are associated with cognitive decline and pathogenesis in Alzheimer's disease. Here, we describe a deep learning-based approach for automatic detection of stalled capillaries in brain images based on 3D convolutional neural networks. In this setting, our approach outperformed other methods and demonstrated state-of-the-art results, achieving 0.85 Matthews correlation coefficient, 85% sensitivity, and 99.3% specificity.
  arXiv  Detail & Related papers  (2021-04-04T20:30:14Z)
• Mapping Surgeon's Hand/Finger Motion During Conventional Microsurgery to Enhance Intuitive Surgical Robot Teleoperation [0.5635300481123077]
  Current human-robot interfaces lack intuitive teleoperation and cannot mimic surgeon's hand/finger sensing and fine motion. We report a pilot study showing an intuitive way of recording and mapping surgeon's gross hand motion and the fine synergic motion during cardiac micro-surgery.
  arXiv  Detail & Related papers  (2021-02-21T11:21:30Z)
• Where is my hand? Deep hand segmentation for visual self-recognition in humanoid robots [129.46920552019247]
  We propose the use of a Convolution Neural Network (CNN) to segment the robot hand from an image in an egocentric view. We fine-tuned the Mask-RCNN network for the specific task of segmenting the hand of the humanoid robot Vizzy.
  arXiv  Detail & Related papers  (2021-02-09T10:34:32Z)
• Automated Quality Assessment of Hand Washing Using Deep Learning [1.8920934738244022]
  We present neural networks for automatically recognizing the different washing movements defined by the WHO. We train the neural network on a part of a large (2000+ videos) real-world labeled dataset with the different washing movements. Using pre-trained neural network models such as MobileNetV2 and Xception for the task, it is possible to achieve >64 % accuracy in recognizing the different washing movements.
  arXiv  Detail & Related papers  (2020-11-23T13:22:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.