A Computer Vision System to Help Prevent the Transmission of COVID-19

• URL: http://arxiv.org/abs/2103.08773v1
• Date: Tue, 16 Mar 2021 00:00:04 GMT
• Title: A Computer Vision System to Help Prevent the Transmission of COVID-19
• Authors: Fevziye Irem Eyiokur, Haz{\i}m Kemal Ekenel, Alexander Waibel
• Abstract summary: The COVID-19 pandemic affects every area of daily life globally. Health organizations advise social distancing, wearing face mask, and avoiding touching face. We developed a deep learning-based computer vision system to help prevent the transmission of COVID-19.
• Score: 79.62140902232628
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The COVID-19 pandemic affects every area of daily life globally. To avoid the spread of coronavirus and retrieve the daily normal worldwide, health organizations advise social distancing, wearing face mask, and avoiding touching face. Based on these recommended protective measures, we developed a deep learning-based computer vision system to help prevent the transmission of COVID-19. Specifically, the developed system performs face mask detection, face-hand interaction detection, and measures social distance. For these purposes, we collected and annotated images that represent face mask usage and face-hand interaction in the real world. We presented two different face datasets, namely Unconstrained Face Mask Dataset (UFMD) and Unconstrained Face Hand Dataset (UFHD). We trained the proposed models on our own datasets and evaluated them on both our datasets and already existing datasets in the literature without performing any adaptation on these target datasets. Besides, we proposed a distance measurement module to track social distance between people. Experimental results indicate that UFMD and UFHD represent the real-world's diversity well. The proposed system achieved very high performance and generalization capacity in a real-world scenario for unseen data from outside the training data to detect face mask usage and face-hand interaction, and satisfactory performance in the case of tracking social distance. Presented UFMD and UFHD datasets will be available at https://github.com/iremeyiokur/COVID-19-Preventions-Control-System.

Related papers

• Masked Student Dataset of Expressions [1.52292571922932]
  We present a novel dataset consisting of 1,960 real-world non-masked and masked facial expression images collected from 142 individuals. Along with the issue of obfuscated facial features, we illustrate how other subtler issues in masked FER are represented in our dataset. To tackle this, we test two training paradigms: contrastive learning and knowledge distillation, and find that they increase the model's performance in the masked scenario while maintaining its non-masked performance.
  arXiv  Detail & Related papers  (2023-04-07T23:43:21Z)
• A Survey on Computer Vision based Human Analysis in the COVID-19 Era [58.79053747159797]
  The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications. These developments triggered the need for novel and improved computer vision techniques capable of (i) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and (ii) facilitating normal operation of existing vision-based services, such as biometric authentication
  arXiv  Detail & Related papers  (2022-11-07T17:20:39Z)
• Bias-Aware Face Mask Detection Dataset [11.400704308166805]
  We present a novel face mask detection dataset that contains images posted on Twitter during the pandemic from around the world. Unlike previous datasets, the proposed Bias-Aware Face Mask Detection dataset contains more images from underrepresented race and age groups.
  arXiv  Detail & Related papers  (2022-11-02T15:38:31Z)
• Cluster-level pseudo-labelling for source-free cross-domain facial expression recognition [94.56304526014875]
  We propose the first Source-Free Unsupervised Domain Adaptation (SFUDA) method for Facial Expression Recognition (FER) Our method exploits self-supervised pretraining to learn good feature representations from the target data. We validate the effectiveness of our method in four adaptation setups, proving that it consistently outperforms existing SFUDA methods when applied to FER.
  arXiv  Detail & Related papers  (2022-10-11T08:24:50Z)
• Multiface: A Dataset for Neural Face Rendering [108.44505415073579]
  In this work, we present Multiface, a new multi-view, high-resolution human face dataset. We introduce Mugsy, a large scale multi-camera apparatus to capture high-resolution synchronized videos of a facial performance. The goal of Multiface is to close the gap in accessibility to high quality data in the academic community and to enable research in VR telepresence.
  arXiv  Detail & Related papers  (2022-07-22T17:55:39Z)
• Facial Emotion Recognition using Deep Residual Networks in Real-World Environments [5.834678345946704]
  We propose a facial feature extractor model trained on an in-the-wild and massively collected video dataset. The dataset consists of a million labelled frames and 2,616 thousand subjects. As temporal information is important to the emotion recognition domain, we utilise LSTM cells to capture the temporal dynamics in the data.
  arXiv  Detail & Related papers  (2021-11-04T10:08:22Z)
• TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
  TRiPOD is a novel method for predicting body dynamics based on graph attentional networks. To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame. Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
  arXiv  Detail & Related papers  (2021-04-08T20:01:00Z)
• Masked Face Recognition for Secure Authentication [2.429066522170765]
  Masked faces make it difficult to be detected and recognized, thereby threatening to make the in-house datasets invalid. We present an open-source tool, MaskTheFace to mask faces effectively creating a large dataset of masked faces. We report an increase of 38% in the true positive rate for the Facenet system.
  arXiv  Detail & Related papers  (2020-08-25T15:33:59Z)
• Federated Face Presentation Attack Detection [93.25058425356694]
  Face presentation attack detection (fPAD) plays a critical role in the modern face recognition pipeline. We propose Federated Face Presentation Attack Detection (FedPAD) framework. FedPAD simultaneously takes advantage of rich fPAD information available at different data owners while preserving data privacy.
  arXiv  Detail & Related papers  (2020-05-29T15:56:01Z)
• Masked Face Recognition Dataset and Application [28.2082082956263]
  This work proposes three types of masked face datasets, including Masked Face Detection dataset (MFDD), Real-world Masked Face Recognition dataset (RMFRD) and Simulated Masked Face Recognition dataset (SMFRD) The multi-granularity masked face recognition model we developed achieves 95% accuracy, exceeding the results reported by the industry.
  arXiv  Detail & Related papers  (2020-03-20T04:15:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.