BEV-Net: Assessing Social Distancing Compliance by Joint People Localization and Geometric Reasoning

• URL: http://arxiv.org/abs/2110.04931v2
• Date: Tue, 12 Oct 2021 05:46:21 GMT
• Title: BEV-Net: Assessing Social Distancing Compliance by Joint People Localization and Geometric Reasoning
• Authors: Zhirui Dai, Yuepeng Jiang, Yi Li, Bo Liu, Antoni B. Chan, Nuno Vasconcelos
• Abstract summary: Social distancing, an essential public health measure, has gained significant attention since the outbreak of the COVID-19 pandemic. In this work, the problem of visual social distancing compliance assessment in busy public areas with wide field-of-view cameras is considered. A dataset of crowd scenes with people annotations under a bird's eye view (BEV) and ground truth for metric distances is introduced. A multi-branch network, BEV-Net, is proposed to localize individuals in world coordinates and identify high-risk regions where social distancing is violated.
• Score: 77.08836528980248
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Social distancing, an essential public health measure to limit the spread of contagious diseases, has gained significant attention since the outbreak of the COVID-19 pandemic. In this work, the problem of visual social distancing compliance assessment in busy public areas, with wide field-of-view cameras, is considered. A dataset of crowd scenes with people annotations under a bird's eye view (BEV) and ground truth for metric distances is introduced, and several measures for the evaluation of social distance detection systems are proposed. A multi-branch network, BEV-Net, is proposed to localize individuals in world coordinates and identify high-risk regions where social distancing is violated. BEV-Net combines detection of head and feet locations, camera pose estimation, a differentiable homography module to map image into BEV coordinates, and geometric reasoning to produce a BEV map of the people locations in the scene. Experiments on complex crowded scenes demonstrate the power of the approach and show superior performance over baselines derived from methods in the literature. Applications of interest for public health decision makers are finally discussed. Datasets, code and pretrained models are publicly available at GitHub.

Related papers

• Granularity at Scale: Estimating Neighborhood Socioeconomic Indicators from High-Resolution Orthographic Imagery and Hybrid Learning [1.8369448205408005]
  Overhead images can help fill in the gaps where community information is sparse. Recent advancements in machine learning and computer vision have made it possible to quickly extract features from and detect patterns in image data. In this work, we explore how well two approaches, a supervised convolutional neural network and semi-supervised clustering can estimate population density, median household income, and educational attainment.
  arXiv  Detail & Related papers  (2023-09-28T19:30:26Z)
• Monitoring Social-distance in Wide Areas during Pandemics: a Density Map and Segmentation Approach [0.0]
  We propose a new framework for monitoring the social-distance using end-to-end Deep Learning. Our framework consists in the creation of a new ground truth based on the ground truth density maps. We show that our framework performs well at providing the zones where people are not following the social-distance even when heavily occluded or far away from one camera.
  arXiv  Detail & Related papers  (2021-04-07T19:26:26Z)
• Automatic Social Distance Estimation From Images: Performance Evaluation, Test Benchmark, and Algorithm [78.88882860340797]
  COVID-19 virus has caused a global pandemic since March 2020. Maintaining a minimum of one meter distance from other people is strongly suggested to reduce the risk of infection. There is no suitable test benchmark for such algorithms.
  arXiv  Detail & Related papers  (2021-03-11T16:15:20Z)
• SD-Measure: A Social Distancing Detector [0.0]
  Social distancing has been adopted as a non-pharmaceutical prevention measure during the COVID-19 pandemic. This work proposes a novel framework named SD-Measure for detecting social distancing from video footages.
  arXiv  Detail & Related papers  (2020-11-04T15:47:14Z)
• Single Image Human Proxemics Estimation for Visual Social Distancing [37.84559773949066]
  We propose a semi-automatic solution to approximate the homography matrix between the scene ground and image plane. We then leverage an off-the-shelf pose detector to detect body poses on the image and to reason upon their inter-personal distances.
  arXiv  Detail & Related papers  (2020-11-03T21:49:13Z)
• DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection [53.40028068801092]
  We propose a novel one-stage HOI detection approach based on a new concept called interaction region for the HOI problem. Unlike previous methods, our approach concentrates on the densely sampled interaction regions across different scales for each human-object pair. In order to compensate for the detection flaws of a single interaction region, we introduce a novel voting strategy.
  arXiv  Detail & Related papers  (2020-10-02T13:57:58Z)
• Perceiving Humans: from Monocular 3D Localization to Social Distancing [93.03056743850141]
  We present a new cost-effective vision-based method that perceives humans' locations in 3D and their body orientation from a single image. We show that it is possible to rethink the concept of "social distancing" as a form of social interaction in contrast to a simple location-based rule.
  arXiv  Detail & Related papers  (2020-09-01T10:12:30Z)
• DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 Pandemic [1.027974860479791]
  Social distancing is a recommended solution by the World Health Organisation (WHO) to minimise the spread of COVID-19 in public places. We develop a hybrid Computer Vision and YOLOv4-based Deep Neural Network model for automated people detection in the crowd using common CCTV cameras. The developed model is a generic and accurate people detection and tracking solution that can be applied in many other fields.
  arXiv  Detail & Related papers  (2020-08-26T16:56:57Z)
• HDNet: Human Depth Estimation for Multi-Person Camera-Space Localization [83.57863764231655]
  We propose the Human Depth Estimation Network (HDNet), an end-to-end framework for absolute root joint localization. A skeleton-based Graph Neural Network (GNN) is utilized to propagate features among joints. We evaluate our HDNet on the root joint localization and root-relative 3D pose estimation tasks with two benchmark datasets.
  arXiv  Detail & Related papers  (2020-07-17T12:44:23Z)
• Peeking into occluded joints: A novel framework for crowd pose estimation [88.56203133287865]
  OPEC-Net is an Image-Guided Progressive GCN module that estimates invisible joints from an inference perspective. OCPose is the most complex Occluded Pose dataset with respect to average IoU between adjacent instances.
  arXiv  Detail & Related papers  (2020-03-23T19:32:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.