Fine-Grained Crowd Counting

• URL: http://arxiv.org/abs/2007.06146v1
• Date: Mon, 13 Jul 2020 01:31:12 GMT
• Title: Fine-Grained Crowd Counting
• Authors: Jia Wan, Nikil Senthil Kumar, Antoni B. Chan
• Abstract summary: Current crowd counting algorithms are only concerned with the number of people in an image. We propose fine-grained crowd counting, which differentiates a crowd into categories based on the low-level behavior attributes of the individuals.
• Score: 59.63412475367119
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Current crowd counting algorithms are only concerned about the number of people in an image, which lacks low-level fine-grained information of the crowd. For many practical applications, the total number of people in an image is not as useful as the number of people in each sub-category. E.g., knowing the number of people waiting inline or browsing can help retail stores; knowing the number of people standing/sitting can help restaurants/cafeterias; knowing the number of violent/non-violent people can help police in crowd management. In this paper, we propose fine-grained crowd counting, which differentiates a crowd into categories based on the low-level behavior attributes of the individuals (e.g. standing/sitting or violent behavior) and then counts the number of people in each category. To enable research in this area, we construct a new dataset of four real-world fine-grained counting tasks: traveling direction on a sidewalk, standing or sitting, waiting in line or not, and exhibiting violent behavior or not. Since the appearance features of different crowd categories are similar, the challenge of fine-grained crowd counting is to effectively utilize contextual information to distinguish between categories. We propose a two branch architecture, consisting of a density map estimation branch and a semantic segmentation branch. We propose two refinement strategies for improving the predictions of the two branches. First, to encode contextual information, we propose feature propagation guided by the density map prediction, which eliminates the effect of background features during propagation. Second, we propose a complementary attention model to share information between the two branches. Experiment results confirm the effectiveness of our method.

Related papers

• CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Model [60.30099369475092]
  Supervised crowd counting relies heavily on costly manual labeling. We propose a novel unsupervised framework for crowd counting, named CrowdCLIP. CrowdCLIP achieves superior performance compared to previous unsupervised state-of-the-art counting methods.
  arXiv  Detail & Related papers  (2023-04-09T12:56:54Z)
• Glance to Count: Learning to Rank with Anchors for Weakly-supervised Crowd Counting [43.446730359817515]
  Crowd image is arguably one of the most laborious data to annotate. We propose a novel weakly-supervised setting, in which we leverage the binary ranking of two images with high-contrast crowd counts as training guidance. We conduct extensive experiments to study various combinations of supervision, and we show that the proposed method outperforms existing weakly-supervised methods by a large margin.
  arXiv  Detail & Related papers  (2022-05-29T13:39:34Z)
• CrowdFormer: Weakly-supervised Crowd counting with Improved Generalizability [2.8174125805742416]
  We propose a weakly-supervised method for crowd counting using a pyramid vision transformer. Our method is comparable to the state-of-the-art on the benchmark crowd datasets.
  arXiv  Detail & Related papers  (2022-03-07T23:10:40Z)
• BBA-net: A bi-branch attention network for crowd counting [25.82337203107288]
  Current CNN-based regression methods simply extract the density information of pedestrians without finding the position of each person. We propose a Bi-Branch Attention Network (BBA-NET) for crowd counting, which has three innovation points. Our method achieves a lower crowd counting error compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-01-22T07:30:52Z)
• Cascaded Residual Density Network for Crowd Counting [63.714719914701014]
  We propose a novel Cascaded Residual Density Network (CRDNet) in a coarse-to-fine approach to generate the high-quality density map for crowd counting more accurately. A novel additional local count loss is presented to refine the accuracy of crowd counting.
  arXiv  Detail & Related papers  (2021-07-29T03:07:11Z)
• Region-Aware Network: Model Human's Top-Down Visual Perception Mechanism for Crowd Counting [33.09330894823192]
  Background noise and scale variation are common problems that have been long recognized in crowd counting. We propose a novel feedback network with Region-Aware block called RANet by modeling human's Top-Down visual perception mechanism. Our method outperforms state-of-the-art crowd counting methods on several public datasets.
  arXiv  Detail & Related papers  (2021-06-23T05:11:58Z)
• A Study of Human Gaze Behavior During Visual Crowd Counting [40.59955546629333]
  Using an eye tracker, we collect gaze behavior of human participants tasked with counting the number of people in crowd images. We observe some common approaches for visual counting. In terms of count accuracy, our human participants are not as good at the counting task, compared to the performance of the current state-of-the-art computer algorithms.
  arXiv  Detail & Related papers  (2020-09-14T15:05:13Z)
• Completely Self-Supervised Crowd Counting via Distribution Matching [92.09218454377395]
  We propose a complete self-supervision approach to training models for dense crowd counting. The only input required to train, apart from a large set of unlabeled crowd images, is the approximate upper limit of the crowd count. Our method dwells on the idea that natural crowds follow a power law distribution, which could be leveraged to yield error signals for backpropagation.
  arXiv  Detail & Related papers  (2020-09-14T13:20:12Z)
• Semi-Supervised Crowd Counting via Self-Training on Surrogate Tasks [50.78037828213118]
  This paper tackles the semi-supervised crowd counting problem from the perspective of feature learning. We propose a novel semi-supervised crowd counting method which is built upon two innovative components.
  arXiv  Detail & Related papers  (2020-07-07T05:30:53Z)
• CNN-based Density Estimation and Crowd Counting: A Survey [65.06491415951193]
  This paper comprehensively studies the crowd counting models, mainly CNN-based density map estimation methods. According to the evaluation metrics, we select the top three performers on their crowd counting datasets. We expect to make reasonable inference and prediction for the future development of crowd counting.
  arXiv  Detail & Related papers  (2020-03-28T13:17:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.