Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank

• URL: http://arxiv.org/abs/2404.19299v1
• Date: Tue, 30 Apr 2024 07:01:05 GMT
• Title: Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank
• Authors: Sungjune Park, Hyunjun Kim, Yong Man Ro,
• Abstract summary: We propose a novel approach to construct versatile pedestrian knowledge bank. We extract pedestrian knowledge from a large-scale pretrained model. We then curate them by quantizing most representative features and guiding them to be distinguishable from background scenes.
• Score: 51.66174565170112
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pedestrian detection is a crucial field of computer vision research which can be adopted in various real-world applications (e.g., self-driving systems). However, despite noticeable evolution of pedestrian detection, pedestrian representations learned within a detection framework are usually limited to particular scene data in which they were trained. Therefore, in this paper, we propose a novel approach to construct versatile pedestrian knowledge bank containing representative pedestrian knowledge which can be applicable to various detection frameworks and adopted in diverse scenes. We extract generalized pedestrian knowledge from a large-scale pretrained model, and we curate them by quantizing most representative features and guiding them to be distinguishable from background scenes. Finally, we construct versatile pedestrian knowledge bank which is composed of such representations, and then we leverage it to complement and enhance pedestrian features within a pedestrian detection framework. Through comprehensive experiments, we validate the effectiveness of our method, demonstrating its versatility and outperforming state-of-the-art detection performances.

Related papers

• Leveraging Mixture of Experts for Improved Speech Deepfake Detection [53.69740463004446]
  Speech deepfakes pose a significant threat to personal security and content authenticity. We introduce a novel approach for enhancing speech deepfake detection performance using a Mixture of Experts architecture.
  arXiv  Detail & Related papers  (2024-09-24T13:24:03Z)
• Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection [51.66174565170112]
  We introduce a novel approach to utilize the strengths of large language models in understanding contextual appearance variations. We propose to formulate language-derived appearance elements and incorporate them with visual cues in pedestrian detection.
  arXiv  Detail & Related papers  (2023-11-02T06:38:19Z)
• Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond [82.37430109152383]
  We show that, current pedestrian detectors poorly handle even small domain shifts in cross-dataset evaluation. We attribute the limited generalization to two main factors, the method and the current sources of data. We propose a progressive fine-tuning strategy which improves generalization.
  arXiv  Detail & Related papers  (2022-01-10T06:00:26Z)
• Corner Cases for Visual Perception in Automated Driving: Some Guidance on Detection Approaches [25.17917252608398]
  Corner cases are unexpected and unknown situations that occur while driving. Their detection is highly safety-critical, and detection methods can be applied to vast amounts of collected data to select suitable training data. In this work, we continue a previous systematization of corner cases on different levels by an extended set of examples for each level.
  arXiv  Detail & Related papers  (2021-02-11T09:06:13Z)
• From Handcrafted to Deep Features for Pedestrian Detection: A Survey [148.35460817092908]
  Pedestrian detection is an important but challenging problem in computer vision. Over the past decade, significant improvement has been witnessed with the help of handcrafted features and deep features. In addition to single-spectral pedestrian detection, we also review multi-spectral pedestrian detection.
  arXiv  Detail & Related papers  (2020-10-01T14:51:10Z)
• Generalizable Pedestrian Detection: The Elephant In The Room [82.37430109152383]
  We find that existing state-of-the-art pedestrian detectors, though perform quite well when trained and tested on the same dataset, generalize poorly in cross dataset evaluation. We illustrate that diverse and dense datasets, collected by crawling the web, serve to be an efficient source of pre-training for pedestrian detection.
  arXiv  Detail & Related papers  (2020-03-19T14:14:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.