Whole-body Detection, Recognition and Identification at Altitude and Range

• URL: http://arxiv.org/abs/2311.05725v1
• Date: Thu, 9 Nov 2023 20:20:23 GMT
• Title: Whole-body Detection, Recognition and Identification at Altitude and Range
• Authors: Siyuan Huang, Ram Prabhakar Kathirvel, Chun Pong Lau, Rama Chellappa
• Abstract summary: We propose an end-to-end system evaluated on diverse datasets. Our approach involves pre-training the detector on common image datasets and fine-tuning it on BRIAR's complex videos and images. We conduct thorough evaluations under various conditions, such as different ranges and angles in indoor, outdoor, and aerial scenarios.
• Score: 57.445372305202405
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we address the challenging task of whole-body biometric detection, recognition, and identification at distances of up to 500m and large pitch angles of up to 50 degree. We propose an end-to-end system evaluated on diverse datasets, including the challenging Biometric Recognition and Identification at Range (BRIAR) dataset. Our approach involves pre-training the detector on common image datasets and fine-tuning it on BRIAR's complex videos and images. After detection, we extract body images and employ a feature extractor for recognition. We conduct thorough evaluations under various conditions, such as different ranges and angles in indoor, outdoor, and aerial scenarios. Our method achieves an average F1 score of 98.29% at IoU = 0.7 and demonstrates strong performance in recognition accuracy and true acceptance rate at low false acceptance rates compared to existing models. On a test set of 100 subjects with 444 distractors, our model achieves a rank-20 recognition accuracy of 75.13% and a TAR@1%FAR of 54.09%.

Related papers

• DailyDVS-200: A Comprehensive Benchmark Dataset for Event-Based Action Recognition [51.96660522869841]
  DailyDVS-200 is a benchmark dataset tailored for the event-based action recognition community. It covers 200 action categories across real-world scenarios, recorded by 47 participants, and comprises more than 22,000 event sequences. DailyDVS-200 is annotated with 14 attributes, ensuring a detailed characterization of the recorded actions.
  arXiv  Detail & Related papers  (2024-07-06T15:25:10Z)
• Detecting and recognizing characters in Greek papyri with YOLOv8, DeiT and SimCLR [9.7902367664742]
  This paper discusses our submission to the ICDAR 2023 Competition on Detection and Recognition of Greek Letters on Papyri' We used an ensemble of YOLOv8 models to detect and classify individual characters and employed two different approaches for refining the character predictions. Our submission won the recognition challenge with a mAP of 42.2%, and was runner-up in the detection challenge with a mean average precision (mAP) of 51.4%.
  arXiv  Detail & Related papers  (2024-01-23T06:08:00Z)
• One-Shot Learning for Periocular Recognition: Exploring the Effect of Domain Adaptation and Data Bias on Deep Representations [59.17685450892182]
  We investigate the behavior of deep representations in widely used CNN models under extreme data scarcity for One-Shot periocular recognition. We improved state-of-the-art results that made use of networks trained with biometric datasets with millions of images. Traditional algorithms like SIFT can outperform CNNs in situations with limited data.
  arXiv  Detail & Related papers  (2023-07-11T09:10:16Z)
• Improving CNN-based Person Re-identification using score Normalization [2.462953128215087]
  This paper proposes a novel approach for PRe-ID, which combines a CNN based feature extraction method with Cross-view Quadratic Discriminant Analysis (XQDA) for metric learning. The proposed approach is tested on four challenging datasets, including VIPeR, GRID, CUHK01, VIPeR and PRID450S.
  arXiv  Detail & Related papers  (2023-07-01T18:12:27Z)
• FarSight: A Physics-Driven Whole-Body Biometric System at Large Distance and Altitude [67.55994773068191]
  This paper presents the end-to-end design, development and evaluation of FarSight. FarSight is an innovative software system designed for whole-body (fusion of face, gait and body shape) biometric recognition. We test FarSight's effectiveness using the newly acquired IARPA Biometric Recognition and Identification at Altitude and Range dataset.
  arXiv  Detail & Related papers  (2023-06-29T16:14:27Z)
• End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation [86.41437210485932]
  We aim at advancing zero-shot HOI detection to detect both seen and unseen HOIs simultaneously. We propose a novel end-to-end zero-shot HOI Detection framework via vision-language knowledge distillation. Our method outperforms the previous SOTA by 8.92% on unseen mAP and 10.18% on overall mAP.
  arXiv  Detail & Related papers  (2022-04-01T07:27:19Z)
• Deep learning for identification and face, gender, expression recognition under constraints [1.2647816797166165]
  Deep convolutional neural network (CNN) is used in this work to extract the features from veiled-person face images. The main objective of this work is to test the ability of deep learning based automated computer system to identify not only persons, but also to perform recognition of gender, age, and facial expressions such as eye smile.
  arXiv  Detail & Related papers  (2021-11-02T22:45:09Z)
• End-to-End Semi-Supervised Object Detection with Soft Teacher [63.26266730447914]
  This paper presents an end-to-end semi-supervised object detection approach, in contrast to previous more complex multi-stage methods. The proposed approach outperforms previous methods by a large margin under various labeling ratios. On the state-of-the-art Swin Transformer-based object detector, it can still significantly improve the detection accuracy by +1.5 mAP.
  arXiv  Detail & Related papers  (2021-06-16T17:59:30Z)
• Neighbourhood-guided Feature Reconstruction for Occluded Person Re-Identification [45.704612531562404]
  We propose to reconstruct the feature representation of occluded parts by fully exploiting the information of its neighborhood in a gallery image set. In the large-scale Occluded-DukeMTMC benchmark, our approach achieves 64.2% mAP and 67.6% rank-1 accuracy.
  arXiv  Detail & Related papers  (2021-05-16T03:53:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.