Towards On-Device Face Recognition in Body-worn Cameras

• URL: http://arxiv.org/abs/2104.03419v1
• Date: Wed, 7 Apr 2021 22:24:57 GMT
• Title: Towards On-Device Face Recognition in Body-worn Cameras
• Authors: Ali Almadan and Ajita Rattani
• Abstract summary: This study evaluates lightweight MobileNet-V2, EfficientNet-B0, LightCNN-9 and LightCNN-29 models for face identification using body-worn camera. Experiments are performed on a publicly available BWCface dataset.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Face recognition technology related to recognizing identities is widely adopted in intelligence gathering, law enforcement, surveillance, and consumer applications. Recently, this technology has been ported to smartphones and body-worn cameras (BWC). Face recognition technology in body-worn cameras is used for surveillance, situational awareness, and keeping the officer safe. Only a handful of academic studies exist in face recognition using the body-worn camera. A recent study has assembled BWCFace facial image dataset acquired using a body-worn camera and evaluated the ResNet-50 model for face identification. However, for real-time inference in resource constraint body-worn cameras and privacy concerns involving facial images, on-device face recognition is required. To this end, this study evaluates lightweight MobileNet-V2, EfficientNet-B0, LightCNN-9 and LightCNN-29 models for face identification using body-worn camera. Experiments are performed on a publicly available BWCface dataset. The real-time inference is evaluated on three mobile devices. The comparative analysis is done with heavy-weight VGG-16 and ResNet-50 models along with six hand-crafted features to evaluate the trade-off between the performance and model size. Experimental results suggest the difference in maximum rank-1 accuracy of lightweight LightCNN-29 over best-performing ResNet-50 is \textbf{1.85\%} and the reduction in model parameters is \textbf{23.49M}. Most of the deep models obtained similar performances at rank-5 and rank-10. The inference time of LightCNNs is 2.1x faster than other models on mobile devices. The least performance difference of \textbf{14\%} is noted between LightCNN-29 and Local Phase Quantization (LPQ) descriptor at rank-1. In most of the experimental settings, lightweight LightCNN models offered the best trade-off between accuracy and the model size in comparison to most of the models.

Related papers

• SqueezerFaceNet: Reducing a Small Face Recognition CNN Even More Via Filter Pruning [55.84746218227712]
  We develop SqueezerFaceNet, a light face recognition network which less than 1M parameters. We show that it can be further reduced (up to 40%) without an appreciable loss in performance.
  arXiv  Detail & Related papers  (2023-07-20T08:38:50Z)
• Convolutional Neural Network Based Partial Face Detection [0.0]
  This study aims to create and enhance a machine learning model that correctly recognizes faces. After creating and running the model, Multi-Task Convolutional Neural Network (MTCNN) achieved 96.2% best model accuracy.
  arXiv  Detail & Related papers  (2022-06-29T01:26:40Z)
• WebFace260M: A Benchmark for Million-Scale Deep Face Recognition [89.39080252029386]
  We contribute a new million-scale recognition benchmark, containing uncurated 4M identities/260M faces (WebFace260M) and cleaned 2M identities/42M faces (WebFace42M) A distributed framework is developed to train face recognition models efficiently without tampering with the performance. The proposed benchmark shows enormous potential on standard, masked and unbiased face recognition scenarios.
  arXiv  Detail & Related papers  (2022-04-21T14:56:53Z)
• YOLO5Face: Why Reinventing a Face Detector [1.3272510644778104]
  We implement a face detector based on YOLOv5 object detector and call it YOLO5Face. We design detectors with different model sizes to achieve the best performance. Experiment results on the WiderFace dataset show that our face detectors can achieve state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-05-27T03:54:38Z)
• FedFace: Collaborative Learning of Face Recognition Model [66.84737075622421]
  FedFace is a framework for collaborative learning of face recognition models. It learns an accurate and generalizable face recognition model where the face images stored at each client are neither shared with other clients nor the central host. Our code and pre-trained models will be publicly available.
  arXiv  Detail & Related papers  (2021-04-07T09:25:32Z)
• Facial Masks and Soft-Biometrics: Leveraging Face Recognition CNNs for Age and Gender Prediction on Mobile Ocular Images [53.913598771836924]
  We address the use of selfie ocular images captured with smartphones to estimate age and gender. We adapt two existing lightweight CNNs proposed in the context of the ImageNet Challenge. Some networks are further pre-trained for face recognition, for which very large training databases are available.
  arXiv  Detail & Related papers  (2021-03-31T01:48:29Z)
• WebFace260M: A Benchmark Unveiling the Power of Million-Scale Deep Face Recognition [79.65728162193584]
  We contribute a new million-scale face benchmark containing noisy 4M identities/260M faces (WebFace260M) and cleaned 2M identities/42M faces (WebFace42M) We reduce relative 40% failure rate on the challenging IJB-C set, and ranks the 3rd among 430 entries on NIST-FRVT. Even 10% data (WebFace4M) shows superior performance compared with public training set.
  arXiv  Detail & Related papers  (2021-03-06T11:12:43Z)
• BWCFace: Open-set Face Recognition using Body-worn Camera [0.8594140167290097]
  This paper aims to bridge the gap in the state-of-the-art face recognition using bodyworn cameras (BWC) The contribution of this work is two-fold: (1) collection of a dataset called BWCFace consisting of a total of 178K facial images of 132 subjects captured using the body-worn camera in in-door and daylight conditions, and (2) open-set evaluation of the latest deep-learning-based Convolutional Neural Network (CNN) architectures combined with five different loss functions for face identification.
  arXiv  Detail & Related papers  (2020-09-24T02:45:29Z)
• SqueezeFacePoseNet: Lightweight Face Verification Across Different Poses for Mobile Platforms [55.84746218227712]
  Face verification technologies can provide reliable and robust user authentication, given the availability of cameras in mobile devices. Deep Convolutional Neural Networks have resulted in many accurate face verification architectures, but their typical size (hundreds of megabytes) makes them infeasible to be incorporated in downloadable mobile applications. We develop a lightweight face recognition network of just a few megabytes that can operate with sufficient accuracy in comparison to much larger models.
  arXiv  Detail & Related papers  (2020-07-16T19:02:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.