Joint Person Identity, Gender and Age Estimation from Hand Images using Deep Multi-Task Representation Learning
- URL: http://arxiv.org/abs/2303.15263v4
- Date: Wed, 20 Mar 2024 12:39:28 GMT
- Title: Joint Person Identity, Gender and Age Estimation from Hand Images using Deep Multi-Task Representation Learning
- Authors: Nathanael L. Baisa,
- Abstract summary: We propose a multi-task representation learning framework to jointly estimate the identity, gender and age of individuals from their hand images.
We make extensive evaluations and comparisons of both convolution-based and transformer-based deep learning architectures on a publicly available 11k hands dataset.
Our experimental analysis shows that it is possible to efficiently estimate not only identity but also other attributes such as gender and age of suspects jointly from hand images.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose a multi-task representation learning framework to jointly estimate the identity, gender and age of individuals from their hand images for the purpose of criminal investigations since the hand images are often the only available information in cases of serious crime such as sexual abuse. We investigate different up-to-date deep learning architectures and compare their performance for joint estimation of identity, gender and age from hand images of perpetrators of serious crime. To simplify the age prediction, we create age groups for the age estimation. We make extensive evaluations and comparisons of both convolution-based and transformer-based deep learning architectures on a publicly available 11k hands dataset. Our experimental analysis shows that it is possible to efficiently estimate not only identity but also other attributes such as gender and age of suspects jointly from hand images for criminal investigations, which is crucial in assisting international police forces in the court to identify and convict abusers.
Related papers
- Individualized Deepfake Detection Exploiting Traces Due to Double
Neural-Network Operations [32.33331065408444]
Existing deepfake detectors are not optimized for this detection task when an image is associated with a specific and identifiable individual.
This study focuses on the deepfake detection of facial images of individual public figures.
We demonstrate that the detection performance can be improved by exploiting the idempotency property of neural networks.
arXiv Detail & Related papers (2023-12-13T10:21:00Z) - There is a Time and Place for Reasoning Beyond the Image [63.96498435923328]
Images often more significant than only the pixels to human eyes, as we can infer, associate, and reason with contextual information from other sources to establish a more complete picture.
We introduce TARA: a dataset with 16k images with their associated news, time and location automatically extracted from New York Times (NYT), and an additional 61k examples as distant supervision from WIT.
We show that there exists a 70% gap between a state-of-the-art joint model and human performance, which is slightly filled by our proposed model that uses segment-wise reasoning, motivating higher-level vision-language joint models that
arXiv Detail & Related papers (2022-03-01T21:52:08Z) - Applying Artificial Intelligence for Age Estimation in Digital Forensic
Investigations [0.8122270502556371]
Investigators often need to determine the age of victims by looking at images and interpreting the sexual development stages and other human characteristics.
This paper evaluates existing facial image datasets and proposes a new dataset tailored to the needs of similar digital forensic research contributions.
The new dataset is tested on the Deep EXpectation (DEX) algorithm pre-trained on the IMDB-WIKI dataset.
arXiv Detail & Related papers (2022-01-09T16:25:37Z) - Towards Privacy-Preserving Affect Recognition: A Two-Level Deep Learning
Architecture [2.9392867898439006]
We propose a two-level deep learning architecture for affect recognition.
The architecture consists of recurrent neural networks to capture the temporal relationships amongst the features.
arXiv Detail & Related papers (2021-11-14T13:52:57Z) - FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in
the Wild [50.8865921538953]
We propose a method to explicitly incorporate facial semantics into age estimation.
We design a face parsing-based network to learn semantic information at different scales.
We show that our method consistently outperforms all existing age estimation methods.
arXiv Detail & Related papers (2021-06-21T14:31:32Z) - Automatic Main Character Recognition for Photographic Studies [78.88882860340797]
Main characters in images are the most important humans that catch the viewer's attention upon first look.
Identifying the main character in images plays an important role in traditional photographic studies and media analysis.
We propose a method for identifying the main characters using machine learning based human pose estimation.
arXiv Detail & Related papers (2021-06-16T18:14:45Z) - Age Gap Reducer-GAN for Recognizing Age-Separated Faces [72.26969872180841]
We propose a novel algorithm for matching faces with temporal variations caused due to age progression.
The proposed generative adversarial network algorithm is a unified framework that combines facial age estimation and age-separated face verification.
arXiv Detail & Related papers (2020-11-11T16:43:32Z) - Gender and Ethnicity Classification based on Palmprint and Palmar Hand
Images from Uncontrolled Environment [13.889082559371401]
Soft biometric attributes such as gender, ethnicity or age may provide useful information for biometrics and forensics applications.
Gender and ethnicity labels are collected and provided for subjects in a publicly available database.
Five deep learning models are fine-tuned and evaluated in gender and ethnicity classification scenarios.
arXiv Detail & Related papers (2020-08-06T07:50:06Z) - From A Glance to "Gotcha": Interactive Facial Image Retrieval with
Progressive Relevance Feedback [72.29919762941029]
We propose an end-to-end framework to retrieve facial images with relevance feedback progressively provided by the witness.
With no need of any extra annotations, our model can be applied at the cost of a little response effort.
arXiv Detail & Related papers (2020-07-30T18:46:25Z) - Investigating Bias in Deep Face Analysis: The KANFace Dataset and
Empirical Study [67.3961439193994]
We introduce the most comprehensive, large-scale dataset of facial images and videos to date.
The data are manually annotated in terms of identity, exact age, gender and kinship.
A method to debias network embeddings is introduced and tested on the proposed benchmarks.
arXiv Detail & Related papers (2020-05-15T00:14:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.