A Novel Fully Annotated Thermal Infrared Face Dataset: Recorded in
Various Environment Conditions and Distances From The Camera
- URL: http://arxiv.org/abs/2205.02093v1
- Date: Fri, 29 Apr 2022 17:57:54 GMT
- Title: A Novel Fully Annotated Thermal Infrared Face Dataset: Recorded in
Various Environment Conditions and Distances From The Camera
- Authors: Roshanak Ashrafi, Mona Azarbayjania, Hamed Tabkhi
- Abstract summary: This article presents a novel public dataset on facial thermography, which we call it Charlotte-ThermalFace.
Charlotte-ThermalFace contains more than10000 infrared thermal images in varying thermal conditions, several distances from the camera, and different head positions.
The data is fully annotated with the facial landmarks, ambient temperature, relative humidity, the air speed of the room, distance to the camera, and subject thermal sensation at the time of capturing each image.
- Score: 3.2872586139884623
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Facial thermography is one of the most popular research areas in infrared
thermal imaging, with diverse applications in medical, surveillance, and
environmental monitoring. However, in contrast to facial imagery in the visual
spectrum, the lack of public datasets on facial thermal images is an obstacle
to research improvement in this area. Thermal face imagery is still a
relatively new research area to be evaluated and studied in different
domains.The current thermal face datasets are limited in regards to the
subjects' distance from the camera, the ambient temperature variation, and
facial landmarks' localization. We address these gaps by presenting a new
facial thermography dataset. This article makes two main contributions to the
body of knowledge. First, it presents a comprehensive review and comparison of
current public datasets in facial thermography. Second, it introduces and
studies a novel public dataset on facial thermography, which we call it
Charlotte-ThermalFace. Charlotte-ThermalFace contains more than10000 infrared
thermal images in varying thermal conditions, several distances from the
camera, and different head positions. The data is fully annotated with the
facial landmarks, ambient temperature, relative humidity, the air speed of the
room, distance to the camera, and subject thermal sensation at the time of
capturing each image. Our dataset is the first publicly available thermal
dataset annotated with the thermal sensation of each subject in different
thermal conditions and one of the few datasets in raw 16-bit format. Finally,
we present a preliminary analysis of the dataset to show the applicability and
importance of the thermal conditions in facial thermography. The full dataset,
including annotations, are freely available for research purpose at
https://github.com/TeCSAR-UNCC/UNCC-ThermalFace
Related papers
- DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis [71.40724659748787]
DiffusionFace is the first diffusion-based face forgery dataset.
It covers various forgery categories, including unconditional and Text Guide facial image generation, Img2Img, Inpaint, and Diffusion-based facial exchange algorithms.
It provides essential metadata and a real-world internet-sourced forgery facial image dataset for evaluation.
arXiv Detail & Related papers (2024-03-27T11:32:44Z) - Semantic segmentation of longitudinal thermal images for identification
of hot and cool spots in urban areas [1.124958340749622]
This work presents the analysis of semantically segmented, longitudinally, and spatially rich thermal images collected at the neighborhood scale to identify hot and cool spots in urban areas.
A subset of the thermal image dataset was used to train state-of-the-art deep learning models to segment various urban features.
arXiv Detail & Related papers (2023-10-06T13:41:39Z) - What Happened 3 Seconds Ago? Inferring the Past with Thermal Imaging [22.923237551192834]
We collect the first RGB-Thermal dataset for human motion analysis, dubbed Thermal-IM.
We develop a three-stage neural network model for accurate past human pose estimation.
arXiv Detail & Related papers (2023-04-26T16:23:10Z) - Multiface: A Dataset for Neural Face Rendering [108.44505415073579]
In this work, we present Multiface, a new multi-view, high-resolution human face dataset.
We introduce Mugsy, a large scale multi-camera apparatus to capture high-resolution synchronized videos of a facial performance.
The goal of Multiface is to close the gap in accessibility to high quality data in the academic community and to enable research in VR telepresence.
arXiv Detail & Related papers (2022-07-22T17:55:39Z) - Machine Learning-Based Automated Thermal Comfort Prediction: Integration
of Low-Cost Thermal and Visual Cameras for Higher Accuracy [3.2872586139884623]
Real-time feedback system is needed to provide data about occupants' comfort conditions.
New solutions are required to bring a more holistic view toward non-intrusive thermal scanning.
arXiv Detail & Related papers (2022-04-14T15:30:16Z) - A Synthesis-Based Approach for Thermal-to-Visible Face Verification [105.63410428506536]
This paper presents an algorithm that achieves state-of-the-art performance on the ARL-VTF and TUFTS multi-spectral face datasets.
We also present MILAB-VTF(B), a challenging multi-spectral face dataset composed of paired thermal and visible videos.
arXiv Detail & Related papers (2021-08-21T17:59:56Z) - Generating Thermal Human Faces for Physiological Assessment Using
Thermal Sensor Auxiliary Labels [21.920079976038163]
Thermal images reveal medically important physiological information about human stress, signs of inflammation, and emotional mood that cannot be seen on visible images.
We introduce favtGAN, a VT GAN which uses the pix2pix image translation model with an auxiliary sensor label prediction network for generating thermal faces from visible images.
Experiments on these combined datasets show that favtGAN demonstrates an increase in SSIM and PSNR scores of generated thermal faces, compared to training on a single face dataset alone.
arXiv Detail & Related papers (2021-06-15T12:32:52Z) - A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset [62.193924313292875]
We present the DEVCOM Army Research Laboratory Visible-Thermal Face dataset (ARL-VTF)
With over 500,000 images from 395 subjects, the ARL-VTF dataset represents to the best of our knowledge, the largest collection of paired visible and thermal face images to date.
This paper presents benchmark results and analysis on thermal face landmark detection and thermal-to-visible face verification by evaluating state-of-the-art models on the ARL-VTF dataset.
arXiv Detail & Related papers (2021-01-07T17:17:12Z) - Exploring Thermal Images for Object Detection in Underexposure Regions
for Autonomous Driving [67.69430435482127]
Underexposure regions are vital to construct a complete perception of the surroundings for safe autonomous driving.
The availability of thermal cameras has provided an essential alternate to explore regions where other optical sensors lack in capturing interpretable signals.
This work proposes a domain adaptation framework which employs a style transfer technique for transfer learning from visible spectrum images to thermal images.
arXiv Detail & Related papers (2020-06-01T09:59:09Z) - Multi-Scale Thermal to Visible Face Verification via Attribute Guided
Synthesis [55.29770222566124]
We use attributes extracted from visible images to synthesize attribute-preserved visible images from thermal imagery for cross-modal matching.
A novel multi-scale generator is proposed to synthesize the visible image from the thermal image guided by the extracted attributes.
A pre-trained VGG-Face network is leveraged to extract features from the synthesized image and the input visible image for verification.
arXiv Detail & Related papers (2020-04-20T01:45:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.