LFW-Beautified: A Dataset of Face Images with Beautification and Augmented Reality Filters

• URL: http://arxiv.org/abs/2203.06082v1
• Date: Fri, 11 Mar 2022 17:05:10 GMT
• Title: LFW-Beautified: A Dataset of Face Images with Beautification and Augmented Reality Filters
• Authors: Pontus Hedman, Vasilios Skepetzis, Kevin Hernandez-Diaz, Josef Bigun, Fernando Alonso-Fernandez
• Abstract summary: We contribute with a database of facial images that includes several manipulations. It includes image enhancement filters (which mostly modify contrast and lightning) and augmented reality filters that incorporate items like animal noses or glasses. Each dataset contains 4,324 images of size 64 x 64, with a total of 34,592 images.
• Score: 53.180678723280145
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Selfie images enjoy huge popularity in social media. The same platforms centered around sharing this type of images offer filters to beautify them or incorporate augmented reality effects. Studies suggests that filtered images attract more views and engagement. Selfie images are also in increasing use in security applications due to mobiles becoming data hubs for many transactions. Also, video conference applications, boomed during the pandemic, include such filters. Such filters may destroy biometric features that would allow person recognition or even detection of the face itself, even if such commodity applications are not necessarily used to compromise facial systems. This could also affect subsequent investigations like crimes in social media, where automatic analysis is usually necessary given the amount of information posted in social sites or stored in devices or cloud repositories. To help in counteracting such issues, we contribute with a database of facial images that includes several manipulations. It includes image enhancement filters (which mostly modify contrast and lightning) and augmented reality filters that incorporate items like animal noses or glasses. Additionally, images with sunglasses are processed with a reconstruction network trained to learn to reverse such modifications. This is because obfuscating the eye region has been observed in the literature to have the highest impact on the accuracy of face detection or recognition. We start from the popular Labeled Faces in the Wild (LFW) database, to which we apply different modifications, generating 8 datasets. Each dataset contains 4,324 images of size 64 x 64, with a total of 34,592 images. The use of a public and widely employed face dataset allows for replication and comparison. The created database is available at https://github.com/HalmstadUniversityBiometrics/LFW-Beautified

Related papers

• Has the Virtualization of the Face Changed Facial Perception? A Study of the Impact of Photo Editing and Augmented Reality on Facial Perception [7.532782211020641]
  We present the results of six surveys on familiarity with different styles of facial filters and ability to discern whether images are filtered. Our results demonstrate that faces modified with more traditional face filters are perceived similarly to unmodified faces. We discuss possible explanations for these results, including a societal adjustment to traditional photo editing techniques or the inherent differences in the different types of filters.
  arXiv  Detail & Related papers  (2023-03-01T16:09:11Z)
• OpenFilter: A Framework to Democratize Research Access to Social Media AR Filters [14.789786314914858]
  We present OpenFilter, a framework to apply AR filters available in social media platforms on existing large collections of human faces. We also share FairBeauty and B-LFW, two beautified versions of the publicly available FairFace and LFW datasets.
  arXiv  Detail & Related papers  (2022-07-19T17:05:25Z)
• FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders [81.21440457805932]
  We propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously. randomly masked face images are used to train the reconstruction module in FaceMAE. We also perform sufficient privacy-preserving face recognition on several public face datasets.
  arXiv  Detail & Related papers  (2022-05-23T07:19:42Z)
• Fun Selfie Filters in Face Recognition: Impact Assessment and Removal [13.715060479044167]
  This work investigates the impact of fun selfie filters on face recognition systems. Ten relevant fun selfie filters are selected to create a database. To mitigate such unwanted effects, a GAN-based selfie filter removal algorithm is proposed.
  arXiv  Detail & Related papers  (2022-02-12T09:12:31Z)
• On the Effect of Selfie Beautification Filters on Face Detection and Recognition [53.561797148529664]
  Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses. We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network. From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
  arXiv  Detail & Related papers  (2021-10-17T22:10:56Z)
• Facial Masks and Soft-Biometrics: Leveraging Face Recognition CNNs for Age and Gender Prediction on Mobile Ocular Images [53.913598771836924]
  We address the use of selfie ocular images captured with smartphones to estimate age and gender. We adapt two existing lightweight CNNs proposed in the context of the ImageNet Challenge. Some networks are further pre-trained for face recognition, for which very large training databases are available.
  arXiv  Detail & Related papers  (2021-03-31T01:48:29Z)
• A Study of Face Obfuscation in ImageNet [94.2949777826947]
  In this paper, we explore image obfuscation in the ImageNet challenge. Most categories in the ImageNet challenge are not people categories; nevertheless, many incidental people are in the images. We benchmark various deep neural networks on face-blurred images and observe a disparate impact on different categories. Results show that features learned on face-blurred images are equally transferable.
  arXiv  Detail & Related papers  (2021-03-10T17:11:34Z)
• Visual Chirality [51.685596116645776]
  We investigate how statistics of visual data are changed by reflection. Our work has implications for data augmentation, self-supervised learning, and image forensics.
  arXiv  Detail & Related papers  (2020-06-16T20:48:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.