FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework

• URL: http://arxiv.org/abs/2404.08277v2
• Date: Thu, 18 Apr 2024 09:43:26 GMT
• Title: FaceFilterSense: A Filter-Resistant Face Recognition and Facial Attribute Analysis Framework
• Authors: Shubham Tiwari, Yash Sethia, Ritesh Kumar, Ashwani Tanwar, Rudresh Dwivedi,
• Abstract summary: Fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems. Current AR-based filters and filters which distort facial key points are in vogue recently and make the faces highly unrecognizable even to the naked eye. To mitigate these limitations, we aim to perform a holistic impact analysis of the latest filters and propose an user recognition model with the filtered images.
• Score: 1.673834743879962
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the advent of social media, fun selfie filters have come into tremendous mainstream use affecting the functioning of facial biometric systems as well as image recognition systems. These filters vary from beautification filters and Augmented Reality (AR)-based filters to filters that modify facial landmarks. Hence, there is a need to assess the impact of such filters on the performance of existing face recognition systems. The limitation associated with existing solutions is that these solutions focus more on the beautification filters. However, the current AR-based filters and filters which distort facial key points are in vogue recently and make the faces highly unrecognizable even to the naked eye. Also, the filters considered are mostly obsolete with limited variations. To mitigate these limitations, we aim to perform a holistic impact analysis of the latest filters and propose an user recognition model with the filtered images. We have utilized a benchmark dataset for baseline images, and applied the latest filters over them to generate a beautified/filtered dataset. Next, we have introduced a model FaceFilterNet for beautified user recognition. In this framework, we also utilize our model to comment on various attributes of the person including age, gender, and ethnicity. In addition, we have also presented a filter-wise impact analysis on face recognition, age estimation, gender, and ethnicity prediction. The proposed method affirms the efficacy of our dataset with an accuracy of 87.25% and an optimal accuracy for facial attribute analysis.

Related papers

• CRAFT: Contextual Re-Activation of Filters for face recognition Training [11.490358127866102]
  We propose "CRAFT: Contextual Re-Activation of Filters for Face Recognition Training" We show that CRAFT reduces fraction of inactive filters from 44% to 32% on average and discovers filter patterns not found by standard training. Compared to standard training without reactivation, CRAFT demonstrates enhanced model accuracy on standard face-recognition benchmark datasets.
  arXiv  Detail & Related papers  (2023-11-29T22:07:25Z)
• Has the Virtualization of the Face Changed Facial Perception? A Study of the Impact of Photo Editing and Augmented Reality on Facial Perception [7.532782211020641]
  We present the results of six surveys on familiarity with different styles of facial filters and ability to discern whether images are filtered. Our results demonstrate that faces modified with more traditional face filters are perceived similarly to unmodified faces. We discuss possible explanations for these results, including a societal adjustment to traditional photo editing techniques or the inherent differences in the different types of filters.
  arXiv  Detail & Related papers  (2023-03-01T16:09:11Z)
• LFW-Beautified: A Dataset of Face Images with Beautification and Augmented Reality Filters [53.180678723280145]
  We contribute with a database of facial images that includes several manipulations. It includes image enhancement filters (which mostly modify contrast and lightning) and augmented reality filters that incorporate items like animal noses or glasses. Each dataset contains 4,324 images of size 64 x 64, with a total of 34,592 images.
  arXiv  Detail & Related papers  (2022-03-11T17:05:10Z)
• Fun Selfie Filters in Face Recognition: Impact Assessment and Removal [13.715060479044167]
  This work investigates the impact of fun selfie filters on face recognition systems. Ten relevant fun selfie filters are selected to create a database. To mitigate such unwanted effects, a GAN-based selfie filter removal algorithm is proposed.
  arXiv  Detail & Related papers  (2022-02-12T09:12:31Z)
• On the Effect of Selfie Beautification Filters on Face Detection and Recognition [53.561797148529664]
  Social media image filters modify the image contrast or illumination or occlude parts of the face with for example artificial glasses or animal noses. We develop a method to reconstruct the applied manipulation with a modified version of the U-NET segmentation network. From a recognition perspective, we employ distance measures and trained machine learning algorithms applied to features extracted using a ResNet-34 network trained to recognize faces.
  arXiv  Detail & Related papers  (2021-10-17T22:10:56Z)
• Unsharp Mask Guided Filtering [53.14430987860308]
  The goal of this paper is guided image filtering, which emphasizes the importance of structure transfer during filtering. We propose a new and simplified formulation of the guided filter inspired by unsharp masking. Our formulation enjoys a filtering prior to a low-pass filter and enables explicit structure transfer by estimating a single coefficient.
  arXiv  Detail & Related papers  (2021-06-02T19:15:34Z)
• Instagram Filter Removal on Fashionable Images [2.1485350418225244]
  We introduce Instagram Filter Removal Network (IFRNet) to mitigate the effects of image filters for social media analysis applications. Experiments demonstrate IFRNet outperforms all compared methods in quantitative and qualitative comparisons. We present the filter classification performance of our proposed model, and analyze the dominant color estimation on the images unfiltered by all compared methods.
  arXiv  Detail & Related papers  (2021-04-11T18:44:43Z)
• Filter Grafting for Deep Neural Networks: Reason, Method, and Cultivation [86.91324735966766]
  Filter is the key component in modern convolutional neural networks (CNNs) In this paper, we introduce filter grafting (textbfMethod) to achieve this goal. We develop a novel criterion to measure the information of filters and an adaptive weighting strategy to balance the grafted information among networks.
  arXiv  Detail & Related papers  (2020-04-26T08:36:26Z)
• Filter Grafting for Deep Neural Networks [71.39169475500324]
  Filter grafting aims to improve the representation capability of Deep Neural Networks (DNNs) We develop an entropy-based criterion to measure the information of filters and an adaptive weighting strategy for balancing the grafted information among networks. For example, the grafted MobileNetV2 outperforms the non-grafted MobileNetV2 by about 7 percent on CIFAR-100 dataset.
  arXiv  Detail & Related papers  (2020-01-15T03:18:57Z)
• Recognizing Instagram Filtered Images with Feature De-stylization [81.38905784617089]
  This paper presents a study on how popular pretrained models are affected by commonly used Instagram filters. Our analysis suggests that simple structure preserving filters which only alter the global appearance of an image can lead to large differences in the convolutional feature space. We introduce a lightweight de-stylization module that predicts parameters used for scaling and shifting feature maps to "undo" the changes incurred by filters.
  arXiv  Detail & Related papers  (2019-12-30T16:48:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.