Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition

• URL: http://arxiv.org/abs/2202.05297v1
• Date: Thu, 10 Feb 2022 19:35:28 GMT
• Title: Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application to Face Recognition
• Authors: Mathias Ibsen, Christian Rathgeb, Pawel Drozdowski, Christoph Busch
• Abstract summary: We propose a generator for automatically adding realistic tattoos to facial images. We show that it is possible to remove facial tattoos from real images without degrading the quality of the image. We also show that it is possible to improve face recognition accuracy by using the proposed deep learning-based tattoo removal.
• Score: 14.63266615325105
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Systems that analyse faces have seen significant improvements in recent years and are today used in numerous application scenarios. However, these systems have been found to be negatively affected by facial alterations such as tattoos. To better understand and mitigate the effect of facial tattoos in facial analysis systems, large datasets of images of individuals with and without tattoos are needed. To this end, we propose a generator for automatically adding realistic tattoos to facial images. Moreover, we demonstrate the feasibility of the generation by training a deep learning-based model for removing tattoos from face images. The experimental results show that it is possible to remove facial tattoos from real images without degrading the quality of the image. Additionally, we show that it is possible to improve face recognition accuracy by using the proposed deep learning-based tattoo removal before extracting and comparing facial features.

Related papers

• OSDFace: One-Step Diffusion Model for Face Restoration [72.5045389847792]
  Diffusion models have demonstrated impressive performance in face restoration. We propose OSDFace, a novel one-step diffusion model for face restoration. Results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics.
  arXiv  Detail & Related papers  (2024-11-26T07:07:48Z)
• Face Anonymization Made Simple [44.24233169815565]
  Current face anonymization techniques often depend on identity loss calculated by face recognition models, which can be inaccurate and unreliable. In contrast, our approach uses diffusion models with only a reconstruction loss, eliminating the need for facial landmarks or masks. Our model achieves state-of-the-art performance in three key areas: identity anonymization, facial preservation, and image quality.
  arXiv  Detail & Related papers  (2024-11-01T17:45:21Z)
• G2Face: High-Fidelity Reversible Face Anonymization via Generative and Geometric Priors [71.69161292330504]
  Reversible face anonymization seeks to replace sensitive identity information in facial images with synthesized alternatives. This paper introduces Gtextsuperscript2Face, which leverages both generative and geometric priors to enhance identity manipulation. Our method outperforms existing state-of-the-art techniques in face anonymization and recovery, while preserving high data utility.
  arXiv  Detail & Related papers  (2024-08-18T12:36:47Z)
• TattTRN: Template Reconstruction Network for Tattoo Retrieval [3.3728564634593914]
  Tattoos have been used effectively as soft biometrics to assist law enforcement in the identification of offenders and victims. Due to various privacy issues in the acquisition of images containing tattoos, only a limited number of databases exists. This lack of databases has delayed the development of new methods to effectively retrieve a potential suspect's tattoo images.
  arXiv  Detail & Related papers  (2024-05-13T09:19:03Z)
• A Generalist FaceX via Learning Unified Facial Representation [77.74407008931486]
  FaceX is a novel facial generalist model capable of handling diverse facial tasks simultaneously. Our versatile FaceX achieves competitive performance compared to elaborate task-specific models on popular facial editing tasks.
  arXiv  Detail & Related papers  (2023-12-31T17:41:48Z)
• DreamIdentity: Improved Editability for Efficient Face-identity Preserved Image Generation [69.16517915592063]
  We propose a novel face-identity encoder to learn an accurate representation of human faces. We also propose self-augmented editability learning to enhance the editability of models. Our methods can generate identity-preserved images under different scenes at a much faster speed.
  arXiv  Detail & Related papers  (2023-07-01T11:01:17Z)
• DigiFace-1M: 1 Million Digital Face Images for Face Recognition [25.31469201712699]
  State-of-the-art face recognition models show impressive accuracy, achieving over 99.8% on Labeled Faces in the Wild dataset. We introduce a large-scale synthetic dataset for face recognition, obtained by rendering digital faces using a computer graphics pipeline.
  arXiv  Detail & Related papers  (2022-10-05T22:02:48Z)
• Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data [88.78171717494688]
  We propose a novel method to automatically transform face photos to portrait drawings using unpaired training data. Our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.
  arXiv  Detail & Related papers  (2022-02-08T06:49:57Z)
• FaceEraser: Removing Facial Parts for Augmented Reality [10.575917056215289]
  Our task is to remove all facial parts and then impose visual elements onto the blank'' face for augmented reality. We propose a novel data generation technique to produce paired training data that well mimic the blank'' faces. Our method has been integrated into commercial products and its effectiveness has been verified with unconstrained user inputs.
  arXiv  Detail & Related papers  (2021-09-22T14:30:12Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)
• Impact of Facial Tattoos and Paintings on Face Recognition Systems [14.784088881975897]
  We investigate the impact that facial tattoos and paintings have on current face recognition systems. The impact on these modules was evaluated using state-of-the-art open-source and commercial systems. Our work is an initial case-study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.
  arXiv  Detail & Related papers  (2021-03-17T22:38:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.