Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application
to Face Recognition
- URL: http://arxiv.org/abs/2202.05297v1
- Date: Thu, 10 Feb 2022 19:35:28 GMT
- Title: Face Beneath the Ink: Synthetic Data and Tattoo Removal with Application
to Face Recognition
- Authors: Mathias Ibsen, Christian Rathgeb, Pawel Drozdowski, Christoph Busch
- Abstract summary: We propose a generator for automatically adding realistic tattoos to facial images.
We show that it is possible to remove facial tattoos from real images without degrading the quality of the image.
We also show that it is possible to improve face recognition accuracy by using the proposed deep learning-based tattoo removal.
- Score: 14.63266615325105
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Systems that analyse faces have seen significant improvements in recent years
and are today used in numerous application scenarios. However, these systems
have been found to be negatively affected by facial alterations such as
tattoos. To better understand and mitigate the effect of facial tattoos in
facial analysis systems, large datasets of images of individuals with and
without tattoos are needed. To this end, we propose a generator for
automatically adding realistic tattoos to facial images. Moreover, we
demonstrate the feasibility of the generation by training a deep learning-based
model for removing tattoos from face images. The experimental results show that
it is possible to remove facial tattoos from real images without degrading the
quality of the image. Additionally, we show that it is possible to improve face
recognition accuracy by using the proposed deep learning-based tattoo removal
before extracting and comparing facial features.
Related papers
- TattTRN: Template Reconstruction Network for Tattoo Retrieval [3.3728564634593914]
Tattoos have been used effectively as soft biometrics to assist law enforcement in the identification of offenders and victims.
Due to various privacy issues in the acquisition of images containing tattoos, only a limited number of databases exists.
This lack of databases has delayed the development of new methods to effectively retrieve a potential suspect's tattoo images.
arXiv Detail & Related papers (2024-05-13T09:19:03Z) - A Generalist FaceX via Learning Unified Facial Representation [77.74407008931486]
FaceX is a novel facial generalist model capable of handling diverse facial tasks simultaneously.
Our versatile FaceX achieves competitive performance compared to elaborate task-specific models on popular facial editing tasks.
arXiv Detail & Related papers (2023-12-31T17:41:48Z) - An Evaluation of Forensic Facial Recognition [16.17759191184531]
We describe the construction of a large-scale synthetic facial dataset along with a controlled facial forensic lineup.
We evaluate the accuracy of two popular neural-based recognition systems.
We find that previously reported face recognition accuracies of more than 95% drop to as low as 65% in this more challenging forensic scenario.
arXiv Detail & Related papers (2023-11-10T16:02:46Z) - DreamIdentity: Improved Editability for Efficient Face-identity
Preserved Image Generation [69.16517915592063]
We propose a novel face-identity encoder to learn an accurate representation of human faces.
We also propose self-augmented editability learning to enhance the editability of models.
Our methods can generate identity-preserved images under different scenes at a much faster speed.
arXiv Detail & Related papers (2023-07-01T11:01:17Z) - Robustness Disparities in Face Detection [64.71318433419636]
We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models.
Across all the datasets and systems, we generally find that photos of individuals who are $textitmasculine presenting$, of $textitolder$, of $textitdarker skin type$, or have $textitdim lighting$ are more susceptible to errors than their counterparts in other identities.
arXiv Detail & Related papers (2022-11-29T05:22:47Z) - DigiFace-1M: 1 Million Digital Face Images for Face Recognition [25.31469201712699]
State-of-the-art face recognition models show impressive accuracy, achieving over 99.8% on Labeled Faces in the Wild dataset.
We introduce a large-scale synthetic dataset for face recognition, obtained by rendering digital faces using a computer graphics pipeline.
arXiv Detail & Related papers (2022-10-05T22:02:48Z) - Quality Metric Guided Portrait Line Drawing Generation from Unpaired
Training Data [88.78171717494688]
We propose a novel method to automatically transform face photos to portrait drawings using unpaired training data.
Our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.
arXiv Detail & Related papers (2022-02-08T06:49:57Z) - FaceEraser: Removing Facial Parts for Augmented Reality [10.575917056215289]
Our task is to remove all facial parts and then impose visual elements onto the blank'' face for augmented reality.
We propose a novel data generation technique to produce paired training data that well mimic the blank'' faces.
Our method has been integrated into commercial products and its effectiveness has been verified with unconstrained user inputs.
arXiv Detail & Related papers (2021-09-22T14:30:12Z) - SynFace: Face Recognition with Synthetic Data [83.15838126703719]
We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap.
We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
arXiv Detail & Related papers (2021-08-18T03:41:54Z) - Impact of Facial Tattoos and Paintings on Face Recognition Systems [14.784088881975897]
We investigate the impact that facial tattoos and paintings have on current face recognition systems.
The impact on these modules was evaluated using state-of-the-art open-source and commercial systems.
Our work is an initial case-study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.
arXiv Detail & Related papers (2021-03-17T22:38:13Z) - Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
arXiv Detail & Related papers (2020-03-15T12:45:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.