Cosmetic-Aware Makeup Cleanser
- URL: http://arxiv.org/abs/2004.09147v1
- Date: Mon, 20 Apr 2020 09:18:23 GMT
- Title: Cosmetic-Aware Makeup Cleanser
- Authors: Yi Li, Huaibo Huang, Junchi Yu, Ran He, Tieniu Tan
- Abstract summary: Face verification aims at determining whether a pair of face images belongs to the same identity.
Recent studies have revealed the negative impact of facial makeup on the verification performance.
This paper proposes a semanticaware makeup cleanser (SAMC) to remove facial makeup under different poses and expressions.
- Score: 109.41917954315784
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Face verification aims at determining whether a pair of face images belongs
to the same identity. Recent studies have revealed the negative impact of
facial makeup on the verification performance. With the rapid development of
deep generative models, this paper proposes a semanticaware makeup cleanser
(SAMC) to remove facial makeup under different poses and expressions and
achieve verification via generation. The intuition lies in the fact that makeup
is a combined effect of multiple cosmetics and tailored treatments should be
imposed on different cosmetic regions. To this end, we present both
unsupervised and supervised semantic-aware learning strategies in SAMC. At
image level, an unsupervised attention module is jointly learned with the
generator to locate cosmetic regions and estimate the degree. At feature level,
we resort to the effort of face parsing merely in training phase and design a
localized texture loss to serve complements and pursue superior synthetic
quality. The experimental results on four makeuprelated datasets verify that
SAMC not only produces appealing de-makeup outputs at a resolution of 256*256,
but also facilitates makeup-invariant face verification through image
generation.
Related papers
- BeautyBank: Encoding Facial Makeup in Latent Space [2.113770213797994]
We propose BeautyBank, a novel makeup encoder that disentangles pattern features of bare and makeup faces.
Our method encodes makeup features into a high-dimensional space, preserving essential details necessary for makeup reconstruction.
We also propose a Progressive Makeup Tuning (PMT) strategy, specifically designed to enhance the preservation of detailed makeup features.
arXiv Detail & Related papers (2024-11-18T01:52:31Z) - DiffAM: Diffusion-based Adversarial Makeup Transfer for Facial Privacy Protection [60.73609509756533]
DiffAM is a novel approach to generate high-quality protected face images with adversarial makeup transferred from reference images.
Experiments demonstrate that DiffAM achieves higher visual quality and attack success rates with a gain of 12.98% under black-box setting.
arXiv Detail & Related papers (2024-05-16T08:05:36Z) - Stable-Makeup: When Real-World Makeup Transfer Meets Diffusion Model [35.01727715493926]
Current makeup transfer methods are limited to simple makeup styles, making them difficult to apply in real-world scenarios.
We introduce Stable-Makeup, a novel diffusion-based makeup transfer method capable of robustly transferring a wide range of real-world makeup.
arXiv Detail & Related papers (2024-03-12T15:53:14Z) - A Generalist FaceX via Learning Unified Facial Representation [77.74407008931486]
FaceX is a novel facial generalist model capable of handling diverse facial tasks simultaneously.
Our versatile FaceX achieves competitive performance compared to elaborate task-specific models on popular facial editing tasks.
arXiv Detail & Related papers (2023-12-31T17:41:48Z) - SynFace: Face Recognition with Synthetic Data [83.15838126703719]
We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap.
We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
arXiv Detail & Related papers (2021-08-18T03:41:54Z) - Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails [53.080403912727604]
We propose a multi-stage Progressive Upsampling and Inpainting Generative Adversarial Network, dubbed Pro-UIGAN.
It exploits facial geometry priors to replenish and upsample (8*) the occluded and tiny faces.
Pro-UIGAN achieves visually pleasing HR faces, reaching superior performance in downstream tasks.
arXiv Detail & Related papers (2021-08-02T02:29:24Z) - PSGAN++: Robust Detail-Preserving Makeup Transfer and Removal [176.47249346856393]
PSGAN++ is capable of performing both detail-preserving makeup transfer and effective makeup removal.
For makeup transfer, PSGAN++ uses a Makeup Distill Network to extract makeup information.
For makeup removal, PSGAN++ applies an Identity Distill Network to embed the identity information from with-makeup images into identity matrices.
arXiv Detail & Related papers (2021-05-26T04:37:57Z) - Detection of Makeup Presentation Attacks based on Deep Face
Representations [16.44565034551196]
The application of makeup can be abused to launch so-called makeup presentation attacks.
It is shown that makeup presentation attacks might seriously impact the security of the face recognition system.
We propose an attack detection scheme which distinguishes makeup presentation attacks from genuine authentication attempts.
arXiv Detail & Related papers (2020-06-09T06:53:58Z) - Local Facial Makeup Transfer via Disentangled Representation [18.326829657548025]
We propose a novel unified adversarial disentangling network to decompose face images into four independent components, i.e., personal identity, lips makeup style, eyes makeup style and face makeup style.
Our approach can produce more realistic and accurate makeup transfer results compared to the state-of-the-art methods.
arXiv Detail & Related papers (2020-03-27T00:25:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.