Controlling Memorability of Face Images
- URL: http://arxiv.org/abs/2202.11896v1
- Date: Thu, 24 Feb 2022 04:33:55 GMT
- Title: Controlling Memorability of Face Images
- Authors: Mohammad Younesi, Yalda Mohsenzadeh
- Abstract summary: We propose a fast approach to modify and control the memorability of face images.
We first found a hyperplane in the latent space of StyleGAN to separate high and low memorable images.
We analyzed how different layers of the StyleGAN augmented latent space contribute to face memorability.
- Score: 5.000272778136267
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Everyday, we are bombarded with many photographs of faces, whether on social
media, television, or smartphones. From an evolutionary perspective, faces are
intended to be remembered, mainly due to survival and personal relevance.
However, all these faces do not have the equal opportunity to stick in our
minds. It has been shown that memorability is an intrinsic feature of an image
but yet, it is largely unknown what attributes make an image more memorable. In
this work, we aimed to address this question by proposing a fast approach to
modify and control the memorability of face images. In our proposed method, we
first found a hyperplane in the latent space of StyleGAN to separate high and
low memorable images. We then modified the image memorability (while
maintaining the identity and other facial features such as age, emotion, etc.)
by moving in the positive or negative direction of this hyperplane normal
vector. We further analyzed how different layers of the StyleGAN augmented
latent space contribute to face memorability. These analyses showed how each
individual face attribute makes an image more or less memorable. Most
importantly, we evaluated our proposed method for both real and synthesized
face images. The proposed method successfully modifies and controls the
memorability of real human faces as well as unreal synthesized faces. Our
proposed method can be employed in photograph editing applications for social
media, learning aids, or advertisement purposes.
Related papers
- GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representations [54.94362657501809]
We propose a new method to generate highly dynamic and deformable human head avatars from multi-view imagery in real-time.
At the core of our method is a hierarchical representation of head models that allows to capture the complex dynamics of facial expressions and head movements.
We train this coarse-to-fine facial avatar model along with the head pose as a learnable parameter in an end-to-end framework.
arXiv Detail & Related papers (2024-09-18T13:05:43Z) - Generalizable Face Landmarking Guided by Conditional Face Warping [34.49985314656207]
We learn a generalizable face landmarker based on labeled real human faces and unlabeled stylized faces.
Our method outperforms existing state-of-the-art domain adaptation methods in face landmarking tasks.
arXiv Detail & Related papers (2024-04-18T16:53:08Z) - FlashFace: Human Image Personalization with High-fidelity Identity Preservation [59.76645602354481]
FlashFace allows users to easily personalize their own photos by providing one or a few reference face images and a text prompt.
Our approach is distinguishable from existing human photo customization methods by higher-fidelity identity preservation and better instruction following.
arXiv Detail & Related papers (2024-03-25T17:59:57Z) - Privacy-Preserving Face Recognition Using Trainable Feature Subtraction [40.47645421424354]
Face recognition has led to increasing privacy concerns.
This paper explores face image protection against viewing and recovery attacks.
We distill our methodologies into a novel privacy-preserving face recognition method, MinusFace.
arXiv Detail & Related papers (2024-03-19T05:27:52Z) - When StyleGAN Meets Stable Diffusion: a $\mathscr{W}_+$ Adapter for
Personalized Image Generation [60.305112612629465]
Text-to-image diffusion models have excelled in producing diverse, high-quality, and photo-realistic images.
We present a novel use of the extended StyleGAN embedding space $mathcalW_+$ to achieve enhanced identity preservation and disentanglement for diffusion models.
Our method adeptly generates personalized text-to-image outputs that are not only compatible with prompt descriptions but also amenable to common StyleGAN editing directions.
arXiv Detail & Related papers (2023-11-29T09:05:14Z) - Face Identity-Aware Disentanglement in StyleGAN [15.753131748318335]
We introduce PluGeN4Faces, a plugin to StyleGAN, which explicitly disentangles face attributes from a person's identity.
Our experiments demonstrate that the modifications of face attributes performed by PluGeN4Faces are significantly less invasive on the remaining characteristics of the image than in the existing state-of-the-art models.
arXiv Detail & Related papers (2023-09-21T12:54:09Z) - DreamIdentity: Improved Editability for Efficient Face-identity
Preserved Image Generation [69.16517915592063]
We propose a novel face-identity encoder to learn an accurate representation of human faces.
We also propose self-augmented editability learning to enhance the editability of models.
Our methods can generate identity-preserved images under different scenes at a much faster speed.
arXiv Detail & Related papers (2023-07-01T11:01:17Z) - FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders [81.21440457805932]
We propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously.
randomly masked face images are used to train the reconstruction module in FaceMAE.
We also perform sufficient privacy-preserving face recognition on several public face datasets.
arXiv Detail & Related papers (2022-05-23T07:19:42Z) - FaR-GAN for One-Shot Face Reenactment [20.894596219099164]
We present a one-shot face reenactment model, FaR-GAN, that takes only one face image of any given source identity and a target expression as input.
The proposed method makes no assumptions about the source identity, facial expression, head pose, or even image background.
arXiv Detail & Related papers (2020-05-13T16:15:37Z) - Towards Face Encryption by Generating Adversarial Identity Masks [53.82211571716117]
We propose a targeted identity-protection iterative method (TIP-IM) to generate adversarial identity masks.
TIP-IM provides 95%+ protection success rate against various state-of-the-art face recognition models.
arXiv Detail & Related papers (2020-03-15T12:45:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.