PixelSmile: Toward Fine-Grained Facial Expression Editing

• URL: http://arxiv.org/abs/2603.25728v1
• Date: Thu, 26 Mar 2026 17:59:04 GMT
• Title: PixelSmile: Toward Fine-Grained Facial Expression Editing
• Abstract summary: PixelSmile is a diffusion framework that disentangles expression semantics via fully symmetric joint training.<n>Experiments demonstrate that PixelSmile achieves superior disentanglement and robust identity preservation.
• Score: 65.87252658984724
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fine-grained facial expression editing has long been limited by intrinsic semantic overlap. To address this, we construct the Flex Facial Expression (FFE) dataset with continuous affective annotations and establish FFE-Bench to evaluate structural confusion, editing accuracy, linear controllability, and the trade-off between expression editing and identity preservation. We propose PixelSmile, a diffusion framework that disentangles expression semantics via fully symmetric joint training. PixelSmile combines intensity supervision with contrastive learning to produce stronger and more distinguishable expressions, achieving precise and stable linear expression control through textual latent interpolation. Extensive experiments demonstrate that PixelSmile achieves superior disentanglement and robust identity preservation, confirming its effectiveness for continuous, controllable, and fine-grained expression editing, while naturally supporting smooth expression blending.

Related papers

• AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing [78.6161238980415]
  AttDiff-GAN is a hybrid framework that combines GAN-based attribute manipulation with diffusion-based image generation.<n>We show that the proposed method achieves more accurate facial attribute editing and better preservation of non-target attributes than state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-04-23T05:05:46Z)
• Retrieval-Augmented Gaussian Avatars: Improving Expression Generalization [39.32685427601982]
  We introduce RAF (Retrieval-Augmented Faces), a simple training-time augmentation designed for template-free head avatars that learn deformation from data.<n>RAF replaces a subset of the subject's expression features with nearest-neighbor expressions retrieved from this bank while still reconstructing the subject's original frames.<n>RAF consistently improves expression fidelity over the baseline, in both self-driving and cross-driving scenarios.
  arXiv  Detail & Related papers  (2026-03-09T17:24:11Z)
• PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement [52.21370023312275]
  PixPerfect is a pixel-level refinement framework that delivers seamless, high-fidelity local edits across diverse LDM architectures and tasks.<n>Experiments on inpainting, object removal, and insertion benchmarks demonstrate that PixPerfect substantially enhances perceptual fidelity and downstream editing performance.
  arXiv  Detail & Related papers  (2025-12-02T21:35:57Z)
• Gen-AFFECT: Generation of Avatar Fine-grained Facial Expressions with Consistent identiTy [15.26953477181137]
  GEN-AFFECT is a novel framework for personalized avatar generation.<n>It generates expressive and identity-consistent avatars with a diverse set of facial expressions.
  arXiv  Detail & Related papers  (2025-08-13T03:35:35Z)
• EmojiDiff: Advanced Facial Expression Control with High Identity Preservation in Portrait Generation [8.314556078632412]
  We introduce EmojiDiff, the first end-to-end solution that enables simultaneous control of extremely detailed expression (RGB-level) and high-fidelity identity in portrait generation.<n>For decoupled training, we innovate ID-irrelevant Data Iteration (IDI) to synthesize cross-identity expression pairs.<n>We also present ID-enhanced Contrast Alignment (ICA) for further fine-tuning.
  arXiv  Detail & Related papers  (2024-12-02T08:24:11Z)
• Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation [66.53435569574135]
  Existing facial expression recognition methods typically fine-tune a pre-trained visual encoder using discrete labels. We observe that the rich knowledge in text embeddings, generated by vision-language models, is a promising alternative for learning discriminative facial expression representations. We propose a novel knowledge-enhanced FER method with an emotional-to-neutral transformation.
  arXiv  Detail & Related papers  (2024-09-13T07:28:57Z)
• MaskDiffusion: Boosting Text-to-Image Consistency with Conditional Mask [84.84034179136458]
  A crucial factor leading to the text-image mismatch issue is the inadequate cross-modality relation learning. We propose an adaptive mask, which is conditioned on the attention maps and the prompt embeddings, to dynamically adjust the contribution of each text token to the image features. Our method, termed MaskDiffusion, is training-free and hot-pluggable for popular pre-trained diffusion models.
  arXiv  Detail & Related papers  (2023-09-08T15:53:37Z)
• MaskCLIP: Masked Self-Distillation Advances Contrastive Language-Image Pretraining [138.86293836634323]
  MaskCLIP incorporates a newly proposed masked self-distillation into contrastive language-image pretraining. MaskCLIP achieves superior results in linear probing, finetuning, and zero-shot performance with the guidance of the language encoder.
  arXiv  Detail & Related papers  (2022-08-25T17:59:58Z)
• LEED: Label-Free Expression Editing via Disentanglement [57.09545215087179]
  LEED framework is capable of editing the expression of both frontal and profile facial images without requiring any expression label. Two novel losses are designed for optimal expression disentanglement and consistent synthesis.
  arXiv  Detail & Related papers  (2020-07-17T13:36:15Z)
• Fine-Grained Expression Manipulation via Structured Latent Space [30.789513209376032]
  We propose an end-to-end expression-guided generative adversarial network (EGGAN) to manipulate fine-grained expressions. Our method can manipulate fine-grained expressions, and generate continuous intermediate expressions between source and target expressions.
  arXiv  Detail & Related papers  (2020-04-21T06:18:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.