Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping

• URL: http://arxiv.org/abs/2607.21434v1
• Date: Thu, 23 Jul 2026 15:37:55 GMT
• Title: Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping
• Abstract summary: We propose Adaptive Identity Anchoring (AIA)<n>AIA generalizes the synthesizer to arbitrary anchor sets.<n>A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline's objectives.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Video face swapping has no natural paired supervision: no real footage exists of one person's face performing another person's video. The strongest current answer, DreamID-V's SyncID-Pipe, mints pairs by replacing the identity in exactly two frames of a real clip -- the first and the last -- and regenerating the rest from a pose sequence alone. Pose carries no appearance evidence of the swapped-in identity, so over long clips, occlusions, and extreme pose excursions the synthesized identity has a long unanchored span on which to drift; no published ablation examines anchor count or placement. We propose Adaptive Identity Anchoring (AIA): (i) generalize the synthesizer to arbitrary anchor sets, architecturally natural for diffusion-forcing-style transformers where conditioning on a frame is clamping its tokens to zero noise; (ii) place anchors by a closed feedback loop that scores every generated frame against the real reference identity and inserts an image-face-swapped anchor at the worst-scoring frame until the pair passes a threshold or exhausts a budget; (iii) reuse the loop's verdict as an automatic data filter. A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline's objectives. We therefore pair AIA with Reality-Referenced Texture Restoration: matched re-graining from each real frame's non-face regions, band-split transfer of sub-identity micro-texture from the real footage, and a second, spectral acceptance channel refereed by the footage's own spectrum. Identity-anchor density, we argue, is a controllable quality dial, and we specify falsifiable experiments -- drift-versus-gap curves, uniform-versus-adaptive placement at matched budgets, student training on AIA-minted data, and texture ablations with a human beauty-filter study -- that would validate or refute the proposal.

Related papers

• Vera: Identity-Faithful Human Subject-to-Video Generation [66.45205582225942]
  We propose Vera, a unified human-centric S2V framework for single- and multi-person generation.<n>We first construct a million-pair identity-aligned human image-video dataset through person-level cross-clip retrieval.<n>We show that Vera improves human identity consistency, multi-person subject binding, and motion naturalness, while reducing identity confusion and excessive reference-image copying.
  arXiv  Detail & Related papers  (2026-07-22T15:08:30Z)
• Anchoring on Reality: Breaking the Pseudo-Target Ceiling in Makeup Transfer [70.44549081321442]
  Makeup transfer applies a reference cosmetic style to a source face while preserving its identity and geometry.<n>Current methods rely on weak priors or synthetic pseudo-targets from large-scale editing models.<n>We propose Anchoring on Reality Makeup Transfer (ART), a two-stage framework with a reality-anchored refinement cycle.
  arXiv  Detail & Related papers  (2026-06-30T03:28:01Z)
• RGFVR: Reference-Guided Face Video Restoration with Flow Matching [0.5607590231264274]
  We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration.<n>Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator.<n> Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation.
  arXiv  Detail & Related papers  (2026-06-15T08:39:51Z)
• AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References [52.81991915377852]
  We present AnyID, an ultra-fidelity identity-preservation video generation framework.<n>First, we introduce a scalable omni-referenced architecture that effectively unifies heterogeneous identity inputs into a cohesive representation.<n>Second, we propose a primary-referenced generation paradigm, which designates one reference as a canonical anchor and uses a novel differential prompt to enable precise, attribute-level controllability.
  arXiv  Detail & Related papers  (2026-03-26T08:54:48Z)
• Unmasking Puppeteers: Leveraging Biometric Leakage to Disarm Impersonation in AI-based Videoconferencing [13.359027851861677]
  AI-based talking-head videoconferencing systems reduce bandwidth by sending a compact pose-expression latent and re-synthesizing RGB at the receiver.<n>This latent can be puppeteered, letting an attacker hijack a victim's likeness in real time.<n>We introduce the first biometric leakage defense without ever looking at the reconstructed RGB video.
  arXiv  Detail & Related papers  (2025-10-03T22:37:03Z)
• InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbing [66.48064661467781]
  We introduce sparse-frame video dubbing, a novel paradigm that strategically preserves references to maintain identity, iconic gestures, and camera trajectories.<n>We propose InfiniteTalk, a streaming audio-driven generator designed for infinite-length long sequence dubbing.<n> Comprehensive evaluations on HDTF, CelebV-HQ, and EMTD datasets demonstrate state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-08-19T17:55:23Z)
• Mask-Free Audio-driven Talking Face Generation for Enhanced Visual Quality and Identity Preservation [54.52905471078152]
  We propose a mask-free talking face generation approach while maintaining the 2D-based face editing task.<n>We transform the input images to have closed mouths, using a two-step landmark-based approach trained in an unpaired manner.
  arXiv  Detail & Related papers  (2025-07-28T16:03:36Z)
• Show and Polish: Reference-Guided Identity Preservation in Face Video Restoration [9.481604837168762]
  Face Video Restoration (FVR) aims to recover high-quality face videos from degraded versions.<n>Traditional methods struggle to preserve fine-grained, identity-specific features when degradation is severe.<n>We introduce IP-FVR, a novel method that leverages a high-quality reference face image as a visual prompt to provide identity conditioning during the denoising process.
  arXiv  Detail & Related papers  (2025-07-14T14:01:37Z)
• RIGID: Recurrent GAN Inversion and Editing of Real Face Videos [73.97520691413006]
  GAN inversion is indispensable for applying the powerful editability of GAN to real images. Existing methods invert video frames individually often leading to undesired inconsistent results over time. We propose a unified recurrent framework, named textbfRecurrent vtextbfIdeo textbfGAN textbfInversion and etextbfDiting (RIGID) Our framework learns the inherent coherence between input frames in an end-to-end manner.
  arXiv  Detail & Related papers  (2023-08-11T12:17:24Z)
• Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose [23.211318473026243]
  We propose a self-supervised hybrid model (DAE-GAN) that learns how to reenact face naturally given large amounts of unlabeled videos. Our approach combines two deforming autoencoders with the latest advances in the conditional generation. Experiment results demonstrate the superior quality of reenacted images and the flexibility of transferring facial movements between identities.
  arXiv  Detail & Related papers  (2020-03-29T06:45:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.