RGFVR: Reference-Guided Face Video Restoration with Flow Matching

• URL: http://arxiv.org/abs/2606.16401v1
• Date: Mon, 15 Jun 2026 08:39:51 GMT
• Title: RGFVR: Reference-Guided Face Video Restoration with Flow Matching
• Abstract summary: We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration.<n>Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator.<n> Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation.
• Score: 0.5607590231264274
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Face video restoration from degraded observations is challenging, as it requires simultaneously recovering visual fidelity, temporal consistency, and subject identity. Existing approaches are often either reference-free, which can lead to identity loss when person-specific facial details are lost, or subject-specific, which limits generalization to unseen identities. We propose a subject-agnostic, reference-guided framework for identity-preserving face video restoration. Our method introduces bimodal perceptual-descriptive identity conditioning into a pretrained flow-based text-to-video generator and employs a two-stage training strategy to strengthen identity guidance during restoration. Experiments show that our approach improves restoration fidelity, temporal consistency, and identity preservation, achieving superior performance under challenging video degradations, including downsampling, blur, noise, and compression artifacts. The code is available under: https://github.com/batuhanntosun/RG-FVR.

Related papers

• Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation [79.94088803584262]
  Identity-preserving video generation (IPVG) aims to synthesize high-fidelity videos that follow text prompts while preserving a reference identity.<n>We propose ST-DRC, an effective Spatial-Temporal Decoupled Reference Conditioning framework for identity-preserving text-to-video generation.<n>We show that ST-DRC achieves strong identity preservation, prompt alignment, temporal consistency, and video quality with a lightweight design built on LTX-2.3.
  arXiv  Detail & Related papers  (2026-06-01T16:12:18Z)
• Preserving Source Video Realism: High-Fidelity Face Swapping for Cinematic Quality [48.231357260785195]
  We present LivingSwap, the first video reference guided face swapping model.<n>By combining video conditioning with video reference guidance, the model performs temporal stitching to ensure stable identity and high-fidelity reconstruction.<n>Our method integrates the target identity with the source video's expressions, lighting, and motion, while significantly reducing manual effort in production.
  arXiv  Detail & Related papers  (2025-12-08T19:00:04Z)
• CodeFormer++: Blind Face Restoration Using Deformable Registration and Deep Metric Learning [1.1666234644810893]
  We present CodeFormer++, a novel framework that maximizes the utility of generative priors for high-quality face restoration while preserving identity.<n>Our method makes three key contributions: (1) a learning-based deformable face registration module that semantically aligns generated and restored faces; (2) a texture guided restoration network to dynamically extract and transfer the texture of generated face to boost the quality of identity-preserving restored face; and (3) the integration of deep metric learning for BFR with the generation of informative positive and hard negative samples to better fuse identity- preserving and generative features.
  arXiv  Detail & Related papers  (2025-10-06T00:53:50Z)
• From Large Angles to Consistent Faces: Identity-Preserving Video Generation via Mixture of Facial Experts [69.44297222099175]
  We introduce a Mixture of Facial Experts (MoFE) that captures distinct but mutually reinforcing aspects of facial attributes.<n>To mitigate dataset limitations, we have tailored a data processing pipeline centered on two key aspects: Face Constraints and Identity Consistency.<n>We have curated and refined a Large Face Angles (LFA) dataset from existing open-source human video datasets.
  arXiv  Detail & Related papers  (2025-08-13T04:10:16Z)
• Audio-Assisted Face Video Restoration with Temporal and Identity Complementary Learning [56.62425904247682]
  We propose a General Audio-assisted face Video restoration Network (GAVN) to address various types of streaming video distortions.<n>GAVN first captures inter-frame temporal features in the low-resolution space to restore frames coarsely and save computational cost.<n>Finally, the reconstruction module integrates temporal features and identity features to generate high-quality face videos.
  arXiv  Detail & Related papers  (2025-08-06T07:38:27Z)
• Show and Polish: Reference-Guided Identity Preservation in Face Video Restoration [9.481604837168762]
  Face Video Restoration (FVR) aims to recover high-quality face videos from degraded versions.<n>Traditional methods struggle to preserve fine-grained, identity-specific features when degradation is severe.<n>We introduce IP-FVR, a novel method that leverages a high-quality reference face image as a visual prompt to provide identity conditioning during the denoising process.
  arXiv  Detail & Related papers  (2025-07-14T14:01:37Z)
• Proteus-ID: ID-Consistent and Motion-Coherent Video Customization [17.792780924370103]
  Video identity customization seeks to synthesize realistic, temporally coherent videos of a specific subject, given a single reference image and a text prompt.<n>This task presents two core challenges: maintaining identity consistency while aligning with the described appearance and actions, and generating natural, fluid motion without unrealistic stiffness.<n>We introduce Proteus-ID, a novel diffusion-based framework for identity-consistent and motion-coherent video customization.
  arXiv  Detail & Related papers  (2025-06-30T11:05:32Z)
• Reference-Guided Identity Preserving Face Restoration [54.10295747851343]
  Preserving face identity is a critical yet persistent challenge in diffusion-based image restoration.<n>This paper introduces a novel approach that maximizes reference face utility for improved face restoration and identity preservation.
  arXiv  Detail & Related papers  (2025-05-28T02:46:34Z)
• EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusion [3.592206475366951]
  Existing methods struggle with "copy-paste" artifacts and low similarity issues.<n>We propose EchoVideo, which integrates high-level semantic features from text to capture clean facial identity representations.<n>It achieves excellent results in generating high-quality, controllability and fidelity videos.
  arXiv  Detail & Related papers  (2025-01-23T08:06:11Z)
• SVFR: A Unified Framework for Generalized Video Face Restoration [86.17060212058452]
  Face Restoration (FR) is a crucial area within image and video processing, focusing on reconstructing high-quality portraits from degraded inputs.<n>We propose a novel approach for the Generalized Video Face Restoration task, which integrates video BFR, inpainting, and colorization tasks.<n>This work advances the state-of-the-art in video FR and establishes a new paradigm for generalized video face restoration.
  arXiv  Detail & Related papers  (2025-01-02T12:51:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.