AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising

• URL: http://arxiv.org/abs/2603.14331v2
• Date: Wed, 18 Mar 2026 06:34:30 GMT
• Title: AvatarForcing: One-Step Streaming Talking Avatars via Local-Future Sliding-Window Denoising
• Abstract summary: AvatarForcing is a one-step streaming diffusion framework that denoises a fixed local-future window with heterogeneous noise levels.<n>Experiments on standard benchmarks and a new 400-video long-form benchmark show strong visual quality and lip synchronization at 34 ms/frame.
• Score: 15.787466786514164
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Real-time talking avatar generation requires low latency and minute-level temporal stability. Autoregressive (AR) forcing enables streaming inference but suffers from exposure bias, which causes errors to accumulate and become irreversible over long rollouts. In contrast, full-sequence diffusion transformers mitigate drift but remain computationally prohibitive for real-time long-form synthesis. We present AvatarForcing, a one-step streaming diffusion framework that denoises a fixed local-future window with heterogeneous noise levels and emits one clean block per step under constant per-step cost. To stabilize unbounded streams, the method introduces dual-anchor temporal forcing: a style anchor that re-indexes RoPE to maintain a fixed relative position with respect to the active window and applies anchor-audio zero-padding, and a temporal anchor that reuses recently emitted clean blocks to ensure smooth transitions. Real-time one-step inference is enabled by two-stage streaming distillation with offline ODE backfill and distribution matching. Experiments on standard benchmarks and a new 400-video long-form benchmark show strong visual quality and lip synchronization at 34 ms/frame using a 1.3B-parameter student model for realtime streaming. Our page is available at: https://cuiliyuan121.github.io/AvatarForcing/

Related papers

• LiveVVT: High-Fidelity Video Virtual Try-On in Real Time [36.4434648528291]
  Video Virtual Try-On (VVT) achieves high visual fidelity through bidirectional modeling.<n>We introduce LiveVVT, a rolling streaming diffusion framework that preserves bidirectional bounded modeling.<n>We show that Experiments on paired and unpaired long-sequence benchmarks demonstrate superior generation quality over similarly sized models.
  arXiv  Detail & Related papers  (2026-08-27T07:06:51Z)
• LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time [26.186924581106087]
  We present the first animation system to combine real-time streaming with stable long-form generation at billion scale.<n>LiveAnimate maintains nearly constant perceptual quality and identity from the first 30 seconds to the final minute.<n>These results establish a new operating point in quality, latency, and duration for interactive full-body animation.
  arXiv  Detail & Related papers  (2026-08-12T07:35:52Z)
• Reflex: Real-Time VLA Control through Streaming Inference [12.85847066934547]
  We present textbfReflex, a framework that enables textitreal-time streaming inference for flow matching policies.<n>On LIBERO and Kinetix benchmarks, Reflex achieves a 2.58$times$ inference speedup and 50Hz stable streaming, reducing reaction latency by up to 54%.
  arXiv  Detail & Related papers  (2026-07-16T07:56:43Z)
• OmniForcing: Unleashing Real-time Joint Audio-Visual Generation [51.031726911410594]
  Recent joint audio-visual diffusion models achieve remarkable generation quality but suffer from high latency.<n>We propose OmniForcing, the first framework to distill an offline, dual-stream bidirectional diffusion model into a high-fidelity streaming autore generator.
  arXiv  Detail & Related papers  (2026-03-12T08:17:36Z)
• Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion [40.885162663758585]
  We propose textbfAnchor Forcing, a cache-centric framework with two designs.<n>First, an anchor-guided re-cache mechanism stores KV states in anchor caches and warm-starts re-cache from these anchors at each prompt switch.<n>Second, a tri-region RoPE with region-specific reference origins reconciles unbounded streaming indices with the pretrained RoPE regime to better retain motion priors.
  arXiv  Detail & Related papers  (2026-03-12T07:40:06Z)
• HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoising [52.237486207964245]
  HiAR is a hierarchical denoising framework that reverses the conventional generation order.<n>It performs causal generation across all blocks at every denoising step, so that each block is always conditioned on context at the same noise level.<n>On VBench (20s generation), HiAR achieves the best overall score and the lowest temporal drift among all compared methods.
  arXiv  Detail & Related papers  (2026-03-09T17:58:16Z)
• JoyAvatar: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusion [19.420963062956222]
  JoyAvatar is an audio-driven autoregressive model capable of real-time inference and infinite-length video generation.<n>Our model achieves competitive results in visual quality, temporal consistency, and lip synchronization.
  arXiv  Detail & Related papers  (2025-12-12T10:06:01Z)
• Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length [57.458450695137664]
  We present Live Avatar, an algorithm-system co-designed framework for efficient, high-fidelity, and infinite-length avatar generation.<n>Live Avatar is first to achieve practical, real-time, high-fidelity avatar generation at this scale.
  arXiv  Detail & Related papers  (2025-12-04T11:11:24Z)
• StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation [91.45910771331741]
  Current diffusion models for audio-driven avatar video generation struggle to synthesize long videos with natural audio synchronization and identity consistency.<n>This paper presents StableAvatar, the first end-to-end video diffusion transformer that synthesizes infinite-length high-quality videos without post-processing.
  arXiv  Detail & Related papers  (2025-08-11T17:58:24Z)
• StreamDiffusion: A Pipeline-level Solution for Real-time Interactive Generation [52.56469577812338]
  We introduce StreamDiffusion, a real-time diffusion pipeline for interactive image generation.<n>Existing diffusion models are adept at creating images from text or image prompts, yet they often fall short in real-time interaction.<n>We present a novel approach that transforms the original sequential denoising into the denoising process.
  arXiv  Detail & Related papers  (2023-12-19T18:18:33Z)
• Real-time Streaming Video Denoising with Bidirectional Buffers [48.57108807146537]
  Real-time denoising algorithms are typically adopted on the user device to remove the noise involved during the shooting and transmission of video streams. Recent multi-output inference works propagate the bidirectional temporal feature with a parallel or recurrent framework. We propose a Bidirectional Streaming Video Denoising framework, to achieve high-fidelity real-time denoising for streaming videos with both past and future temporal receptive fields.
  arXiv  Detail & Related papers  (2022-07-14T14:01:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.