LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing

• URL: http://arxiv.org/abs/2606.26740v1
• Date: Thu, 25 Jun 2026 08:24:03 GMT
• Title: LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing
• Abstract summary: We present a novel streaming video editing framework that performs causal, frame-by-frame editing with strong content preservation and real-time responsiveness.<n>Our method achieves state-of-the-art visual quality among streaming baselines while drastically boosting inference speed to 12.66 FPS, making it suitable for interactive and augmented reality applications.
• Score: 19.90420626930003
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Streaming video editing has made rapid progress, yet practical deployment is still limited by two core issues: maintaining stable backgrounds and non-edited regions over time, and achieving the low latency required for real-time interactive scenarios. Meanwhile, recent streaming video generation methods are mostly developed for synthesis and cannot be directly applied to editing due to the strict preservation requirement and region-specific control. In this work, we present a novel streaming video editing framework that performs causal, frame-by-frame editing with strong content preservation and real-time responsiveness. Our key design is a three-stage distillation pipeline that progressively transfers editing capability from a powerful bidirectional foundation model to an efficient unidirectional streaming editor, enabling stable long-horizon edits without sacrificing visual fidelity. To further support real-time deployment, we introduce an AR-oriented mask cache that reuses region-related computation across frames, substantially reducing redundant processing and accelerating inference. Finally, we establish a dedicated benchmark for streaming video editing. Extensive evaluations demonstrate that our method achieves state-of-the-art visual quality among streaming baselines while drastically boosting inference speed to 12.66 FPS, making it suitable for interactive and augmented reality applications.

Related papers

• EditaLive! Unified Character Video Editing for Live Streaming [59.93029261408041]
  EditaLive is a novel framework for real-time streaming character video editing.<n>It delivers state-of-the-art editing performance with faithful preservation of facial expressions and low-latency real-time streaming inference.
  arXiv  Detail & Related papers  (2026-08-27T13:37:45Z)
• EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing [67.99022753510475]
  EditStream is a unified framework for interactive video generation and editing.<n>It unifies multiple video creation and manipulation tasks within a single DiT-based model.<n>It supports Text-to-Video, Image-to-Video, Video-to-Video, Editing propagation, Reference-guided Video Editing, and Camera Pose Change.
  arXiv  Detail & Related papers  (2026-08-16T07:27:18Z)
• SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing [76.349958946335]
  We present SAMA (factorized Semantic Anchoring and Motion Alignment), a framework that factorizes video editing into semantic anchoring and motion modeling.<n>First, we introduce Semantic Anchoring, which establishes a reliable visual anchor by jointly predicting semantic tokens and video latents at sparse anchor frames.<n>Second, Motion Alignment pre-trains the same backbone on motion-centric video restoration pretext tasks.
  arXiv  Detail & Related papers  (2026-03-19T17:59:51Z)
• VRWKV-Editor: Reducing quadratic complexity in transformer-based video editing [0.13381749415517016]
  We introduce VRWKV-Editor, a novel video editing model that integrates a linear-temporal aggregation module into video-based diffusion models.<n> VRWKV-Editor achieves up to 3.7x speedup and 60% lower memory usage compared to state-of-the-art diffusion-based video editing methods.
  arXiv  Detail & Related papers  (2025-09-30T09:30:23Z)
• FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editing [2.7248421583285265]
  FlowDirector is a novel inversion-free video editing framework.<n>Our framework models the editing process as a direct evolution in data space.<n>To achieve localized and controllable edits, we introduce an attention-guided masking mechanism.
  arXiv  Detail & Related papers  (2025-06-05T13:54:40Z)
• VIA: Unified Spatiotemporal Video Adaptation Framework for Global and Local Video Editing [91.60658973688996]
  We introduce VIA, a unified Video Adaptation framework for global local video editing, pushing the limits of consistently editing minute-long videos.<n>To ensure local consistency within individual frames, we designed test-time editing adaptation to adapt a pre-trained image editing model.<n>We show that VIA can achieve consistent long video editing in minutes, unlocking the potential for advanced video editing tasks over long video sequences.
  arXiv  Detail & Related papers  (2024-06-18T17:51:37Z)
• COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing [57.76170824395532]
  Video editing is an emerging task, in which most current methods adopt the pre-trained text-to-image (T2I) diffusion model to edit the source video.<n>We propose COrrespondence-guided Video Editing (COVE) to achieve high-quality and consistent video editing.<n>COVE can be seamlessly integrated into the pre-trained T2I diffusion model without the need for extra training or optimization.
  arXiv  Detail & Related papers  (2024-06-13T06:27:13Z)
• Streaming Video Diffusion: Online Video Editing with Diffusion Models [30.55613486291111]
  We present a novel task called online video editing, which is designed to edit textbfstreaming frames while maintaining temporal consistency. Our model can edit long, high-quality videos with remarkable results, achieving a real-time inference speed of 15.2 FPS at a resolution of 512x512.
  arXiv  Detail & Related papers  (2024-05-30T06:16:33Z)
• FastVideoEdit: Leveraging Consistency Models for Efficient Text-to-Video Editing [8.907836546058086]
  Existing approaches relying on image generation models for video editing suffer from time-consuming one-shot fine-tuning, additional condition extraction, or DDIM inversion. We propose FastVideoEdit, an efficient zero-shot video editing approach inspired by Consistency Models (CMs) Our method enables direct mapping from source video to target video with strong preservation ability utilizing a special variance schedule.
  arXiv  Detail & Related papers  (2024-03-10T17:12:01Z)
• Object-Centric Diffusion for Efficient Video Editing [64.71639719352636]
  Diffusion-based video editing has reached impressive quality. Such solutions typically incur heavy memory and computational costs to generate temporally-coherent frames. We propose modifications that allow significant speed-ups whilst maintaining quality.
  arXiv  Detail & Related papers  (2024-01-11T08:36:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.