LongVie 2: Multimodal Controllable Ultra-Long Video World Model

• URL: http://arxiv.org/abs/2512.13604v1
• Date: Mon, 15 Dec 2025 17:59:58 GMT
• Title: LongVie 2: Multimodal Controllable Ultra-Long Video World Model
• Abstract summary: LongVie 2 is an end-to-end autoregressive framework trained in three stages.<n>LongVie 2 achieves state-of-the-art performance in long-range controllability, temporal coherence, and visual fidelity.
• Score: 94.85126937285527
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Building video world models upon pretrained video generation systems represents an important yet challenging step toward general spatiotemporal intelligence. A world model should possess three essential properties: controllability, long-term visual quality, and temporal consistency. To this end, we take a progressive approach-first enhancing controllability and then extending toward long-term, high-quality generation. We present LongVie 2, an end-to-end autoregressive framework trained in three stages: (1) Multi-modal guidance, which integrates dense and sparse control signals to provide implicit world-level supervision and improve controllability; (2) Degradation-aware training on the input frame, bridging the gap between training and long-term inference to maintain high visual quality; and (3) History-context guidance, which aligns contextual information across adjacent clips to ensure temporal consistency. We further introduce LongVGenBench, a comprehensive benchmark comprising 100 high-resolution one-minute videos covering diverse real-world and synthetic environments. Extensive experiments demonstrate that LongVie 2 achieves state-of-the-art performance in long-range controllability, temporal coherence, and visual fidelity, and supports continuous video generation lasting up to five minutes, marking a significant step toward unified video world modeling.

Related papers

• EchoWM: Open and Enterable Omnimodal World Models [71.49148067556887]
  EchoWM is an omnimodal world model for enterable generative media.<n>It responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech.
  arXiv  Detail & Related papers  (2026-08-24T12:39:59Z)
• MBench: A Comprehensive Benchmark on Memory Capability for Video World Models [36.71271805993198]
  We present textbfMBench, a benchmark dedicated to quantifying and evaluating the memory capability of video world models.<n>Our benchmark is built upon rigorously curated real-captured long videos, and evaluated by rule-based quantitative matrices and VLM.
  arXiv  Detail & Related papers  (2026-05-30T16:17:33Z)
• DCARL: A Divide-and-Conquer Framework for Autoregressive Long-Trajectory Video Generation [10.575655795360937]
  DCARL is a novel divide-and-conquer, autoregressive framework that combines the structural stability of the divide-and-conquer scheme with the high-fidelity generation of VDMs.<n>Our method achieves superior performance in both visual quality and camera adherence compared to state-of-the-art autoregressive and divide-and-conquer baselines.
  arXiv  Detail & Related papers  (2026-03-25T22:07:09Z)
• SkyReels-V3 Technique Report [23.793804843416606]
  Video robustness serves as a cornerstone for building world models, where contextual inference stands as the defining test of capability.<n>We present SkyReels-V3, a conditional video generation model, built upon a unified multimodal in-context learning framework with diffusion Transformers.<n>SkyReels-V3 model supports three core generative paradigms within a single architecture: images-to-video synthesis, video-to-video extension and audio-guided video generation.
  arXiv  Detail & Related papers  (2026-01-24T06:08:12Z)
• KlingAvatar 2.0 Technical Report [43.949604396366425]
  Our model effectively addresses the challenges of efficient, multimodally aligned long-form high-resolution video generation.<n>It delivers enhanced visual clarity, realistic lip-teeth rendering with accurate lip synchronization, strong identity preservation, and coherent multimodal instruction following.
  arXiv  Detail & Related papers  (2025-12-15T13:30:51Z)
• Endless World: Real-Time 3D-Aware Long Video Generation [57.411689597435334]
  Endless World is a real-time framework for infinite, 3D-consistent video generation.<n>We introduce a conditional autoregressive training strategy that aligns newly generated content with existing video frames.<n>Our 3D injection mechanism enforces physical plausibility and geometric consistency throughout extended sequences.
  arXiv  Detail & Related papers  (2025-12-13T19:06:12Z)
• WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception [40.96323549891244]
  Current methods predominantly rely on RGB signals, leading to accumulated errors in object structure and motion over extended durations.<n>We introduce WorldWeaver, a robust framework for long video generation that jointly models RGB frames and perceptual conditions within a unified long-horizon modeling scheme.<n>Our training framework offers three key advantages. First, by jointly predicting perceptual conditions and color information from a unified representation, it significantly enhances temporal consistency and motion dynamics.
  arXiv  Detail & Related papers  (2025-08-21T16:57:33Z)
• LongVie: Multimodal-Guided Controllable Ultra-Long Video Generation [90.02820796070135]
  LongVie is an end-to-end autoregressive framework for controllable long video generation.<n>LongVie achieves state-of-the-art performance in long-range controllability, consistency, and quality.
  arXiv  Detail & Related papers  (2025-08-05T17:59:58Z)
• Seedance 1.0: Exploring the Boundaries of Video Generation Models [71.26796999246068]
  Seedance 1.0 is a high-performance and inference-efficient video foundation generation model.<n>It integrates multi-source curation data augmented with precision and meaningful video captioning.<n>Seedance 1.0 can generate a 5-second video at 1080p resolution only with 41.4 seconds ( NVIDIA-L20)
  arXiv  Detail & Related papers  (2025-06-10T17:56:11Z)
• RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks [93.18404922542702]
  We present a novel video generative model designed to address long-term spatial and temporal dependencies. Our approach incorporates a hybrid explicit-implicit tri-plane representation inspired by 3D-aware generative frameworks. Our model synthesizes high-fidelity video clips at a resolution of $256times256$ pixels, with durations extending to more than $5$ seconds at a frame rate of 30 fps.
  arXiv  Detail & Related papers  (2024-01-11T16:48:44Z)
• Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution [65.91317390645163]
  Upscale-A-Video is a text-guided latent diffusion framework for video upscaling. It ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences. It also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation.
  arXiv  Detail & Related papers  (2023-12-11T18:54:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.