Fast LeWorldModel

• URL: http://arxiv.org/abs/2606.26217v1
• Date: Wed, 24 Jun 2026 17:59:59 GMT
• Title: Fast LeWorldModel
• Abstract summary: We propose Fast LeWorldModel (Fast-LeWM), a fast latent world model that replaces repeated local rollout with action prediction.<n>By making action prefixes the basic prediction unit, Fast-LeWM directly models action effects accumulated to different extents over multiple horizons.<n>Fast-LeWM improves average success over LeWM while substantially reducing planning time, achieving lower open-loop latent loss.
• Score: 5.938994204098151
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step latent transition model. This autoregressive rollout makes planning computationally expensive and exposes the predicted trajectory to accumulated latent errors as the horizon grows. We propose Fast LeWorldModel (Fast-LeWM), a fast latent world model that replaces repeated local rollout with action-prefix prediction. Given the current latent and a candidate action sequence, Fast-LeWM encodes its prefixes and predicts the future latents reached after executing those prefixes in parallel. By making action prefixes the basic prediction unit, Fast-LeWM directly models action effects accumulated to different extents over multiple horizons. This prefix-level supervision forces the model to learn how states continuously evolve under different action prefixes, rather than only fitting one-step state transitions. During planning, the predictor can use the last prefix token from the encoded action sequence to evaluate the corresponding future latent without explicitly rolling through each intermediate imagined state. Across multiple tasks, Fast-LeWM improves average success over LeWM while substantially reducing planning time, achieving lower open-loop latent loss whose growth becomes significantly slower as the rollout horizon increases.

Related papers

• Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving [78.83165764484562]
  Drive-HWM is a hierarchical slow--fast world modeling framework that organizes future representation prediction and action generation at complementary temporal scales.<n>Next-frame prediction encourages the fast model to capture imminent scene evolution, while one-step action generation allows decisions to be continuously updated as new observations arrive.
  arXiv  Detail & Related papers  (2026-09-03T09:21:19Z)
• WALL-SS: Scaling Long-horizon World Models via Next-Scale Autoregression [24.010807495676605]
  Generative world models provide robots with predictive models of how the world evolves under interaction.<n>We introduce WALL-SS, a world model that generates visual futures through Scale-wise autoregressive Scaling.<n>We show that WALL-SS improves action following and trajectory accuracy, supports coherent minute-long streaming rollout under bounded memory, and consistently benefits from on-policy alignment.
  arXiv  Detail & Related papers  (2026-08-26T17:57:12Z)
• ActSWM: Action-Sensitive World Models for Long-Horizon Planning in Open-World Games [6.8149466180197]
  We propose ActSWM, an action-sensitive latent world model grounded in a transition-separation principle.<n>Across step-drift analysis, closed-loop Minecraft planning, and cross-game local action recovery, ActSWM preserves larger action-dependent rollout gaps than existing baselines.
  arXiv  Detail & Related papers  (2026-07-29T09:55:54Z)
• TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL [72.7712729541565]
  Autoregressive (AR) video diffusion models enable low-latency streaming generation by synthesizing videos chunk by chunk with cached visual context.<n>A single global prompt does not specify which sub-event should be realized in each chunk, while naively switching to step-wise prompts often leads to delayed reactions, blended step semantics, and error propagation across prompt transitions.<n>We address these challenges with TempAct, a planner--executor reinforcement learning framework that jointly optimize temporal decomposition and step-conditioned execution for temporally plausible AR video generation.
  arXiv  Detail & Related papers  (2026-06-26T12:19:28Z)
• Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning [40.09669638091686]
  We propose a framework that learns to predict future latent states conditioned on action sequences of variable lengths.<n>Experiments show that Variable-length Latent World Models significantly improve latent space world models.
  arXiv  Detail & Related papers  (2026-06-19T21:50:15Z)
• Next Forcing: Causal World Modeling with Multi-Chunk Prediction [65.05727210375643]
  Next Forcing is a multi-chunk prediction framework for causal world modeling.<n>It enables faster training, higher accuracy, and accelerated inference.<n>It achieves 93.1% relative improvement over LingBot-VA at 5k training steps and 2.3x faster convergence.
  arXiv  Detail & Related papers  (2026-06-09T17:59:22Z)
• LeapTS: Rethinking Time Series Forecasting as Adaptive Multi-Horizon Scheduling [74.94985663101906]
  We present LeapTS, a novel framework that reformulates time series forecasting as a dynamic scheduling process over the prediction horizon.<n>We show that LeapTS improves overall forecasting performance by at least 7.4% while achieving a 2.6$times$ to 5.3$times$ inference speedup over representative Transformer-based models.
  arXiv  Detail & Related papers  (2026-05-11T09:54:02Z)
• ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model [53.15040805435013]
  Vision-language models (VLMs) provide strong semantic grounding and general knowledge by reasoning over uniformly sampled frames.<n>We propose a VLM-guided JEPA-style latent world modeling framework that combines dense-frame dynamics modeling with long-horizon semantic guidance.
  arXiv  Detail & Related papers  (2026-03-23T17:59:42Z)
• MWM: Mobile World Models for Action-Conditioned Consistent Prediction [19.819967401664464]
  We propose a mobile world model for planning-based image-goal navigation.<n>We introduce a two-stage training framework that combines structure pretraining with Action-Conditioned Consistency (ACC) post-training to improve rollout consistency.<n>Our experiments on benchmark and real-world tasks demonstrate consistent gains in visual fidelity, trajectory accuracy, planning success, and inference efficiency.
  arXiv  Detail & Related papers  (2026-03-08T20:54:50Z)
• OmniSAT: Compact Action Token, Faster Auto Regression [70.70037017501357]
  We introduce an Omni Swift Action Tokenizer, which learns a compact, transferable action representation.<n>The resulting discrete tokenization shortens the training sequence by 6.8$times$, and lowers the target entropy.
  arXiv  Detail & Related papers  (2025-10-08T03:55:24Z)
• Masked Temporal Interpolation Diffusion for Procedure Planning in Instructional Videos [32.71627274876863]
  We address the challenge of procedure planning in instructional videos, aiming to generate coherent and task-aligned action sequences from start and end visual observations.<n>Previous work has mainly relied on text-level supervision to bridge the gap between observed states and unobserved actions, but it struggles with capturing intricate temporal relationships among actions.<n>We propose the Masked Temporal Interpolation Diffusion Diffusion model that introduces a latent space temporal temporal module within the diffusion model.
  arXiv  Detail & Related papers  (2025-07-04T08:54:59Z)
• AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving [59.94343412438211]
  We introduce the GPT style next token motion prediction into motion prediction. Different from language data which is composed of homogeneous units -words, the elements in the driving scene could have complex spatial-temporal and semantic relations. We propose to adopt three factorized attention modules with different neighbors for information aggregation and different position encoding styles to capture their relations.
  arXiv  Detail & Related papers  (2024-03-20T06:22:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.