ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

• URL: http://arxiv.org/abs/2607.19191v1
• Date: Tue, 21 Jul 2026 15:26:50 GMT
• Title: ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU
• Abstract summary: ABot-World-0 is an action-conditioned video world model for real-time, long-horizon closed-loop interaction.<n>WorldExplorer performs agent-driven collection guided by training feedback.<n> unified pipeline applies 14 deterministic quality checks, VLM-based assessment, and synchronized action and text annotation.
• Score: 41.37131555577374
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present ABot-World-0, an action-conditioned video world model for real-time, long-horizon closed-loop interaction, supported by a multi-source data infrastructure spanning AAA games, simulation engines, and internet videos to learn controllable world dynamics. WorldExplorer performs agent-driven collection guided by training feedback, while a unified pipeline applies 14 deterministic quality checks, VLM-based assessment, and synchronized action and text annotation. We progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduce LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift. Raw keyboard actions provide a unified control interface for scene roaming and third-person character interaction, while reference-character memory provides persistent appearance cues for identity consistency during third-person rollouts. For deployment, we co-design a streaming inference stack with a lightweight VAE decoder, efficient attention, memory-aware scheduling, and low-bit DiT inference. Across optimized low-bit configurations, ABot-World-0 streams 720P video at up to 16 FPS on a single NVIDIA RTX 5090 desktop GPU, with 1.2s action-to-first-frame latency and approximately 19GiB peak VRAM. Experiments on WorldRoamBench and extended interactive rollouts demonstrate competitive controllability and coherent long-horizon world evolution.

Related papers

• Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds [60.18437892555415]
  We present JoyAI-Echo-1.5, a unified audio-visual generation system with two purpose-built variants.<n>The long-video variant introduces composable cross-shot memory that aggregates visual evidence across multiple prior shots and speaker cues derived from speech-filtered full-shot audio.<n>The world-model variant converts heterogeneous navigation inputs into calibrated metric 6-DoF camera trajectories and injects them through a geometry-aware conditioning pathway.
  arXiv  Detail & Related papers  (2026-08-24T15:31:12Z)
• ForgeWM: Progressive Causal Training for Few-Step Action-Conditioned Video World Models [45.42265012012433]
  We introduce ForgeWM, a framework that transforms a bidirectional action-conditioned video generator into efficient few-step world models.<n>On paired Minecraft trajectories, ForgeWM leads the evaluated systems in Imaging Quality, reference-aligned motion-profile agreement, action-sign accuracy, and mouse-control accuracy.
  arXiv  Detail & Related papers  (2026-08-14T07:13:34Z)
• AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report [39.20781986625199]
  AlayaWorld is an interactive long-horizon video world model that generates 24-fps video at 540p and 720p.<n>Built on a 15B video diffusion transformer, AlayaWorld generates short latent chunks autoregressively under camera trajectories.<n>On iWorld-Bench, AlayaWorld achieves the best performance over long-horizon generation.
  arXiv  Detail & Related papers  (2026-07-20T17:15:41Z)
• DriftWorld: Fast World Modeling through Drifting [49.014235003131596]
  We introduce DriftWorld, an action-conditioned world model based on drifting generative models.<n>Rather than denoising iteratively at inference, DriftWorld learns an action-conditioned drift during training.<n>By producing rollouts both accurate and fast, DriftWorld achieves state-of-the-art decision-making performance.
  arXiv  Detail & Related papers  (2026-07-16T14:37:43Z)
• Infinite Worlds with Versatile Interactions [72.56254206708059]
  LingBot-World 2.0 (also known as LingBot-World-Infinity) is an advanced iteration of LingBot-World.<n>This update introduces highly diverse interactive elements, comprising a broader spectrum of actions.<n>To facilitate a shared experience, we develop an interface that permits multiple players to simultaneously immerse themselves in this vivid world simulator.
  arXiv  Detail & Related papers  (2026-07-08T15:33:25Z)
• CausalDrive: Real-time Causal World Models for Autonomous Driving [60.66609721457312]
  We present CausalDrive, a controllable, real-time foundation driving world.<n>CaulDrive operates solely on the initial front-view frame, the ego-vehicle's trajectory, and a macroscopic text prompt.<n>We demonstrate its versatility across three downstream applications: (1) generative closed-loop evaluation with significantly mitigated collision artifacts, (2) large-scale Reinforcement Learning (RL) post-training driven by a Video2Reward module, and (3) real-time human-in-the-loop simulation.
  arXiv  Detail & Related papers  (2026-06-13T15:04:44Z)
• Incantation: Natural Language as the Action Interface for Multi-Entity Video World Models [18.614835778452345]
  Incantation is the first interactive video world model with per-latent-frame natural-language conditioning.<n>We surpass the Action-Index baseline on cross-entity transfer and out-of-vocabulary prompts.<n>We apply the same architecture and training recipe to The King of Fighters, changing only the per-entity action vocabulary slots.
  arXiv  Detail & Related papers  (2026-05-18T16:12:52Z)
• RELIC: Interactive Video World Model with Long-Horizon Memory [74.81433479334821]
  A truly interactive world model requires real-time long-horizon streaming, consistent spatial memory, and precise user control.<n>We present RELIC, a unified framework that tackles these three challenges altogether.<n>Given a single image and a text description, RELIC enables memory-aware, long-duration exploration of arbitrary scenes in real time.
  arXiv  Detail & Related papers  (2025-12-03T18:29:20Z)
• MotionStream: Real-Time Video Generation with Interactive Motion Controls [60.403597895657505]
  We present MotionStream, enabling sub-second latency with up to 29 FPS streaming generation on a single GPU.<n>Our approach begins by augmenting a text-to-video model with motion control, which generates high-quality videos that adhere to the global text prompt and local motion guidance, but does not perform inference on the fly.<n>Our models achieve state-of-the-art results in motion following and video quality while being two orders of magnitude faster, uniquely enabling infinite-length streaming.
  arXiv  Detail & Related papers  (2025-11-03T06:37:53Z)
• Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model [15.16063778402193]
  Matrix-Game 2.0 is an interactive world model generates long videos on-the-fly via few-step auto-regressive diffusion.<n>It can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS.
  arXiv  Detail & Related papers  (2025-08-18T15:28:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.