WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models

• URL: http://arxiv.org/abs/2606.31672v3
• Date: Mon, 06 Jul 2026 17:27:19 GMT
• Title: WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
• Abstract summary: We introduce WorldRoamBench, an open-world benchmark for long-horizon stability across four dimensions.<n>The benchmark comprises 600+ test cases across Nature, Urban, and Indoor scenes in first/third-person views with WASD 10-60s continuous interaction.
• Score: 37.59051701511746
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite rapid progress in interactive world models (IWMs), existing benchmarks evaluate action following only at trajectory level and ignore memory and interaction physics. We introduce WorldRoamBench, an open-world benchmark for long-horizon stability across four dimensions, each with tailored innovations: (i) Action: per-frame action metric bypassing cross-model semantic scale disparity and exposing failures hidden by trajectory; (ii) Vision: segment-based drift metric capturing non-monotonic mid-sequence collapse missed by start-vs-end comparisons; (iii) Physics: controllability-gated evaluation over mechanics, optics, and 3D consistency, scoring plausibility under faithful action execution; (iv) Memory: action-decoupled protocol evaluating scene memory via transition-localized 3D point-cloud reconstruction and subject memory via tracking-plus-VLM reasoning. The benchmark comprises 600+ test cases across Nature, Urban, and Indoor scenes in first/third-person views with WASD 10-60s continuous interaction. Evaluating 10+ open/closed-source models reveals none reliably satisfies all dimensions; even the best achieves only moderate scores. Advances on WorldRoamBench are steps toward IWMs that are stable, physically grounded, memory-faithful, and deployable in real-world applications.

Related papers

• KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding [58.541098216700796]
  evaluating the physical consistency of embodied world models is a critical open challenge.<n>Existing frameworks almost exclusively rely on Inverse Dynamics Models(IDMs) for action extraction.<n>We present KineBench, an IDM-free closed-loop benchmark for EWMs.
  arXiv  Detail & Related papers  (2026-07-22T08:04:17Z)
• MemoBench: Benchmarking World Modeling in Dynamically Changing Environments [72.23517478870605]
  We introduce MemoBench, a diagnostic benchmark built around the disappear-and-reappear paradigm in dynamically changing environments.<n>We curate 360 ground-truth clips spanning synthetic and real-world scenes, and design an evaluation suite combining automated metrics with VQA-based assessment.
  arXiv  Detail & Related papers  (2026-06-25T20:37:39Z)
• Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulation [55.42006264038458]
  Action-conditioned world models have emerged as a promising paradigm for robot learning.<n>Mem-World is a memory-augmented multi-view action-conditioned world model.<n>We present W-VMem, a 4D wrist-view-centered surfel-indexed memory that anchors historical observations to temporally evolving surface elements.
  arXiv  Detail & Related papers  (2026-06-17T11:42:00Z)
• WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation [56.5415838759151]
  WBench is a comprehensive benchmark for evaluation of interactive world models.<n>It covers video quality, setting adherence, interaction adherence, consistency, and physics compliance.<n>It contains 289 test cases and 1,058 interaction turns, covering diverse scenes, styles, subjects, and both first- and third-person perspectives.
  arXiv  Detail & Related papers  (2026-05-25T14:01:31Z)
• WorldMark: A Unified Benchmark Suite for Interactive Video World Models [29.83820642224732]
  We introduce WorldMark, the first benchmark that provides a common playing field for interactive Image-to-Video world models.<n>WorldMark contributes: (1) a unified action-mapping layer that translates a shared WASD-style action vocabulary into each model's native control format, enabling apples-to-apples comparison across six major models on identical scenes and trajectories; (2) a hierarchical test suite of 500 evaluation cases covering first- and third-person viewpoints, photorealistic and stylized scenes, and three difficulty tiers from Easy to Hard spanning 20-60s; and (3) a modular evaluation toolkit for Visual Quality, Control Alignment, and World Consistency
  arXiv  Detail & Related papers  (2026-04-23T13:50:47Z)
• Can Vision Foundation Models Navigate? Zero-Shot Real-World Evaluation and Lessons Learned [5.561294055181353]
  Visual Navigation Models (VNMs) promise generalizable, robot navigation by learning from large-scale visual demonstrations.<n>We present a real-world evaluation of five state-of-the-art VNMs across two robot platforms and five environments spanning indoor and outdoor settings.
  arXiv  Detail & Related papers  (2026-03-26T22:04:49Z)
• Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models [39.648000265543445]
  Video-based world models have emerged along two dominant paradigms: video generation and 3D reconstruction.<n>We argue that the future of world modeling lies in 4D generation, which jointly models spatial structure and temporal evolution.<n>We propose Omni--WorldBench, a benchmark specifically designed to evaluate the interactive response capabilities of world models in 4D settings.
  arXiv  Detail & Related papers  (2026-03-23T17:10:29Z)
• MIND: Benchmarking Memory Consistency and Action Control in World Models [28.346879515303755]
  We introduce MIND, the first open-domain closed-loop revisited benchmark for evaluating Memory consIstency and action coNtrol in worlD models.<n>MIND contains 250 high-quality videos at 1080p and 24 FPS, including 100 (first-person) + 100 (third-person) video clips under a shared action space.<n>We design various action spaces, including different character movement speeds and camera rotation angles, to evaluate the action generalization capability across different action spaces under shared scenes.
  arXiv  Detail & Related papers  (2026-02-08T15:57:23Z)
• Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory [101.2076718776139]
  We propose a robust interactive world model capable of maintaining coherent visual memory over 1000+ frames in complex real-world environments.<n>We introduce a Pose-free Memory (HPMC) that distills historical latents into a fixed-budget geometric representation.<n>We also propose an Uncertainty-aware Action Labeling module that discretizes continuous motion into a tri-state logic.
  arXiv  Detail & Related papers  (2026-02-02T17:52:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.