Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence

• URL: http://arxiv.org/abs/2609.12036v1
• Date: Thu, 10 Sep 2026 17:51:01 GMT
• Title: Pelican-Sim 1.0: A General World Model Simulator for Embodied Intelligence
• Abstract summary: Pelican-Sim 1.0 is a general world model simulator for embodied intelligence.<n>It predicts future observations from visual context and robot actions to support downstream learning and decision making.
• Score: 22.0636262013758
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this technical report, we propose Pelican-Sim 1.0, a general world model simulator for embodied intelligence that predicts future observations from visual context and robot actions to support downstream learning and decision making. The model incorporates four key design features: (1) Unified action representation: a 28-dimensional action value space covering most mainstream embodiments, keeping one model valid across heterogeneous devices. (2) Action-visual injection: URDF- and camera-rendered action videos bridge actions and pixels, giving markedly better controllability across embodiments, scenes, and tasks (PSNR +0.904 over alternative fusion baselines). (3) Sparse mixture-of-experts (MoE): sparse MoE layers add capacity for heterogeneous dynamics and absorb the action modality while reducing inter-modality conflict (FVD -6.530 vs. the dense backbone). (4) Efficient rollout generation: causal adaptation and few-step distillation yield a four-step autoregressive simulator, achieving a 5.67-fold speedup over the 35-step model. Benefiting from these designs, we train on approximately one million real-world and simulated trajectories and obtain large gains in action controllability and video quality: PSNR improves over the strongest evaluated baselines by 4.636 on AgiBotWorld Beta, 2.080 on RoboMIND, and 10.343 on RoboTwin, with the adapted EWMBench DYN score up 0.426 on RoboTwin. Relying on this, four downstream applications on RoboTwin succeed: 500 generated trajectories added to 50 demonstrations per task raise policy success from 70% to 93%; policy evaluation reaches a Pearson correlation of 0.994 across five checkpoints; and relative success gains reach 47.7% for action selection and 20.3% for policy improvement. Qualitative generalization across trajectory, scene, object, embodiment, and viewpoint shifts highlights its potential as a general-purpose world model simulator.

Related papers

• Riemann-1.0: An Embodied World Action Model for Physical AI [17.136136265925682]
  We introduce a fully causal autoregressive World Action Model for embodied intelligence.<n>Rickel-1.0 unifies online robot policy execution and action-conditioned world simulation within a single model.<n>We develop a progressive embodied pretraining framework that unifies learning from egocentric human videos, handheld-gripper demonstrations, and heterogeneous robot trajectories.
  arXiv  Detail & Related papers  (2026-08-27T12:21:26Z)
• GigaBrain-WBC-0.5: A Behavior World Model for Robust Whole-Body Control with Environment Interaction [68.67772166423812]
  We present GigaBrain-WBC-0.5, the first Behavior World Model (BWM) for humanoid whole-body control.<n>Rather than a purely reactive tracker, we train a causal Transformer to jointly predict its next action, next state, and the distribution over its next latent behavior command.<n>An automatic terrain-annotation pipeline recovers full 3D contact geometry from retargeted motion, enabling terrain annotation at the scale of existing motion datasets.
  arXiv  Detail & Related papers  (2026-08-18T18:21:36Z)
• Hydra-0: Action Flow for Generalist World Modeling and Control [64.88849745875753]
  Hydra-0 is a world model conditioned on action flow, which represents robot actions as pixel motion.<n>Our best configuration achieves 90.4% lower robot-motion error and 60.2% lower object-motion error.<n>A trained action head maps the resulting latent features to executable actions without requiring task-specific expert robot demonstrations.
  arXiv  Detail & Related papers  (2026-08-18T17:59:30Z)
• From Foundation to Application: Improving VLA Models in Practice [62.1552185059214]
  We present LingBot-VLA 2.0, which advances LingBot-VLA through improvements in three functional domains.<n>Compared to the previous version, we revamp the data processing pipeline and curate around 60,000 hours of data for pretraining.<n>In particular, our system accommodates degrees of freedom for the heads, waists, mobile bases, and dexterous hands, thereby empowering the robots to tackle more complex tasks in practical scenarios.
  arXiv  Detail & Related papers  (2026-07-07T15:33:12Z)
• RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation [0.0]
  RepSAM is a representation-guided parameter-efficient fine-tuning framework for adapting foundation models to robotic vision.<n>RepSAM achieves 97.9% of full fine-tuning performance (89.0% vs. 90.9% mIoU) while reducing trainable parameters by 158x (from 632M to 4.0M).
  arXiv  Detail & Related papers  (2026-05-25T06:56:42Z)
• MotuBrain: An Advanced World Action Model for Robot Control [23.733029557644354]
  We present MotuBrain, a unified World Action Model that jointly models video and action under a UniDiffuser formulation.<n>A single model supports policy learning, world modeling, video generation, inverse dynamics, and joint video-action prediction.<n>Building on Motus, MotuBrain further introduces unified multiview modeling, an independent text stream for stronger language-action coupling.<n>Our inference stack combines step reduction, compilation, FP8 quantization, DiT caching, V2A-style action-only inference, and real-time chunked closed-loop execution.
  arXiv  Detail & Related papers  (2026-04-30T12:34:44Z)
• GigaWorld-Policy: An Efficient Action-Centered World--Action Model [50.107640832046464]
  GigaWorld-Policy is an action-centered WAM that learns 2D pixel-action dynamics while enabling efficient action decoding, with optional video generation.<n> Experimental results on real-world robotic platforms show that GigaWorld-Policy runs 9x faster than the leading WAM baseline, Motus.
  arXiv  Detail & Related papers  (2026-03-18T00:52:02Z)
• DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control [16.562259973551786]
  We introduce DiT4DiT, an end-to-end Video-Action Model that couples a video Diffusion Transformer with an action Diffusion Transformer.<n>Instead of relying on reconstructed future frames, DiT4DiT extracts intermediate denoising features from the video generation process.<n>It achieves state-of-the-art results, reaching average success rates of 98.6% on LIBERO and 50.8% on RoboCasa GR1.
  arXiv  Detail & Related papers  (2026-03-11T06:03:53Z)
• VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model [87.75549463328836]
  The goal of this paper is to improve the performance and reliability of vision-language-action (VLA) models through iterative online interaction.<n>We propose a simple iterative improvement algorithm that uses real-world roll-out data to improve the fidelity of the world model.<n>We achieve a 39.2% absolute success rate improvement over the base policy and 11.6% improvement from training with the generated synthetic rollouts.
  arXiv  Detail & Related papers  (2026-02-12T15:21:47Z)
• InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation [77.07565723756119]
  We present InternVLA-A1, a vision-language-action model with dynamic predictive capabilities.<n>We pre-train these models on heterogeneous data sources over real-world robot data, synthetic simulation data, and human videos.<n>We evaluate InternVLA-A1 on 12 real-world robotic tasks and a simulation benchmark.
  arXiv  Detail & Related papers  (2026-01-05T18:54:29Z)
• Target-Bench: Can World Models Achieve Mapless Path Planning with Semantic Targets? [25.37180619162052]
  Target-Bench is the first benchmark designed to evaluate world models on mapless path planning toward semantic targets in real-world environments.<n>We provide 450 robot-collected video sequences spanning 45 semantic categories with SLAM-based ground truth trajectories.<n>We evaluate state-of-the-art models including Sora 2, Veo 3.1, and the Wan series.
  arXiv  Detail & Related papers  (2025-11-21T21:36:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.