Hierarchical Planning with Latent World Models

• URL: http://arxiv.org/abs/2604.03208v1
• Date: Fri, 03 Apr 2026 17:32:36 GMT
• Title: Hierarchical Planning with Latent World Models
• Abstract summary: hierarchical planning achieves higher success while requiring up to 4x less planning-time compute.<n>We demonstrate that this hierarchical approach enables zero-shot control on real-world non-greedy robotic tasks.
• Score: 49.82095442483551
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Model predictive control (MPC) with learned world models has emerged as a promising paradigm for embodied control, particularly for its ability to generalize zero-shot when deployed in new environments. However, learned world models often struggle with long-horizon control due to the accumulation of prediction errors and the exponentially growing search space. In this work, we address these challenges by learning latent world models at multiple temporal scales and performing hierarchical planning across these scales, enabling long-horizon reasoning while substantially reducing inference-time planning complexity. Our approach serves as a modular planning abstraction that applies across diverse latent world-model architectures and domains. We demonstrate that this hierarchical approach enables zero-shot control on real-world non-greedy robotic tasks, achieving a 70% success rate on pick-&-place using only a final goal specification, compared to 0% for a single-level world model. In addition, across physics-based simulated environments including push manipulation and maze navigation, hierarchical planning achieves higher success while requiring up to 4x less planning-time compute.

Related papers

• Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning [40.09669638091686]
  We propose a framework that learns to predict future latent states conditioned on action sequences of variable lengths.<n>Experiments show that Variable-length Latent World Models significantly improve latent space world models.
  arXiv  Detail & Related papers  (2026-06-19T21:50:15Z)
• Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks [44.06996146648851]
  We introduce WorldDP, a world model framework designed for multi-stage robotic manipulation.<n>Our hierarchical approach utilizes a high-level world model as a transition function to optimize for feasible subgoals during runtime.<n>We incorporate object-centric representations that decouple environmental entities and enable us to plan sequentially with respect to each.
  arXiv  Detail & Related papers  (2026-06-07T18:39:45Z)
• Lifting Embodied World Models for Planning and Control [59.09016913513998]
  We train a lightweight policy that maps high-level actions to sequences of low-level joint actions.<n>We instantiate this framework for a human-like embodiment, defining the high-level action space as a small set of 2D waypoints.<n>We show that the lifted world model substantially outperforms searching directly in low-level joint space.
  arXiv  Detail & Related papers  (2026-04-28T23:59:19Z)
• Planning in 8 Tokens: A Compact Discrete Tokenizer for Latent World Model [76.30055935418561]
  We propose CompACT, a tokenizer that compresses each observation into as few as 8 tokens, drastically reducing computational cost while preserving essential information for planning.<n>An action-conditioned world model occupies CompACT tokenizer achieves competitive planning performance with orders-of-magnitude faster planning, offering a practical step toward real-world deployment of world models.
  arXiv  Detail & Related papers  (2026-03-05T18:00:02Z)
• Compositional Planning with Jumpy World Models [70.74595987225908]
  We study agents that compose pre-trained policies as temporally extended actions, enabling solutions to complex tasks that no constituent alone can solve.<n>Motivated by the geometric policy composition framework introduced in arXiv:2206.08736, we address these challenges by learning predictive models of multi-step dynamics.
  arXiv  Detail & Related papers  (2026-02-23T09:22:21Z)
• From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction [57.56072009935036]
  We introduce a new driving paradigm named Policy World Model (PWM)<n>PWM integrates world modeling and trajectory planning within a unified architecture.<n>Our method matches or exceeds state-of-the-art approaches that rely on multi-view and multi-modal inputs.
  arXiv  Detail & Related papers  (2025-10-22T14:57:51Z)
• ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planning [77.49815848173613]
  We propose a framework for abstract world models that jointly learns symbolic state representations and causal processes for both endogenous actions and mechanisms.<n>Across five simulated tabletop robotics environments, the learned models enable fast planning that generalizes to held-out tasks with more objects and more complex goals, outperforming a range of baselines.
  arXiv  Detail & Related papers  (2025-09-30T13:44:34Z)
• Learning Hierarchical Domain Models Through Environment-Grounded Interaction [14.98687521721637]
  In open-world environments, a single general domain model cannot capture the variety of tasks.<n>Large Language Models (LLMs) can generate such domains, but suffer from high error rates that limit their applicability.<n>We propose LODGE, a framework for autonomous domain learning from LLMs and environment grounding.
  arXiv  Detail & Related papers  (2025-05-15T20:23:21Z)
• Forecaster: Towards Temporally Abstract Tree-Search Planning from Pixels [42.275164872809746]
  We introduce Forecaster, a deep hierarchical reinforcement learning approach which plans over high-level goals. Forecaster learns an abstract model of its environment by modelling the transitions dynamics at an abstract level. It then uses this world model to choose optimal high-level goals through a tree-search planning procedure.
  arXiv  Detail & Related papers  (2023-10-16T01:13:26Z)
• World Model as a Graph: Learning Latent Landmarks for Planning [12.239590266108115]
  Planning is a hallmark of human intelligence. One prominent framework, Model-Based RL, learns a world model and plans using step-by-step virtual rollouts. We propose to learn graph-structured world models composed of sparse, multi-step transitions.
  arXiv  Detail & Related papers  (2020-11-25T02:49:21Z)
• Evolutionary Planning in Latent Space [7.863826008567604]
  Planning is a powerful approach to reinforcement learning with several desirable properties. We learn a world model that enables Evolutionary Planning in Latent Space. We show how to build a model of the world by bootstrapping it with rollouts from a random policy and iteratively refining it with rollouts from an increasingly accurate planning policy.
  arXiv  Detail & Related papers  (2020-11-23T09:21:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.