Differentiable Learning of Lifted Action Schemas for Classical Planning
- URL: http://arxiv.org/abs/2605.13282v1
- Date: Wed, 13 May 2026 09:59:49 GMT
- Title: Differentiable Learning of Lifted Action Schemas for Classical Planning
- Abstract summary: We develop a novel neural network architecture for learning action schemas from traces where states are fully observed but action arguments are unobserved.<n>We evaluate the architecture on various planning domains, where the learned lifted action schemas must recover the ground-truth structure.
- Score: 6.30853901017231
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Classical planners can effectively solve very large deterministic MDPs represented in STRIPS or PDDL where states are sets of atoms over objects and relations, and lifted action schemas add or delete these atoms. This compact representation yields strong search heuristics and provides an ideal setting for structural generalization, since lifted relations and action schemas give rise to infinitely many domain instances. A central challenge is to learn these relations and action schemas from data, and recent approaches have addressed this problem using different types of observations. In this work, we develop a novel neural network architecture for learning action schemas from traces where states are fully observed but action arguments are unobserved. The problem is a simplification but an important step towards learning planning domains from sequences of images and action labels, and we aim to solve this simplification in a nearly perfect manner. The challenge lies in learning the action schemas while simultaneously identifying the action arguments from observed state changes. Our approach yields a robust differentiable component that can then be integrated into larger neuro-symbolic models. We evaluate the architecture on various planning domains, where the learned lifted action schemas must recover the ground-truth structure. Additionally, we report experiments on robustness to observation noise and on a variation related to slot-based dynamics models.
Related papers
- Surprising Effectiveness of Self-Demonstrations in Enhancing Schema-Ontology Mapping with LLMs [23.62124559072917]
This paper presents a self-demonstration-driven approach that combines a neuro-symbolic task decomposition with a novel mechanism for automatically generating pattern-guided demonstrations.<n> Experiments on three of the most challenging scenarios from the RODI benchmark show that our approach achieves state-of-the-art performance.
arXiv Detail & Related papers (2026-09-12T07:42:55Z) - Planning as Emergent Behavior in Reinforcement Learning with Relational Hidden States [0.0]
Recent work has shown that planning can emerge from model-free reinforcement learning alone.<n>We present evidence that, in the observed cases, the hidden-state structure of the neural architecture is the deciding factor.<n>We argue that this explains the observed phenomenon of emergent planning in model-free reinforcement learning.
arXiv Detail & Related papers (2026-07-20T23:49:42Z) - World Action Models: The Next Frontier in Embodied AI [123.5787299299832]
Vision-Language-Action (VLA) models have achieved strong semantic generalization for embodied policy learning.<n>They learn reactive observation-to-action mappings without explicitly modeling how the physical world evolves under intervention.<n>A growing body of work addresses this limitation by integrating world models, predictive models of environment dynamics, into the action generation pipeline.
arXiv Detail & Related papers (2026-05-12T13:10:52Z) - On Sample-Efficient Generalized Planning via Learned Transition Models [8.508980351550003]
Generalized planning studies the construction of solution strategies that generalize across families of planning problems sharing a common domain model.<n>Recent Transformer-based planners, such as PlanGPT and Plansformer, largely cast generalized planning as direct action-sequence prediction.<n>We formulate generalized planning as a transition-model learning problem, in which a neural model explicitly approximates the successor-state function $hat approx $ and generates plans by rolling out symbolic state trajectories.
arXiv Detail & Related papers (2026-02-26T16:13:46Z) - ExoPredicator: Learning Abstract Models of Dynamic Worlds for Robot Planning [77.49815848173613]
We propose a framework for abstract world models that jointly learns symbolic state representations and causal processes for both endogenous actions and mechanisms.<n>Across five simulated tabletop robotics environments, the learned models enable fast planning that generalizes to held-out tasks with more objects and more complex goals, outperforming a range of baselines.
arXiv Detail & Related papers (2025-09-30T13:44:34Z) - Latent Diffusion Planning for Imitation Learning [78.56207566743154]
Latent Diffusion Planning (LDP) is a modular approach consisting of a planner and inverse dynamics model.<n>By separating planning from action prediction, LDP can benefit from the denser supervision signals of suboptimal and action-free data.<n>On simulated visual robotic manipulation tasks, LDP outperforms state-of-the-art imitation learning approaches.
arXiv Detail & Related papers (2025-04-23T17:53:34Z) - Large Trajectory Models are Scalable Motion Predictors and Planners [25.03447801499]
Motion prediction and planning are vital tasks in autonomous driving.
We introduce a scalable trajectory model called State Transformer (STR)
STR reformulates the motion prediction and motion planning problems by arranging observations, states, and actions into one unified sequence modeling task.
arXiv Detail & Related papers (2023-10-30T15:12:41Z) - Compositional Foundation Models for Hierarchical Planning [52.18904315515153]
We propose a foundation model which leverages expert foundation model trained on language, vision and action data individually together to solve long-horizon tasks.
We use a large language model to construct symbolic plans that are grounded in the environment through a large video diffusion model.
Generated video plans are then grounded to visual-motor control, through an inverse dynamics model that infers actions from generated videos.
arXiv Detail & Related papers (2023-09-15T17:44:05Z) - Goal-Aware Prediction: Learning to Model What Matters [105.43098326577434]
One of the fundamental challenges in using a learned forward dynamics model is the mismatch between the objective of the learned model and that of the downstream planner or policy.
We propose to direct prediction towards task relevant information, enabling the model to be aware of the current task and encouraging it to only model relevant quantities of the state space.
We find that our method more effectively models the relevant parts of the scene conditioned on the goal, and as a result outperforms standard task-agnostic dynamics models and model-free reinforcement learning.
arXiv Detail & Related papers (2020-07-14T16:42:59Z) - STRIPS Action Discovery [67.73368413278631]
Recent approaches have shown the success of classical planning at synthesizing action models even when all intermediate states are missing.
We propose a new algorithm to unsupervisedly synthesize STRIPS action models with a classical planner when action signatures are unknown.
arXiv Detail & Related papers (2020-01-30T17:08:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.