PDDLGym: Gym Environments from PDDL Problems

• URL: http://arxiv.org/abs/2002.06432v2
• Date: Tue, 15 Sep 2020 23:33:35 GMT
• Title: PDDLGym: Gym Environments from PDDL Problems
• Authors: Tom Silver and Rohan Chitnis
• Abstract summary: We present PDDLGym, a framework that automatically constructs OpenAI Gym environments from PDDL domains and problems. Observations and actions in PDDLGym are relational, making the framework particularly well-suited for research in relational reinforcement learning and relational sequential decision-making.
• Score: 13.630185187102413
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: We present PDDLGym, a framework that automatically constructs OpenAI Gym environments from PDDL domains and problems. Observations and actions in PDDLGym are relational, making the framework particularly well-suited for research in relational reinforcement learning and relational sequential decision-making. PDDLGym is also useful as a generic framework for rapidly building numerous, diverse benchmarks from a concise and familiar specification language. We discuss design decisions and implementation details, and also illustrate empirical variations between the 20 built-in environments in terms of planning and model-learning difficulty. We hope that PDDLGym will facilitate bridge-building between the reinforcement learning community (from which Gym emerged) and the AI planning community (which produced PDDL). We look forward to gathering feedback from all those interested and expanding the set of available environments and features accordingly. Code: https://github.com/tomsilver/pddlgym

Related papers

• Training Cross-Morphology Embodied AI Agents: From Practical Challenges to Theoretical Foundations [16.735655028118817]
  This article shows that theoretical insight is essential for overcoming real-world engineering barriers.<n>We formalize the Heterogeneous Embodied Agent Training (HEAT) problem and prove it reduces to a structured Partially Observable Markov Decision Process (POMDP) that is PSPACE-complete.<n>We also explore Collective Adaptation, a distributed learning alternative inspired by biological systems.
  arXiv  Detail & Related papers  (2025-06-04T06:44:49Z)
• HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gym [7.365229047837842]
  Reinforcement learning (RL) methods have been widely tested using tools like OpenAI Gym.<n>There is a lack of a tool that enables seamless integration of hierarchical planning with RL.<n>We introduce HDDLGym, a Python-based tool that automatically generates OpenAI Gym environments from HDDL domains and problems.
  arXiv  Detail & Related papers  (2025-05-28T17:10:43Z)
• Zero-Shot Iterative Formalization and Planning in Partially Observable Environments [11.066479432278301]
  We propose PDDLego+, a framework to formalize, plan, grow, and refine PDDL representations in a zero-shot manner.<n>We show that PDDLego+ improves goal reaching success and exhibits robustness against problem complexity.
  arXiv  Detail & Related papers  (2025-05-19T13:58:15Z)
• Planning with Vision-Language Models and a Use Case in Robot-Assisted Teaching [0.9217021281095907]
  This paper introduces Image2PDDL, a novel framework that leverages Vision-Language Models (VLMs) to automatically convert images of initial states and descriptions of goal states into PDDL problems. We evaluate the framework on various domains, including standard planning domains like blocksworld and sliding tile puzzles, using datasets with multiple difficulty levels. We will discuss a potential use case in robot-assisted teaching of students with Autism Spectrum Disorder.
  arXiv  Detail & Related papers  (2025-01-29T14:04:54Z)
• Decision Making in Changing Environments: Robustness, Query-Based Learning, and Differential Privacy [59.64384863882473]
  We study the problem of interactive decision making in which the underlying environment changes over time subject to given constraints. We propose a framework, which provides an complexity between the complexity and adversarial settings of decision making.
  arXiv  Detail & Related papers  (2025-01-24T21:31:50Z)
• Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planning [51.52387511006586]
  We propose Hierarchical Opponent modeling and Planning (HOP), a novel multi-agent decision-making algorithm. HOP is hierarchically composed of two modules: an opponent modeling module that infers others' goals and learns corresponding goal-conditioned policies. HOP exhibits superior few-shot adaptation capabilities when interacting with various unseen agents, and excels in self-play scenarios.
  arXiv  Detail & Related papers  (2024-06-12T08:48:06Z)
• Generalized Planning for the Abstraction and Reasoning Corpus [10.377424252002795]
  We introduce an ARC solver, Generalized Planning for Abstract Reasoning (GPAR) It casts an ARC problem as a generalized planning (GP) problem, where a solution is formalized as a planning program with pointers. We show how to scale up GP solvers via domain knowledge specific to ARC in the form of restrictions over the actions model, predicates, arguments and valid structure of planning programs.
  arXiv  Detail & Related papers  (2024-01-15T02:25:00Z)
• Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning [50.47568731994238]
  Key method for creating Artificial Intelligence (AI) agents is Reinforcement Learning (RL) This paper presents a general framework model for integrating and learning structured reasoning into AI agents' policies.
  arXiv  Detail & Related papers  (2023-12-22T17:57:57Z)
• SDGym: Low-Code Reinforcement Learning Environments using System Dynamics Models [0.0]
  We introduce SDGym, a low-code library built on the OpenAI Gym framework which enables the generation of custom RL environments. We demonstrate the capabilities of the SDGym environment using an SD model of the electric vehicle adoption problem. By open-sourcing SDGym, the intent is to galvanize further research and promote adoption across the SD and RL communities.
  arXiv  Detail & Related papers  (2023-10-19T05:56:25Z)
• Serving Deep Learning Model in Relational Databases [70.53282490832189]
  Serving deep learning (DL) models on relational data has become a critical requirement across diverse commercial and scientific domains. We highlight three pivotal paradigms: The state-of-the-art DL-centric architecture offloads DL computations to dedicated DL frameworks. The potential UDF-centric architecture encapsulates one or more tensor computations into User Defined Functions (UDFs) within the relational database management system (RDBMS)
  arXiv  Detail & Related papers  (2023-10-07T06:01:35Z)
• PDSketch: Integrated Planning Domain Programming and Learning [86.07442931141637]
  We present a new domain definition language, named PDSketch. It allows users to flexibly define high-level structures in the transition models. Details of the transition model will be filled in by trainable neural networks.
  arXiv  Detail & Related papers  (2023-03-09T18:54:12Z)
• pyRDDLGym: From RDDL to Gym Environments [22.439740618373346]
  pyRDDLGym is a Python framework for auto-generation of OpenAI Gym environments from RDDL declerative description. We present the design and built-in examples of pyRDDLGym, and the additions made to the RDDL language that were incorporated into the framework.
  arXiv  Detail & Related papers  (2022-11-11T00:58:16Z)
• POGEMA: Partially Observable Grid Environment for Multiple Agents [64.88759709443819]
  POGEMA is a sandbox for challenging partially observable multi-agent pathfinding (PO-MAPF) problems. It can be tailored to a variety of PO-MAPF, which can serve as an excellent testing ground for planning and learning methods.
  arXiv  Detail & Related papers  (2022-06-22T09:39:50Z)
• The AI Arena: A Framework for Distributed Multi-Agent Reinforcement Learning [0.3437656066916039]
  We introduce the AI Arena: a scalable framework with flexible abstractions for distributed multi-agent reinforcement learning. We show performance gains due to a distributed multi-agent learning approach over commonly-used RL techniques in several different learning environments.
  arXiv  Detail & Related papers  (2021-03-09T22:16:19Z)
• Plato Dialogue System: A Flexible Conversational AI Research Platform [64.82999992143448]
  Plato is a flexible Conversational AI platform written in Python that supports any kind of conversational agent architecture. Plato has been designed to be easy to understand and debug and is agnostic to the underlying learning frameworks that train each component.
  arXiv  Detail & Related papers  (2020-01-17T18:27:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.