Gymnasium: A Standard Interface for Reinforcement Learning Environments

• URL: http://arxiv.org/abs/2407.17032v3
• Date: Fri, 08 Nov 2024 16:08:51 GMT
• Title: Gymnasium: A Standard Interface for Reinforcement Learning Environments
• Authors: Mark Towers, Ariel Kwiatkowski, Jordan Terry, John U. Balis, Gianluca De Cola, Tristan Deleu, Manuel Goulão, Andreas Kallinteris, Markus Krimmel, Arjun KG, Rodrigo Perez-Vicente, Andrea Pierré, Sander Schulhoff, Jun Jet Tai, Hannah Tan, Omar G. Younis,
• Abstract summary: Reinforcement Learning (RL) is a growing field that has the potential to revolutionize many areas of artificial intelligence. Despite its promise, RL research is often hindered by the lack of standardization in environment and algorithm implementations. Gymnasium is an open-source library that provides a standard API for RL environments.
• Score: 5.7144222327514616
• License:
• Abstract: Reinforcement Learning (RL) is a continuously growing field that has the potential to revolutionize many areas of artificial intelligence. However, despite its promise, RL research is often hindered by the lack of standardization in environment and algorithm implementations. This makes it difficult for researchers to compare and build upon each other's work, slowing down progress in the field. Gymnasium is an open-source library that provides a standard API for RL environments, aiming to tackle this issue. Gymnasium's main feature is a set of abstractions that allow for wide interoperability between environments and training algorithms, making it easier for researchers to develop and test RL algorithms. In addition, Gymnasium provides a collection of easy-to-use environments, tools for easily customizing environments, and tools to ensure the reproducibility and robustness of RL research. Through this unified framework, Gymnasium significantly streamlines the process of developing and testing RL algorithms, enabling researchers to focus more on innovation and less on implementation details. By providing a standardized platform for RL research, Gymnasium helps to drive forward the field of reinforcement learning and unlock its full potential. Gymnasium is available online at https://github.com/Farama-Foundation/Gymnasium

Related papers

• A Benchmark Environment for Offline Reinforcement Learning in Racing Games [54.83171948184851]
  Offline Reinforcement Learning (ORL) is a promising approach to reduce the high sample complexity of traditional Reinforcement Learning (RL) This paper introduces OfflineMania, a novel environment for ORL research. It is inspired by the iconic TrackMania series and developed using the Unity 3D game engine.
  arXiv  Detail & Related papers  (2024-07-12T16:44:03Z)
• OpenRL: A Unified Reinforcement Learning Framework [19.12129820612253]
  We present OpenRL, an advanced reinforcement learning (RL) framework. It is designed to accommodate a diverse array of tasks, from single-agent challenges to complex multi-agent systems. It integrates Natural Language Processing (NLP) with RL, enabling researchers to address a combination of RL training and language-centric tasks effectively.
  arXiv  Detail & Related papers  (2023-12-20T12:04:06Z)
• RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmark [69.19502244910632]
  Deep reinforcement learning (RL) has shown significant benefits in solving optimization (CO) problems. We introduce RL4CO, a unified benchmark with in-depth library coverage of 23 state-of-the-art methods and more than 20 CO problems. Built on efficient software libraries and best practices in implementation, RL4CO features modularized implementation and flexible configuration of diverse RL algorithms, neural network architectures, inference techniques, and environments.
  arXiv  Detail & Related papers  (2023-06-29T16:57:22Z)
• DIAMBRA Arena: a New Reinforcement Learning Platform for Research and Experimentation [91.3755431537592]
  This work presents DIAMBRA Arena, a new platform for reinforcement learning research and experimentation. It features a collection of high-quality environments exposing a Python API fully compliant with OpenAI Gym standard. They are episodic tasks with discrete actions and observations composed by raw pixels plus additional numerical values.
  arXiv  Detail & Related papers  (2022-10-19T14:39:10Z)
• MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research [24.9044606044585]
  MiniHack is a powerful sandbox framework for easily designing novel deep reinforcement learning environments. By leveraging the full set of entities and environment dynamics from NetHack, MiniHack allows designing custom RL testbeds. In addition to a variety of RL tasks and baselines, MiniHack can wrap existing RL benchmarks and provide ways to seamlessly add additional complexity.
  arXiv  Detail & Related papers  (2021-09-27T17:22:42Z)
• Eden: A Unified Environment Framework for Booming Reinforcement Learning Algorithms [19.62620266334838]
  reinforcement learning algorithms have gradually become the code-base of building stronger artificial intelligence(AI) Existing environments, which can be divided into real world games and customized toy environments, have obvious shortcomings. We introduce the first virtual user-friendly environment framework for RL.
  arXiv  Detail & Related papers  (2021-09-04T02:38:08Z)
• RL-DARTS: Differentiable Architecture Search for Reinforcement Learning [62.95469460505922]
  We introduce RL-DARTS, one of the first applications of Differentiable Architecture Search (DARTS) in reinforcement learning (RL) By replacing the image encoder with a DARTS supernet, our search method is sample-efficient, requires minimal extra compute resources, and is also compatible with off-policy and on-policy RL algorithms, needing only minor changes in preexisting code. We show that the supernet gradually learns better cells, leading to alternative architectures which can be highly competitive against manually designed policies, but also verify previous design choices for RL policies.
  arXiv  Detail & Related papers  (2021-06-04T03:08:43Z)
• The AI Arena: A Framework for Distributed Multi-Agent Reinforcement Learning [0.3437656066916039]
  We introduce the AI Arena: a scalable framework with flexible abstractions for distributed multi-agent reinforcement learning. We show performance gains due to a distributed multi-agent learning approach over commonly-used RL techniques in several different learning environments.
  arXiv  Detail & Related papers  (2021-03-09T22:16:19Z)
• Improving Reinforcement Learning with Human Assistance: An Argument for Human Subject Studies with HIPPO Gym [21.4215863934377]
  Reinforcement learning (RL) is a popular machine learning paradigm for game playing, robotics control, and other sequential decision tasks. This article introduces our new open-source RL framework, the Human Input Parsing Platform for Openai Gym (HIPPO Gym)
  arXiv  Detail & Related papers  (2021-02-02T12:56:02Z)
• The NetHack Learning Environment [79.06395964379107]
  We present the NetHack Learning Environment (NLE), a procedurally generated rogue-like environment for Reinforcement Learning research. We argue that NetHack is sufficiently complex to drive long-term research on problems such as exploration, planning, skill acquisition, and language-conditioned RL. We demonstrate empirical success for early stages of the game using a distributed Deep RL baseline and Random Network Distillation exploration.
  arXiv  Detail & Related papers  (2020-06-24T14:12:56Z)
• MushroomRL: Simplifying Reinforcement Learning Research [60.70556446270147]
  MushroomRL is an open-source Python library developed to simplify the process of implementing and running Reinforcement Learning (RL) experiments. Compared to other available libraries, MushroomRL has been created with the purpose of providing a comprehensive and flexible framework to minimize the effort in implementing and testing novel RL methodologies.
  arXiv  Detail & Related papers  (2020-01-04T17:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.