PufferLib: Making Reinforcement Learning Libraries and Environments Play Nice

• URL: http://arxiv.org/abs/2406.12905v1
• Date: Tue, 11 Jun 2024 21:13:34 GMT
• Title: PufferLib: Making Reinforcement Learning Libraries and Environments Play Nice
• Authors: Joseph Suarez,
• Abstract summary: PufferLib provides one-line environment wrappers that eliminate common compatibility problems. With PufferLib, you can use familiar libraries like CleanRL and SB3 to scale from classic benchmarks like Atari and Procgen to complex simulators like NetHack and Neural MMO. All of our code is free and open-source software under the MIT license.
• Score: 0.8702432681310401
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: You have an environment, a model, and a reinforcement learning library that are designed to work together but don't. PufferLib makes them play nice. The library provides one-line environment wrappers that eliminate common compatibility problems and fast vectorization to accelerate training. With PufferLib, you can use familiar libraries like CleanRL and SB3 to scale from classic benchmarks like Atari and Procgen to complex simulators like NetHack and Neural MMO. We release pip packages and prebuilt images with dependencies for dozens of environments. All of our code is free and open-source software under the MIT license, complete with baselines, documentation, and support at pufferai.github.io.

Related papers

• BayesDLL: Bayesian Deep Learning Library [29.624531252627484]
  We release a new Bayesian neural network library for PyTorch for large-scale deep networks. Our library implements mainstream inference algorithms: variational inference, MC-dropout, approximate-gradient MCMC, and Laplace approximation.
  arXiv  Detail & Related papers  (2023-09-22T15:27:54Z)
• torchgfn: A PyTorch GFlowNet library [56.071033896777784]
  torchgfn is a PyTorch library that aims to address this need. It provides users with a simple API for environments and useful abstractions for samplers and losses.
  arXiv  Detail & Related papers  (2023-05-24T00:20:59Z)
• SequeL: A Continual Learning Library in PyTorch and JAX [50.33956216274694]
  SequeL is a library for Continual Learning that supports both PyTorch and JAX frameworks. It provides a unified interface for a wide range of Continual Learning algorithms, including regularization-based approaches, replay-based approaches, and hybrid approaches. We release SequeL as an open-source library, enabling researchers and developers to easily experiment and extend the library for their own purposes.
  arXiv  Detail & Related papers  (2023-04-21T10:00:22Z)
• Code Librarian: A Software Package Recommendation System [65.05559087332347]
  We present a recommendation engine called Librarian for open source libraries. A candidate library package is recommended for a given context if: 1) it has been frequently used with the imported libraries in the program; 2) it has similar functionality to the imported libraries in the program; 3) it has similar functionality to the developer's implementation, and 4) it can be used efficiently in the context of the provided code.
  arXiv  Detail & Related papers  (2022-10-11T12:30:05Z)
• Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code [74.28810048824519]
  Repro is an open-source library which aims at improving the usability of research code. It provides a lightweight Python API for running software released by researchers within Docker containers.
  arXiv  Detail & Related papers  (2022-04-29T01:54:54Z)
• ReservoirComputing.jl: An Efficient and Modular Library for Reservoir Computing Models [0.17499351967216337]
  ReservoirComputing.jl is an open source Julia library for reservoir computing models. The code and documentation are hosted on Github under an MIT license.
  arXiv  Detail & Related papers  (2022-04-08T13:33:09Z)
• skrl: Modular and Flexible Library for Reinforcement Learning [0.0]
  skrl is an open-source modular library for reinforcement learning written in Python. It allows loading, configuring, and operating NVIDIA Isaac Gym environments.
  arXiv  Detail & Related papers  (2022-02-08T12:43:31Z)
• Bridging the Language Gap: An Empirical Study of Bindings for Open Source Machine Learning Libraries Across Software Package Ecosystems [9.339419442638983]
  Machine learning libraries enable developers to integrate advanced ML functionality into their own applications. However, popular ML libraries are not available in all programming languages and software package ecosystems. We collect 2,436 cross-ecosystem bindings for 546 ML libraries across 13 software package ecosystems.
  arXiv  Detail & Related papers  (2022-01-18T18:53:21Z)
• Solo-learn: A Library of Self-supervised Methods for Visual Representation Learning [83.02597612195966]
  solo-learn is a library of self-supervised methods for visual representation learning. Implemented in Python, using Pytorch and Pytorch lightning, the library fits both research and industry needs.
  arXiv  Detail & Related papers  (2021-08-03T22:19:55Z)
• SuperSuit: Simple Microwrappers for Reinforcement Learning Environments [0.0]
  SuperSuit is a Python library that includes all popular wrappers and wrappers that can easily apply functions to the observations/actions/reward. It's compatible with the standard Gym environment specification, as well as the PettingZoo specification for multi-agent environments.
  arXiv  Detail & Related papers  (2020-08-17T00:30:06Z)
• Picasso: A Sparse Learning Library for High Dimensional Data Analysis in R and Python [77.33905890197269]
  We describe a new library which implements a unified pathwise coordinate optimization for a variety of sparse learning problems. The library is coded in R++ and has user-friendly sparse experiments.
  arXiv  Detail & Related papers  (2020-06-27T02:39:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.