Blue River Controls: A toolkit for Reinforcement Learning Control Systems on Hardware

• URL: http://arxiv.org/abs/2001.02254v1
• Date: Tue, 7 Jan 2020 19:24:29 GMT
• Title: Blue River Controls: A toolkit for Reinforcement Learning Control Systems on Hardware
• Abstract summary: We present Blue River Controls, a tool that allows to train and test reinforcement learning algorithms on real-world hardware. It features a simple interface based on OpenAI Gym, that works directly on both simulation and hardware. We also provide tools to simplify training RL algorithms on other hardware.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We provide a simple hardware wrapper around the Quanser's hardware-in-the-loop software development kit (HIL SDK) to allow for easy development of new Quanser hardware. To connect to the hardware we use a module written in Cython. The internal QuanserWrapper class handles most of the difficult aspects of interacting with hardware, including the timing (using a hardware timer), and ensuring the data sent to hardware is safe and correct, where safety corresponds to safe operating voltage and current for the specified hardware. Much of the recent success of Reinforcement learning (RL) has been made possible with training and testing tools like OpenAI Gym and Deepmind Control Suite. Unfortunately, tools for quickly testing and transferring high-frequency RL algorithms from simulation to real hardware environment remain mostly absent. We present Blue River Controls, a tool that allows to train and test reinforcement learning algorithms on real-world hardware. It features a simple interface based on OpenAI Gym, that works directly on both simulation and hardware. We use Quanser's Qube Servo2-USB platform, an underactuated rotary pendulum as an initial testing device. We also provide tools to simplify training RL algorithms on other hardware. Several baselines, from both classical controllers and pretrained RL agents are included to compare performance across tasks. Blue River Controls is available at this https URL: https://github.com/BlueRiverTech/quanser-openai-driver

Related papers

• RTL-Arrow: Hardware-to-Cloud Bridge [0.3437656066916039]
  "RTL-Arrow" is a framework to compile performant binaries which bridge the hardware/data divide.<n>We describe our approach, its benefits, and lessons learned from the process of packaging and distributing these libraries for our security research program.
  arXiv  Detail & Related papers  (2026-06-11T19:45:15Z)
• Aletheia: What Makes RLVR For Code Verifiers Tick? [51.371034079170435]
  Verifiers trained via Reinforcement Learning from Verifiable Rewards (RLVR) are a prominent fixture of the Large Language Model (LLM) post-training pipeline.<n>Code verifiers remain valuable toward judging model outputs in scenarios where execution feedback is hard to obtain.<n>We examine components of the RLVR-based verifier training recipe widely credited for its success.
  arXiv  Detail & Related papers  (2026-01-17T22:30:45Z)
• A Framework for Deploying Learning-based Quadruped Loco-Manipulation [9.16082538503878]
  We present an open pipeline for training, benchmarking, and deploying RL-based controllers on the Unitree B1 quadruped with a Z1 arm.<n>The framework unifies sim-to-sim and sim-to-real transfer through ROS, re-implementing a policy trained in Isaac Gym, extending it to MuJoCo via a hardware abstraction layer, and deploying the same controller on physical hardware.
  arXiv  Detail & Related papers  (2025-12-22T01:19:26Z)
• SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning [85.21378553454672]
  We develop a library containing a sample efficient off-policy deep RL method, together with methods for computing rewards and resetting the environment. We find that our implementation can achieve very efficient learning, acquiring policies for PCB board assembly, cable routing, and object relocation. These policies achieve perfect or near-perfect success rates, extreme robustness even under perturbations, and exhibit emergent robustness recovery and correction behaviors.
  arXiv  Detail & Related papers  (2024-01-29T10:01:10Z)
• Using the IBM Analog In-Memory Hardware Acceleration Kit for Neural Network Training and Inference [1.8381945648605231]
  This tutorial is accompanied by comprehensive Jupyter Notebook code examples that can be run using AIHWKit. We present an in-depth description of the AIHWKit design, functionality, and best practices to properly perform inference and training. We also present an overview of the Analog AI Cloud Composer, a platform that provides the benefits of using the AIHWKit simulation in a fully managed cloud setting.
  arXiv  Detail & Related papers  (2023-07-18T15:44:24Z)
• Katakomba: Tools and Benchmarks for Data-Driven NetHack [52.0035089982277]
  NetHack is known as the frontier of reinforcement learning research. We argue that there are three major obstacles for adoption: resource-wise, implementation-wise, and benchmark-wise. We develop an open-source library that provides workflow fundamentals familiar to the offline reinforcement learning community.
  arXiv  Detail & Related papers  (2023-06-14T22:50:25Z)
• RLtools: A Fast, Portable Deep Reinforcement Learning Library for Continuous Control [7.259696592534715]
  Deep Reinforcement Learning (RL) can yield capable agents and control policies in several domains but is commonly plagued by prohibitively long training times. We present RLtools, a dependency-free, header-only, pure C++ library for deep supervised and reinforcement learning.
  arXiv  Detail & Related papers  (2023-06-06T09:26:43Z)
• VRKitchen2.0-IndoorKit: A Tutorial for Augmented Indoor Scene Building in Omniverse [77.52012928882928]
  INDOORKIT is a built-in toolkit for NVIDIA OMNIVERSE. It provides flexible pipelines for indoor scene building, scene randomizing, and animation controls.
  arXiv  Detail & Related papers  (2022-06-23T17:53:33Z)
• ElegantRL-Podracer: Scalable and Elastic Library for Cloud-Native Deep Reinforcement Learning [141.58588761593955]
  We present a library ElegantRL-podracer for cloud-native deep reinforcement learning. It efficiently supports millions of cores to carry out massively parallel training at multiple levels. At a low-level, each pod simulates agent-environment interactions in parallel by fully utilizing nearly 7,000 GPU cores in a single GPU.
  arXiv  Detail & Related papers  (2021-12-11T06:31:21Z)
• Cockpit: A Practical Debugging Tool for Training Deep Neural Networks [27.96164890143314]
  We present a collection of instruments that enable a closer look into the inner workings of a learning machine. These instruments leverage novel higher-order information about the gradient distribution and curvature.
  arXiv  Detail & Related papers  (2021-02-12T16:28:49Z)
• Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and Benchmarking [4.721069729610892]
  Deep reinforcement learning has been one of the fastest growing fields of machine learning over the past years and numerous libraries have been open sourced to support research. This paper introduces Tonic, a Python library allowing researchers to quickly implement new ideas and measure their importance.
  arXiv  Detail & Related papers  (2020-11-15T14:10:37Z)
• Decoupling Representation Learning from Reinforcement Learning [89.82834016009461]
  We introduce an unsupervised learning task called Augmented Temporal Contrast (ATC) ATC trains a convolutional encoder to associate pairs of observations separated by a short time difference. In online RL experiments, we show that training the encoder exclusively using ATC matches or outperforms end-to-end RL.
  arXiv  Detail & Related papers  (2020-09-14T19:11:13Z)
• TriFinger: An Open-Source Robot for Learning Dexterity [33.26612195196921]
  We propose an open-source robotic platform which can safely operate without human supervision. The hardware is inexpensive yet highly dynamic, robust, and capable of complex interaction with external objects. We illustrate the potential of the proposed platform through a number of experiments, including real-time optimal control, deep reinforcement learning from scratch, throwing, and writing.
  arXiv  Detail & Related papers  (2020-08-08T20:54:30Z)
• Reinforcement Learning with Augmented Data [97.42819506719191]
  We present Reinforcement Learning with Augmented Data (RAD), a simple plug-and-play module that can enhance most RL algorithms. We show that augmentations such as random translate, crop, color jitter, patch cutout, random convolutions, and amplitude scale can enable simple RL algorithms to outperform complex state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-04-30T17:35:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.