CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management

• URL: http://arxiv.org/abs/2012.10504v1
• Date: Fri, 18 Dec 2020 20:41:53 GMT
• Title: CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management
• Authors: Jose R Vazquez-Canteli, Sourav Dey, Gregor Henze, Zoltan Nagy
• Abstract summary: In the US, buildings represent about 70% of the total electricity demand and demand response has the potential for reducing peaks of electricity by about 20%. Reinforcement learning algorithms have gained increased interest in the past years. CityLearn is an OpenAI Gym Environment which allows researchers to implement, share, replicate, and compare their implementations of RL for demand response.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Rapid urbanization, increasing integration of distributed renewable energy resources, energy storage, and electric vehicles introduce new challenges for the power grid. In the US, buildings represent about 70% of the total electricity demand and demand response has the potential for reducing peaks of electricity by about 20%. Unlocking this potential requires control systems that operate on distributed systems, ideally data-driven and model-free. For this, reinforcement learning (RL) algorithms have gained increased interest in the past years. However, research in RL for demand response has been lacking the level of standardization that propelled the enormous progress in RL research in the computer science community. To remedy this, we created CityLearn, an OpenAI Gym Environment which allows researchers to implement, share, replicate, and compare their implementations of RL for demand response. Here, we discuss this environment and The CityLearn Challenge, a RL competition we organized to propel further progress in this field.

Related papers

• Aquatic Navigation: A Challenging Benchmark for Deep Reinforcement Learning [53.3760591018817]
  We propose a new benchmarking environment for aquatic navigation using recent advances in the integration between game engines and Deep Reinforcement Learning. Specifically, we focus on PPO, one of the most widely accepted algorithms, and we propose advanced training techniques. Our empirical evaluation shows that a well-designed combination of these ingredients can achieve promising results.
  arXiv  Detail & Related papers  (2024-05-30T23:20:23Z)
• MERLIN: Multi-agent offline and transfer learning for occupant-centric energy flexible operation of grid-interactive communities using smart meter data and CityLearn [0.0]
  Decarbonization of buildings presents new challenges for the reliability of the electrical grid. We propose the MERLIN framework and use a digital twin of a real-world grid-interactive residential community in CityLearn. We show that independent RL-controllers for batteries improve building and district level compared to a reference by tailoring their policies to individual buildings.
  arXiv  Detail & Related papers  (2022-12-31T21:37:14Z)
• PowRL: A Reinforcement Learning Framework for Robust Management of Power Networks [2.9822184411723645]
  This paper presents a reinforcement learning framework, PowRL, to mitigate the effects of unexpected network events. PowRL is benchmarked on a variety of competition datasets hosted by the L2RPN (Learning to Run a Power Network)
  arXiv  Detail & Related papers  (2022-12-05T16:22:12Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design [0.0]
  This challenge belongs to a series started in 2019 under the name "Learning to run a power network" (L2RPN) We introduce new more realistic scenarios proposed by RTE to reach carbon neutrality by 2050. We provide a baseline using state-of-the-art reinforcement learning algorithm to stimulate the future participants.
  arXiv  Detail & Related papers  (2022-07-21T06:56:46Z)
• Machine learning applications for electricity market agent-based models: A systematic literature review [68.8204255655161]
  Agent-based simulations are used to better understand the dynamics of the electricity market. Agent-based models provide the opportunity to integrate machine learning and artificial intelligence. We review 55 papers published between 2016 and 2021 which focus on machine learning applied to agent-based electricity market models.
  arXiv  Detail & Related papers  (2022-06-05T14:52:26Z)
• Automated Reinforcement Learning (AutoRL): A Survey and Open Problems [92.73407630874841]
  Automated Reinforcement Learning (AutoRL) involves not only standard applications of AutoML but also includes additional challenges unique to RL. We provide a common taxonomy, discuss each area in detail and pose open problems which would be of interest to researchers going forward.
  arXiv  Detail & Related papers  (2022-01-11T12:41:43Z)
• Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning [1.8175650854482457]
  The model-free deep reinforcement learning algorithm Rainbow Deep Q-Networks is used to control a battery in a small microgrid. The grid operates with its own demand and renewable generation based on a dataset collected at Keele University.
  arXiv  Detail & Related papers  (2021-06-10T21:27:35Z)
• RL Unplugged: A Suite of Benchmarks for Offline Reinforcement Learning [108.9599280270704]
  We propose a benchmark called RL Unplugged to evaluate and compare offline RL methods. RL Unplugged includes data from a diverse range of domains including games and simulated motor control problems. We will release data for all our tasks and open-source all algorithms presented in this paper.
  arXiv  Detail & Related papers  (2020-06-24T17:14:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.