Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

• URL: http://arxiv.org/abs/2110.13450v1
• Date: Tue, 26 Oct 2021 07:29:16 GMT
• Title: Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control
• Authors: Vinay Hanumaiah, Sahika Genc
• Abstract summary: It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning systems. We present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment. Using DRL, we achieve more than 75% savings in energy consumption.
• Score: 1.796271361142275
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the thermal comfort of the occupants is very challenging due to unknown and complex relationships between various HVAC controls and thermal dynamics inside a building. To this end, we present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment for optimizing HVAC in commercial buildings. This framework learns the complex thermal dynamics in the building and takes advantage of the differential effect of cooling and heating systems in the building to reduce energy costs, while maintaining the thermal comfort of the occupants. With adaptive penalty, the RL algorithm can be prioritized for energy savings or maintaining thermal comfort. Using DRL, we achieve more than 75\% savings in energy consumption. The distributed DRL framework can be scaled to multiple GPUs and CPUs of heterogeneous types.

Related papers

• An experimental evaluation of Deep Reinforcement Learning algorithms for HVAC control [40.71019623757305]
  Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform traditional reactive controllers. This paper provides a critical and reproducible evaluation of several state-of-the-art DRL algorithms for HVAC control.
  arXiv  Detail & Related papers  (2024-01-11T08:40:26Z)
• Global Transformer Architecture for Indoor Room Temperature Forecasting [49.32130498861987]
  This work presents a global Transformer architecture for indoor temperature forecasting in multi-room buildings. It aims at optimizing energy consumption and reducing greenhouse gas emissions associated with HVAC systems. Notably, this study is the first to apply a Transformer architecture for indoor temperature forecasting in multi-room buildings.
  arXiv  Detail & Related papers  (2023-10-31T14:09:32Z)
• Laxity-Aware Scalable Reinforcement Learning for HVAC Control [2.0625936401496237]
  We tackle the curse of dimensionality issue in modeling and control by utilizing the concept of laxity to quantify the emergency level of each operation request. We propose a two-level approach to address energy optimization for a large population of HVAC systems.
  arXiv  Detail & Related papers  (2023-06-29T01:28:14Z)
• Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach [4.323740171581589]
  HVAC systems account for about 40% of the total energy cost in the commercial sector. We propose a low-complexity DRL-based model with multi-input multi-output architecture for the HVAC energy optimization of open-plan offices.
  arXiv  Detail & Related papers  (2023-06-23T07:27:31Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• Uncertainty-Cognizant Model Predictive Control for Energy Management of Residential Buildings with PVT and Thermal Energy Storage [0.0]
  Building sector accounts for almost 40 percent of the global energy consumption. This paper offers a building energy system embracing a heat pump, a thermal energy storage system along with grid-connected thermal photovoltaic (PVT) collectors.
  arXiv  Detail & Related papers  (2022-01-21T22:30:13Z)
• LSTM-based Space Occupancy Prediction towards Efficient Building Energy Management [0.0]
  This paper proposes predictive time-series models of occupancy patterns using LSTM. Prediction signal for future room occupancy status on the next time span can be directly used to operate HVAC. We show that LSTM's room occupancy prediction based HVAC control could save energy usage by 50% compared to conventional RBC based control.
  arXiv  Detail & Related papers  (2020-12-15T06:32:07Z)
• Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings [38.326533494236266]
  In commercial buildings, about 40%-50% of the total electricity is attributed to Heating, Ventilation, and Air Conditioning systems. In this paper, we intend to minimize the energy cost of which an HVAC system in a multi-zone building under dynamic pricing with occupancy of zone, thermal comfort, and indoor air quality comfort.
  arXiv  Detail & Related papers  (2020-06-25T03:41:42Z)
• Controlling Rayleigh-B\'enard convection via Reinforcement Learning [62.997667081978825]
  The identification of effective control strategies to suppress or enhance the convective heat exchange under fixed external thermal gradients is an outstanding fundamental and technological issue. In this work, we explore a novel approach, based on a state-of-the-art Reinforcement Learning (RL) algorithm. We show that our RL-based control is able to stabilize the conductive regime and bring the onset of convection up to a Rayleigh number.
  arXiv  Detail & Related papers  (2020-03-31T16:39:25Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.