Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings

• URL: http://arxiv.org/abs/2006.14156v2
• Date: Wed, 22 Jul 2020 06:07:03 GMT
• Title: Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings
• Authors: Liang Yu, Yi Sun, Zhanbo Xu, Chao Shen, Dong Yue, Tao Jiang, and Xiaohong Guan
• Abstract summary: In commercial buildings, about 40%-50% of the total electricity is attributed to Heating, Ventilation, and Air Conditioning systems. In this paper, we intend to minimize the energy cost of which an HVAC system in a multi-zone building under dynamic pricing with occupancy of zone, thermal comfort, and indoor air quality comfort.
• Score: 38.326533494236266
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In commercial buildings, about 40%-50% of the total electricity consumption is attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems, which places an economic burden on building operators. In this paper, we intend to minimize the energy cost of an HVAC system in a multi-zone commercial building under dynamic pricing with the consideration of random zone occupancy, thermal comfort, and indoor air quality comfort. Due to the existence of unknown thermal dynamics models, parameter uncertainties (e.g., outdoor temperature, electricity price, and number of occupants), spatially and temporally coupled constraints associated with indoor temperature and CO2 concentration, a large discrete solution space, and a non-convex and non-separable objective function, it is very challenging to achieve the above aim. To this end, the above energy cost minimization problem is reformulated as a Markov game. Then, an HVAC control algorithm is proposed to solve the Markov game based on multi-agent deep reinforcement learning with attention mechanism. The proposed algorithm does not require any prior knowledge of uncertain parameters and can operate without knowing building thermal dynamics models. Simulation results based on real-world traces show the effectiveness, robustness and scalability of the proposed algorithm.

Related papers

• Efficient Data-Driven MPC for Demand Response of Commercial Buildings [0.0]
  We propose a data-driven and mixed-integer bidding strategy for energy management in small commercial buildings. We consider rooftop unit heating, air conditioning systems with discrete controls to accurately model the operation of most commercial buildings. We apply our approach in several demand response (DR) settings, including a time-of-use, and a critical rebate bidding.
  arXiv  Detail & Related papers  (2024-01-28T20:01:44Z)
• Global Transformer Architecture for Indoor Room Temperature Forecasting [49.32130498861987]
  This work presents a global Transformer architecture for indoor temperature forecasting in multi-room buildings. It aims at optimizing energy consumption and reducing greenhouse gas emissions associated with HVAC systems. Notably, this study is the first to apply a Transformer architecture for indoor temperature forecasting in multi-room buildings.
  arXiv  Detail & Related papers  (2023-10-31T14:09:32Z)
• Laxity-Aware Scalable Reinforcement Learning for HVAC Control [2.0625936401496237]
  We tackle the curse of dimensionality issue in modeling and control by utilizing the concept of laxity to quantify the emergency level of each operation request. We propose a two-level approach to address energy optimization for a large population of HVAC systems.
  arXiv  Detail & Related papers  (2023-06-29T01:28:14Z)
• Powerful ordered collective heat engines [58.720142291102135]
  We introduce a class of engines in which the regime of units operating synchronously can boost the performance. We show that the interplay between Ising-like interactions and a collective ordered regime is crucial to operate as a heat engine.
  arXiv  Detail & Related papers  (2023-01-16T20:14:19Z)
• Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control [1.796271361142275]
  It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning systems. We present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment. Using DRL, we achieve more than 75% savings in energy consumption.
  arXiv  Detail & Related papers  (2021-10-26T07:29:16Z)
• Model-assisted Learning-based Framework for Sensor Fault-Tolerant Building HVAC Control [2.6246169665063634]
  We present a novel learning-based framework for sensor fault-tolerant HVAC control. It includes three deep learning based components for 1) generating temperature proposals with the consideration of possible sensor faults, 2) selecting one of the proposals based on the assessment of their accuracy, and 3) applying reinforcement learning with the selected temperature proposal.
  arXiv  Detail & Related papers  (2021-06-27T05:03:08Z)
• Demand-Side Scheduling Based on Multi-Agent Deep Actor-Critic Learning for Smart Grids [56.35173057183362]
  We consider the problem of demand-side energy management, where each household is equipped with a smart meter that is able to schedule home appliances online. The goal is to minimize the overall cost under a real-time pricing scheme. We propose the formulation of a smart grid environment as a Markov game.
  arXiv  Detail & Related papers  (2020-05-05T07:32:40Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.