Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach

• URL: http://arxiv.org/abs/2306.13333v2
• Date: Wed, 15 Nov 2023 04:40:23 GMT
• Title: Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach
• Authors: Hao Wang, Xiwen Chen, Natan Vital, Edward.Duffy, Abolfazl Razi
• Abstract summary: HVAC systems account for about 40% of the total energy cost in the commercial sector. We propose a low-complexity DRL-based model with multi-input multi-output architecture for the HVAC energy optimization of open-plan offices.
• Score: 4.323740171581589
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With more than 32% of the global energy used by commercial and residential buildings, there is an urgent need to revisit traditional approaches to Building Energy Management (BEM). With HVAC systems accounting for about 40% of the total energy cost in the commercial sector, we propose a low-complexity DRL-based model with multi-input multi-output architecture for the HVAC energy optimization of open-plan offices, which uses only a handful of controllable and accessible factors. The efficacy of our solution is evaluated through extensive analysis of the overall energy consumption and thermal comfort levels compared to a baseline system based on the existing HVAC schedule in a real building. This comparison shows that our method achieves 37% savings in energy consumption with minimum violation (<1%) of the desired temperature range during work hours. It takes only a total of 40 minutes for 5 epochs (about 7.75 minutes per epoch) to train a network with superior performance and covering diverse conditions for its low-complexity architecture; therefore, it easily adapts to changes in the building setups, weather conditions, occupancy rate, etc. Moreover, by enforcing smoothness on the control strategy, we suppress the frequent and unpleasant on/off transitions on HVAC units to avoid occupant discomfort and potential damage to the system. The generalizability of our model is verified by applying it to different building models and under various weather conditions.

Related papers

• Global Transformer Architecture for Indoor Room Temperature Forecasting [49.32130498861987]
  This work presents a global Transformer architecture for indoor temperature forecasting in multi-room buildings. It aims at optimizing energy consumption and reducing greenhouse gas emissions associated with HVAC systems. Notably, this study is the first to apply a Transformer architecture for indoor temperature forecasting in multi-room buildings.
  arXiv  Detail & Related papers  (2023-10-31T14:09:32Z)
• Laxity-Aware Scalable Reinforcement Learning for HVAC Control [2.0625936401496237]
  We tackle the curse of dimensionality issue in modeling and control by utilizing the concept of laxity to quantify the emergency level of each operation request. We propose a two-level approach to address energy optimization for a large population of HVAC systems.
  arXiv  Detail & Related papers  (2023-06-29T01:28:14Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• Zero-Shot Building Control [0.0]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. Existing solutions require pre-training in simulators that are prohibitively expensive to obtain for every building in the world. We show it is possible to perform safe, zero-shot control of buildings by combining ideas from system identification and model-based RL.
  arXiv  Detail & Related papers  (2022-06-28T17:56:40Z)
• Domain Knowledge Aids in Signal Disaggregation; the Example of the Cumulative Water Heater [68.8204255655161]
  We present an unsupervised low-frequency method aimed at detecting and disaggregating the power used by Cumulative Water Heaters (CWH) in residential homes. Our model circumvents the inherent difficulty of unsupervised signal disaggregation by using both the shape of a power spike and its time of occurrence. Our model, despite its simplicity, offers promising applications: detection of mis-configured CWHs on off-peak contracts and slow performance degradation.
  arXiv  Detail & Related papers  (2022-03-22T10:39:19Z)
• Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control [1.796271361142275]
  It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning systems. We present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment. Using DRL, we achieve more than 75% savings in energy consumption.
  arXiv  Detail & Related papers  (2021-10-26T07:29:16Z)
• Investigating Underlying Drivers of Variability in Residential Energy Usage Patterns with Daily Load Shape Clustering of Smart Meter Data [53.51471969978107]
  Large-scale deployment of smart meters has motivated increasing studies to explore disaggregated daily load patterns. This paper aims to shed light on the mechanisms by which electricity consumption patterns exhibit variability.
  arXiv  Detail & Related papers  (2021-02-16T16:56:27Z)
• LSTM-based Space Occupancy Prediction towards Efficient Building Energy Management [0.0]
  This paper proposes predictive time-series models of occupancy patterns using LSTM. Prediction signal for future room occupancy status on the next time span can be directly used to operate HVAC. We show that LSTM's room occupancy prediction based HVAC control could save energy usage by 50% compared to conventional RBC based control.
  arXiv  Detail & Related papers  (2020-12-15T06:32:07Z)
• Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings [38.326533494236266]
  In commercial buildings, about 40%-50% of the total electricity is attributed to Heating, Ventilation, and Air Conditioning systems. In this paper, we intend to minimize the energy cost of which an HVAC system in a multi-zone building under dynamic pricing with occupancy of zone, thermal comfort, and indoor air quality comfort.
  arXiv  Detail & Related papers  (2020-06-25T03:41:42Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.