HVAC-DPT: A Decision Pretrained Transformer for HVAC Control

• URL: http://arxiv.org/abs/2411.19746v1
• Date: Fri, 29 Nov 2024 14:46:37 GMT
• Title: HVAC-DPT: A Decision Pretrained Transformer for HVAC Control
• Authors: Anaïs Berkes,
• Abstract summary: Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning systems responsible for up to 50%. Existing control strategies lack generalisation and require extensive training and data. This paper introduces HVAC-DPT, a Decision-Pretrained Transformer using in-context Reinforcement Learning.
• Score: 0.0
• License:
• Abstract: Building operations consume approximately 40% of global energy, with Heating, Ventilation, and Air Conditioning (HVAC) systems responsible for up to 50% of this consumption. As HVAC energy demands are expected to rise, optimising system efficiency is crucial for reducing future energy use and mitigating climate change. Existing control strategies lack generalisation and require extensive training and data, limiting their rapid deployment across diverse buildings. This paper introduces HVAC-DPT, a Decision-Pretrained Transformer using in-context Reinforcement Learning (RL) for multi-zone HVAC control. HVAC-DPT frames HVAC control as a sequential prediction task, training a causal transformer on interaction histories generated by diverse RL agents. This approach enables HVAC-DPT to refine its policy in-context, without modifying network parameters, allowing for deployment across different buildings without the need for additional training or data collection. HVAC-DPT reduces energy consumption in unseen buildings by 45% compared to the baseline controller, offering a scalable and effective approach to mitigating the increasing environmental impact of HVAC systems.

Related papers

• Employing Federated Learning for Training Autonomous HVAC Systems [3.4137115855910767]
  Buildings account for 40 % of global energy consumption. Implementing smart, energy-efficient HVAC systems has the potential to significantly impact the course of climate change. Model-free reinforcement learning algorithms have been shown to outperform classical controllers in terms of energy cost and consumption, as well as thermal comfort.
  arXiv  Detail & Related papers  (2024-05-01T08:42:22Z)
• An experimental evaluation of Deep Reinforcement Learning algorithms for HVAC control [40.71019623757305]
  Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform traditional reactive controllers. This paper provides a critical and reproducible evaluation of several state-of-the-art DRL algorithms for HVAC control.
  arXiv  Detail & Related papers  (2024-01-11T08:40:26Z)
• Global Transformer Architecture for Indoor Room Temperature Forecasting [49.32130498861987]
  This work presents a global Transformer architecture for indoor temperature forecasting in multi-room buildings. It aims at optimizing energy consumption and reducing greenhouse gas emissions associated with HVAC systems. Notably, this study is the first to apply a Transformer architecture for indoor temperature forecasting in multi-room buildings.
  arXiv  Detail & Related papers  (2023-10-31T14:09:32Z)
• Hybrid Reinforcement Learning for Optimizing Pump Sustainability in Real-World Water Distribution Networks [55.591662978280894]
  This article addresses the pump-scheduling optimization problem to enhance real-time control of real-world water distribution networks (WDNs) Our primary objectives are to adhere to physical operational constraints while reducing energy consumption and operational costs. Traditional optimization techniques, such as evolution-based and genetic algorithms, often fall short due to their lack of convergence guarantees.
  arXiv  Detail & Related papers  (2023-10-13T21:26:16Z)
• Laxity-Aware Scalable Reinforcement Learning for HVAC Control [2.0625936401496237]
  We tackle the curse of dimensionality issue in modeling and control by utilizing the concept of laxity to quantify the emergency level of each operation request. We propose a two-level approach to address energy optimization for a large population of HVAC systems.
  arXiv  Detail & Related papers  (2023-06-29T01:28:14Z)
• Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach [4.323740171581589]
  HVAC systems account for about 40% of the total energy cost in the commercial sector. We propose a low-complexity DRL-based model with multi-input multi-output architecture for the HVAC energy optimization of open-plan offices.
  arXiv  Detail & Related papers  (2023-06-23T07:27:31Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control [1.796271361142275]
  It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning systems. We present a multi-agent, distributed deep reinforcement learning (DRL) framework based on Energy Plus simulation environment. Using DRL, we achieve more than 75% savings in energy consumption.
  arXiv  Detail & Related papers  (2021-10-26T07:29:16Z)
• Investigating Underlying Drivers of Variability in Residential Energy Usage Patterns with Daily Load Shape Clustering of Smart Meter Data [53.51471969978107]
  Large-scale deployment of smart meters has motivated increasing studies to explore disaggregated daily load patterns. This paper aims to shed light on the mechanisms by which electricity consumption patterns exhibit variability.
  arXiv  Detail & Related papers  (2021-02-16T16:56:27Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.