ThermoLLM: Thermodynamics-Aware HVAC Control with Spatial-Semantic Knowledge Graph

• URL: http://arxiv.org/abs/2606.22911v1
• Date: Mon, 22 Jun 2026 06:51:42 GMT
• Title: ThermoLLM: Thermodynamics-Aware HVAC Control with Spatial-Semantic Knowledge Graph
• Abstract summary: This paper presents a thermodynamics-aware LLM control framework for a five-zone EnergyPlus building simulation.<n>At each control step, the model receives the current building state, graph-structured spatial context, and recent environment-controller history.<n>Results show that the proposed approach achieves the best overall energy-comfort trade-off and the lowest PMV violation.
• Score: 11.363638628487912
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-zone HVAC control is a spatial decision problem in which indoor thermal evolution and control decisions depend not only on outdoor conditions and internal heat gains but also on zone layout, physical adjacency, and delayed thermal interactions across the building. Recent LLM-based HVAC controllers have shown that prompt-based control is feasible. However, these methods typically rely on task descriptions, observation values, short textual feedback, or unstructured retrieval, which limits their ability to reason about zone coupling, thermal response, and building dynamics. This paper presents a thermodynamics-aware LLM control framework for a five-zone EnergyPlus building simulation. The controller is grounded in a physics-informed spatial knowledge graph derived from Brick-style building semantics and linked with recent interaction history. At each control step, the model receives the current building state, graph-structured spatial context, and recent environment-controller history, enabling it to make decisions that reflect both building structure and short-term thermal evolution. We evaluate the framework against standard control baselines and several LLM-based alternatives. Results show that the proposed approach achieves the best overall energy-comfort trade-off and the lowest PMV violation while maintaining energy-efficient operation.

Related papers

• Generalizing HVAC Control With Domain Randomized Reinforcement Learning [6.460844680543445]
  NOMAD-RL is a general-purpose Reinforcement Learning (RL) controller designed to transfer across heterogeneous thermal zones.<n>Our main contribution is an adaptive domain randomization scheme based on physics-informed normalizing flows.<n>We evaluate NOMAD-RL against a constant-setpoint controller, RL without domain randomization, and MPC in single- and multi-zone settings.
  arXiv  Detail & Related papers  (2026-09-05T02:36:28Z)
• ADAPT: Physics-Aware Diffusion-based World Models for Adaptive Predictive Transferable HVAC Control [19.871939624912073]
  ADAPT is a physics-aware conditional diffusion indoor environmental world model for HVAC control.<n>It reduces HVAC energy consumption by 7.3% and occupant discomfort by 30.2% compared with state-of-the-art baselines under IID control.
  arXiv  Detail & Related papers  (2026-08-20T08:58:28Z)
• SkyJEPA: Learning Long-Horizon World Models for Zero-Shot Sim-to-Real Control of Quadrotors [48.60897189520386]
  We introduce the JEPA-style model for real-time quadrotor control.<n>We combine a latent dynamics model with a novel physics-inspired prober that maps frozen latents to interpretable state.<n>To reduce the dependence on expensive and unsafe real-world data collection, we develop a structured pipeline for automated dataset generation.
  arXiv  Detail & Related papers  (2026-06-22T15:00:59Z)
• LC-Opt: Benchmarking Reinforcement Learning and Agentic AI for End-to-End Liquid Cooling Optimization in Data Centers [18.187205962508646]
  We present LC-Opt, a benchmark environment for machine learning-based liquid cooling control strategies.<n>Built on the baseline of a high-fidelity digital twin of Oak Ridge National Lab's Frontier Supercomputer cooling system, LC-Opt provides detailed Modelica-based end-to-end models.<n>We benchmark centralized and decentralized multi-agent RL approaches, demonstrate policy distillation into decision and regression trees for interpretable control, and explore LLM-based methods that explain control actions in natural language.
  arXiv  Detail & Related papers  (2025-10-31T03:04:14Z)
• ASTREA: Introducing Agentic Intelligence for Orbital Thermal Autonomy [51.56484100374058]
  ASTREA is the first agentic system executed on flight-heritage hardware for autonomous spacecraft operations.<n>We integrate a resource-constrained Large Language Model (LLM) agent with a reinforcement learning controller in an asynchronous architecture tailored for space-qualified platforms.
  arXiv  Detail & Related papers  (2025-09-16T08:52:13Z)
• Towards Machine Learning-based Model Predictive Control for HVAC Control in Multi-Context Buildings at Scale via Ensemble Learning [16.62153443064872]
  Building thermodynamics models predict real-time indoor temperature changes under potential HVAC control operations.<n>These models often require extensive data collection periods and rely heavily on expert knowledge, making the modeling process inefficient and limiting the reusability of the models.<n>This paper explores a model ensemble perspective that utilizes existing developed models as base models to serve a target building environment.
  arXiv  Detail & Related papers  (2025-05-05T08:09:36Z)
• Partially stochastic deep learning with uncertainty quantification for model predictive heating control [0.0]
  Model Predictive Control (MPC) addresses drawbacks by using predictive modeling to optimize heating based on a building's learned thermal behavior.<n>MPC solutions often employ simplified physics-inspired indoor temperature models, sacrificing accuracy for robustness and interpretability.<n>We propose a partially deep learning architecture, dubbed LSTM+BNN, for building-specific indoor temperature modeling.
  arXiv  Detail & Related papers  (2025-04-04T11:07:23Z)
• The Smart Buildings Control Suite: A Diverse Open Source Benchmark to Evaluate and Scale HVAC Control Policies for Sustainability [7.963101539809386]
  Commercial buildings account for 17% of U.S. carbon emissions.<n>Model Predictive Control and Reinforcement Learning have been used to optimize control policies, scaling to thousands of buildings remains a significant unsolved challenge.<n>We present the Smart Buildings Control Suite, the first open source interactive HVAC control benchmark.
  arXiv  Detail & Related papers  (2024-10-02T06:30:07Z)
• Autonomous Payload Thermal Control [55.2480439325792]
  In small satellites there is less room for heat control equipment, scientific instruments, and electronic components. An autonomous thermal control tool that uses deep reinforcement learning is proposed for learning the thermal control policy onboard. The proposed framework is able to learn to control the payload processing power to maintain the temperature under operational ranges.
  arXiv  Detail & Related papers  (2023-07-28T09:40:19Z)
• A Dynamic Feedforward Control Strategy for Energy-efficient Building System Operation [59.56144813928478]
  In current control strategies and optimization algorithms, most of them rely on receiving information from real-time feedback. We propose an engineer-friendly control strategy framework that embeds dynamic prior knowledge from building system characteristics simultaneously for system control. We tested it in a case for heating system control with typical control strategies, which shows our framework owns a further energy-saving potential of 15%.
  arXiv  Detail & Related papers  (2023-01-23T09:07:07Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• Data-driven control of micro-climate in buildings: an event-triggered reinforcement learning approach [56.22460188003505]
  We formulate the micro-climate control problem based on semi-Markov decision processes. We propose two learning algorithms for event-triggered control of micro-climate in buildings. We show the efficacy of our proposed approach via designing a smart learning thermostat.
  arXiv  Detail & Related papers  (2020-01-28T18:20:43Z)
• NeurOpt: Neural network based optimization for building energy management and climate control [58.06411999767069]
  We propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy.
  arXiv  Detail & Related papers  (2020-01-22T00:51:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.