Experimental study on surveillance video-based indoor occupancy measurement with occupant-centric control

• URL: http://arxiv.org/abs/2603.26081v1
• Date: Fri, 27 Mar 2026 05:19:42 GMT
• Title: Experimental study on surveillance video-based indoor occupancy measurement with occupant-centric control
• Abstract summary: This paper presents an experimental study of large language models (LLMs)-enhanced vision-based indoor occupancy measurement.<n>Results show that tracking-based methods improve temporal stability over detection-only measurement.<n>LLMs-enhanced refinement further improves occupancy measurement performance and reduces false unoccupied prediction.
• Score: 19.349952628032213
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate occupancy information is essential for closed-loop occupant-centric control (OCC) in smart buildings. However, existing vision-based occupancy measurement methods often struggle to provide stable and accurate measurements in real indoor environments, and their implications for downstream HVAC control remain insufficiently studied. To achieve Net Zero emissions by 2050, this paper presents an experimental study of large language models (LLMs)-enhanced vision-based indoor occupancy measurement and its impact on OCC-enabled HVAC operation. Detection-only, tracking-based, and LLM-based refinement pipelines are compared under identical conditions using real surveillance data collected from a research laboratory in China, with frame-level manual ground-truth annotations. Results show that tracking-based methods improve temporal stability over detection-only measurement, while LLM-based refinement further improves occupancy measurement performance and reduces false unoccupied prediction. The best-performing pipeline, YOLOv8+DeepSeek, achieves an accuracy of 0.8824 and an F1-score of 0.9320. This pipeline is then integrated into an HVAC supervisory model predictive control framework in OpenStudio-EnergyPlus. Experimental results demonstrate that the proposed framework can support more efficient OCC operation, achieving a substantial HVAC energy-saving potential of 17.94%. These findings provide an effective methodology and practical foundation for future research in AI-enhanced smart building operations.

Related papers

• Direct Advantage Estimation for Scalable and Sample-efficient Deep Reinforcement Learning [54.916555668983726]
  We introduce discrete latent dynamics models that efficiently approximate transition probabilities.<n>We find that DAE scales effectively with function approximator capacity while retaining high sample efficiency.
  arXiv  Detail & Related papers  (2026-06-18T15:58:48Z)
• Learning POMDP World Models from Observations with Language-Model Priors [52.11151769796862]
  Partially-observable Markov decision processes (POMDPs) provide a flexible modeling class for internal world models.<n>We ask whether language-model priors can reduce costly interaction by leveraging prior knowledge.<n>We show that emphPinductor matches the performance and sample efficiency of LLM-based POMDP learning methods.
  arXiv  Detail & Related papers  (2026-05-13T16:18:15Z)
• AWARE: Adaptive Whole-body Active Rotating Control for Enhanced LiDAR-Inertial Odometry under Human-in-the-Loop Interaction [15.502575136823237]
  Resource-constrained UAV platforms are often limited to narrow-field-of-view LiDAR sensors.<n>AWAKE is a bio-inspired whole-body active yawing framework that exploits the UAV's own rotational agility to extend the effective sensor horizon.<n>A Safe Flight Corridor mechanism ensures operational safety within this HITL paradigm by decoupling the operator's navigational intent from autonomous yaw optimization.
  arXiv  Detail & Related papers  (2026-04-12T12:07:58Z)
• Plug-and-Play Benchmarking of Reinforcement Learning Algorithms for Large-Scale Flow Control [61.155940786140455]
  Reinforcement learning (RL) has shown promising results in active flow control (AFC)<n>Current AFC benchmarks rely on external computational fluid dynamics (CFD) solvers, are not fully differentiable, and provide limited 3D and multi-agent support.<n>We introduce FluidGym, the first standalone, fully differentiable benchmark suite for RL in AFC.
  arXiv  Detail & Related papers  (2026-01-21T14:13:44Z)
• A Lightweight Transfer Learning-Based State-of-Health Monitoring with Application to Lithium-ion Batteries in Autonomous Air Vehicles [53.158733310637295]
  Transfer learning is a promising technique for leveraging knowledge from data-rich source working conditions.<n>Traditional TL-based state-of-health (SOH) monitoring is infeasible when applied in portable mobile devices.<n>This paper proposes a lightweight TL-based SOH monitoring approach with constructive transfer incremental learning (CITL)
  arXiv  Detail & Related papers  (2025-12-09T11:54:09Z)
• Data-driven operator learning for energy-efficient building control [2.3326951882644553]
  We present a data-driven framework that combines the physical accuracy of CFD with the computational efficiency of machine learning to enable energy-efficient building ventilation control.<n>We train a neural operator transformer to learn the mapping from building control actions to airflow field distributions using high-resolution CFD data.<n> Experimental results demonstrate that our approach achieves substantial energy savings compared to maximum airflow rate control, rule-based control, and data-driven control based on regional average CO2 predictions.
  arXiv  Detail & Related papers  (2025-04-30T00:45:49Z)
• Vision-based autonomous structural damage detection using data-driven methods [0.0]
  This study addresses the need for efficient and accurate damage detection in wind turbine structures.<n>Traditional inspection methods, such as manual assessments and non-destructive testing (NDT), are often costly, time-consuming, and prone to human error.<n>To tackle these challenges, this research investigates advanced deep learning algorithms for vision-based structural health monitoring.
  arXiv  Detail & Related papers  (2025-01-28T02:52:04Z)
• Experimental evaluation of offline reinforcement learning for HVAC control in buildings [12.542463083734614]
  Reinforcement learning (RL) techniques have been increasingly investigated for dynamic HVAC control in buildings. This paper comprehensively evaluates the strengths and limitations of state-of-the-art offline RL algorithms.
  arXiv  Detail & Related papers  (2024-08-15T07:25:52Z)
• Enhancing personalised thermal comfort models with Active Learning for improved HVAC controls [0.8192907805418583]
  This study proposes a thermal preference-based HVAC control framework enhanced with Active Learning (AL) to address the data challenges related to real-world implementations of such OCC systems. Preliminary results indicate a significant reduction in overall labelling effort between our AL-enabled OCC and conventional OCC while still achieving a slight increase in energy savings.
  arXiv  Detail & Related papers  (2023-09-16T18:42:58Z)
• B-Learner: Quasi-Oracle Bounds on Heterogeneous Causal Effects Under Hidden Confounding [51.74479522965712]
  We propose a meta-learner called the B-Learner, which can efficiently learn sharp bounds on the CATE function under limits on hidden confounding. We prove its estimates are valid, sharp, efficient, and have a quasi-oracle property with respect to the constituent estimators under more general conditions than existing methods.
  arXiv  Detail & Related papers  (2023-04-20T18:07:19Z)
• Predictive Coding for Locally-Linear Control [92.35650774524399]
  High-dimensional observations and unknown dynamics are major challenges when applying optimal control to many real-world decision making tasks. The Learning Controllable Embedding (LCE) framework addresses these challenges by embedding the observations into a lower dimensional latent space. We show theoretically that explicit next-observation prediction can be replaced with predictive coding.
  arXiv  Detail & Related papers  (2020-03-02T18:20:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.