Filling time-series gaps using image techniques: Multidimensional context autoencoder approach for building energy data imputation

• URL: http://arxiv.org/abs/2307.05926v2
• Date: Thu, 13 Jul 2023 01:04:51 GMT
• Title: Filling time-series gaps using image techniques: Multidimensional context autoencoder approach for building energy data imputation
• Authors: Chun Fu, Matias Quintana, Zoltan Nagy, Clayton Miller
• Abstract summary: Building energy prediction and management has become increasingly important in recent decades. Energy data is often collected from multiple sources and can be incomplete or inconsistent. This study compares PConv, Convolutional neural networks (CNNs), and weekly persistence method using one of the biggest publicly available whole building energy datasets.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Building energy prediction and management has become increasingly important in recent decades, driven by the growth of Internet of Things (IoT) devices and the availability of more energy data. However, energy data is often collected from multiple sources and can be incomplete or inconsistent, which can hinder accurate predictions and management of energy systems and limit the usefulness of the data for decision-making and research. To address this issue, past studies have focused on imputing missing gaps in energy data, including random and continuous gaps. One of the main challenges in this area is the lack of validation on a benchmark dataset with various building and meter types, making it difficult to accurately evaluate the performance of different imputation methods. Another challenge is the lack of application of state-of-the-art imputation methods for missing gaps in energy data. Contemporary image-inpainting methods, such as Partial Convolution (PConv), have been widely used in the computer vision domain and have demonstrated their effectiveness in dealing with complex missing patterns. To study whether energy data imputation can benefit from the image-based deep learning method, this study compared PConv, Convolutional neural networks (CNNs), and weekly persistence method using one of the biggest publicly available whole building energy datasets, consisting of 1479 power meters worldwide, as the benchmark. The results show that, compared to the CNN with the raw time series (1D-CNN) and the weekly persistence method, neural network models with reshaped energy data with two dimensions reduced the Mean Squared Error (MSE) by 10% to 30%. The advanced deep learning method, Partial convolution (PConv), has further reduced the MSE by 20-30% than 2D-CNN and stands out among all models.

Related papers

• Quanv4EO: Empowering Earth Observation by means of Quanvolutional Neural Networks [62.12107686529827]
  This article highlights a significant shift towards leveraging quantum computing techniques in processing large volumes of remote sensing data. The proposed Quanv4EO model introduces a quanvolution method for preprocessing multi-dimensional EO data. Key findings suggest that the proposed model not only maintains high precision in image classification but also shows improvements of around 5% in EO use cases.
  arXiv  Detail & Related papers  (2024-07-24T09:11:34Z)
• EnergyDiff: Universal Time-Series Energy Data Generation using Diffusion Models [2.677325229270716]
  High-resolution time series data are crucial for operation and planning in energy systems. Due to data collection costs and privacy concerns, such data is often unavailable or insufficient for downstream tasks. We propose EnergyDiff, a universal data generation framework for energy time series data.
  arXiv  Detail & Related papers  (2024-07-18T14:10:50Z)
• A Gap in Time: The Challenge of Processing Heterogeneous IoT Point Data in Buildings [15.06538531625261]
  The need for sustainable energy solutions has driven the integration of digitalized buildings into the power grid. incorporating IoT point data within deep-learning frameworks for energy management presents a complex challenge. This paper comprehensively analyzes the multifaceted heterogeneity present in real-world building IoT data streams.
  arXiv  Detail & Related papers  (2024-05-23T07:45:48Z)
• Hybrid AI-based Anomaly Detection Model using Phasor Measurement Unit Data [0.41998444721319217]
  Using phasor measurement units (PMUs) to surveil the power system is one of the technologies that have a promising future. The increased cyber-physical interaction offers both benefits and drawbacks, where one of the drawbacks comes in the form of anomalies in the measurement data. This paper aims to develop a hybrid AI-based model that is based on various methods for anomaly detection in PMUs data.
  arXiv  Detail & Related papers  (2022-09-21T11:22:01Z)
• Low-Energy Convolutional Neural Networks (CNNs) using Hadamard Method [0.0]
  Convolutional neural networks (CNNs) are a potential approach for object recognition and detection. A new approach based on the Hadamard transformation as an alternative to the convolution operation is demonstrated. The method is helpful for other computer vision tasks when the kernel size is smaller than the input image size.
  arXiv  Detail & Related papers  (2022-09-06T21:36:57Z)
• Combining Embeddings and Fuzzy Time Series for High-Dimensional Time Series Forecasting in Internet of Energy Applications [0.0]
  Fuzzy Time Series (FTS) models stand out as data-driven non-parametric models of easy implementation and high accuracy. We present a new methodology for handling high-dimensional time series, by projecting the original high-dimensional data into a low dimensional embedding space.
  arXiv  Detail & Related papers  (2021-12-03T19:50:09Z)
• Convolutional generative adversarial imputation networks for spatio-temporal missing data in storm surge simulations [86.5302150777089]
  Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods. We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
  arXiv  Detail & Related papers  (2021-11-03T03:50:48Z)
• Adversarial Energy Disaggregation for Non-intrusive Load Monitoring [78.47901044638525]
  Energy disaggregation, also known as non-intrusive load monitoring (NILM), challenges the problem of separating the whole-home electricity usage into appliance-specific individual consumptions. Recent advances reveal that deep neural networks (DNNs) can get favorable performance for NILM. We introduce the idea of adversarial learning into NILM, which is new for the energy disaggregation task.
  arXiv  Detail & Related papers  (2021-08-02T03:56:35Z)
• Energy-Efficient Model Compression and Splitting for Collaborative Inference Over Time-Varying Channels [52.60092598312894]
  We propose a technique to reduce the total energy bill at the edge device by utilizing model compression and time-varying model split between the edge and remote nodes. Our proposed solution results in minimal energy consumption and $CO$ emission compared to the considered baselines.
  arXiv  Detail & Related papers  (2021-06-02T07:36:27Z)
• Power Modeling for Effective Datacenter Planning and Compute Management [53.41102502425513]
  We discuss two classes of statistical power models designed and validated to be accurate, simple, interpretable and applicable to all hardware configurations and workloads. We demonstrate that the proposed statistical modeling techniques, while simple and scalable, predict power with less than 5% Mean Absolute Percent Error (MAPE) for more than 95% diverse Power Distribution Units (more than 2000) using only 4 features.
  arXiv  Detail & Related papers  (2021-03-22T21:22:51Z)
• Targeted free energy estimation via learned mappings [66.20146549150475]
  Free energy perturbation (FEP) was proposed by Zwanzig more than six decades ago as a method to estimate free energy differences. FEP suffers from a severe limitation: the requirement of sufficient overlap between distributions. One strategy to mitigate this problem, called Targeted Free Energy Perturbation, uses a high-dimensional mapping in configuration space to increase overlap.
  arXiv  Detail & Related papers  (2020-02-12T11:10:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.