Short-Term Aggregated Residential Load Forecasting using BiLSTM and
CNN-BiLSTM
- URL: http://arxiv.org/abs/2302.05033v1
- Date: Fri, 10 Feb 2023 03:11:02 GMT
- Title: Short-Term Aggregated Residential Load Forecasting using BiLSTM and
CNN-BiLSTM
- Abstract summary: Short-term residential load forecasting has become an increasing area of focus.
Recently deep neural networks have been leveraged to address this issue.
This paper investigates the capabilities of a bidirectional long short-term memory (BiLSTM) and a convolutional neural network-based BiLSTM.
- Score: 0.3499870393443268
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Higher penetration of renewable and smart home technologies at the
residential level challenges grid stability as utility-customer interactions
add complexity to power system operations. In response, short-term residential
load forecasting has become an increasing area of focus. However, forecasting
at the residential level is challenging due to the higher uncertainties
involved. Recently deep neural networks have been leveraged to address this
issue. This paper investigates the capabilities of a bidirectional long
short-term memory (BiLSTM) and a convolutional neural network-based BiLSTM
(CNN-BiLSTM) to provide a day ahead (24 hr.) forecasting at an hourly
resolution while minimizing the root mean squared error (RMSE) between the
actual and predicted load demand. Using a publicly available dataset consisting
of 38 homes, the BiLSTM and CNN-BiLSTM models are trained to forecast the
aggregated active power demand for each hour within a 24 hr. span, given the
previous 24 hr. load data. The BiLSTM model achieved the lowest RMSE of 1.4842
for the overall daily forecast. In addition, standard LSTM and CNN-LSTM models
are trained and compared with the BiLSTM architecture. The RMSE of BiLSTM is
5.60%, 2.85% and 2.60% lower than the LSTM, CNN-LSTM and CNN-BiLSTM models
respectively. The source code of this work is available at
https://github.com/Varat7v2/STLF-BiLSTM-CNNBiLSTM.git.
Related papers
- LSTM Variants for Chaotic Dynamical Systems: An Empirical Study on the Lorenz Attractor [0.0]
We study seven recurrent and convolutional architectures for the AI-DEEDS 2026 Chaotic Systems Challenge.<n>We obtain leaderboard scores between 45.72 and 58.81, with the BiLSTM trained with Huber loss being the strongest configuration.<n>Two findings stand out: (i) adding additive attention to the unidirectional baseline degraded performance by over ten points, and (ii) prepending a CNN front-end to either an LSTM or a BiLSTM did not help and slightly hurt the score.
arXiv Detail & Related papers (2026-06-21T20:39:35Z) - Towards Sample Efficient Entanglement Classification for 3 and 4 Qubit Systems: A Tailored CNN-BiLSTM Approach [6.448866790627225]
We propose a hybrid neural network architecture integrating Convolutional and Bidirectional Long Short-Term Memory networks (CNN-BiLSTM)<n>This design leverages CNNs for local feature extraction and BiLSTMs for sequential dependency modeling, enabling robust feature learning from minimal training data.<n>When trained on only 100 samples, Architecture 2 maintains classification accuracies exceeding 90% for both 3-qubit and 4-qubit systems, demonstrating rapid loss within tens of epochs.
arXiv Detail & Related papers (2026-01-30T04:59:44Z) - Transforming Credit Risk Analysis: A Time-Series-Driven ResE-BiLSTM Framework for Post-Loan Default Detection [12.68085308605668]
Prediction of post-loan default is an important task in credit risk management.<n>This study introduces a ResE-BiLSTM model, using a sliding window technique.<n>It is evaluated on 44 independent cohorts from the extensive Freddie Mac US mortgage dataset.
arXiv Detail & Related papers (2025-08-01T08:13:14Z) - Deep Learning Calabi-Yau four folds with hybrid and recurrent neural network architectures [0.0]
We report the results of applying deep learning based on hybrid convolutional-recurrent and purely recurrent neural network architectures to a dataset of almost one million complete intersection Calabi-Yau four-folds (CICY4)
In terms of the $h1,1, h2,1, h3,1, h2,2$ prediction accuracies, at 72% training ratio, our best performing individual model is CNN-LSTM-400.
The top two performing models LSTM-448 and LSTM-424 are both LSTM-based with the hidden sizes of 448 and
arXiv Detail & Related papers (2024-05-27T17:55:05Z) - Federated Quantum Long Short-term Memory (FedQLSTM) [58.50321380769256]
Quantum federated learning (QFL) can facilitate collaborative learning across multiple clients using quantum machine learning (QML) models.
No prior work has focused on developing a QFL framework that utilizes temporal data to approximate functions.
A novel QFL framework that is the first to integrate quantum long short-term memory (QLSTM) models with temporal data is proposed.
arXiv Detail & Related papers (2023-12-21T21:40:47Z) - RigLSTM: Recurrent Independent Grid LSTM for Generalizable Sequence
Learning [75.61681328968714]
We propose recurrent independent Grid LSTM (RigLSTM) to exploit the underlying modular structure of the target task.
Our model adopts cell selection, input feature selection, hidden state selection, and soft state updating to achieve a better generalization ability.
arXiv Detail & Related papers (2023-11-03T07:40:06Z) - Extreme-Long-short Term Memory for Time-series Prediction [0.0]
Long Short-Term Memory (LSTM) is a new type of Recurrent Neural Networks (RNN)
In this paper, we propose an advanced LSTM algorithm, the Extreme Long Short-Term Memory (E-LSTM)
The new E-LSTM requires only 2 epochs to obtain the results of the 7th epoch traditional LSTM.
arXiv Detail & Related papers (2022-10-15T09:45:48Z) - Image Classification using Sequence of Pixels [3.04585143845864]
This study compares sequential image classification methods based on recurrent neural networks.
We describe methods based on Long-Short-Term memory(LSTM), bidirectional Long-Short-Term memory(BiLSTM) architectures, etc.
arXiv Detail & Related papers (2022-09-23T09:42:44Z) - Bayesian Neural Network Language Modeling for Speech Recognition [59.681758762712754]
State-of-the-art neural network language models (NNLMs) represented by long short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming highly complex.
In this paper, an overarching full Bayesian learning framework is proposed to account for the underlying uncertainty in LSTM-RNN and Transformer LMs.
arXiv Detail & Related papers (2022-08-28T17:50:19Z) - Use of 1D-CNN for input data size reduction of LSTM in Hourly
Rainfall-Runoff modeling [0.0]
CNNsLSTM was implemented for hourly rainfall-runoff modeling at the Ishikari River watershed, Japan.
Results of CNNsLSTM were compared with those of 1D-CNN, LSTM only with hourly inputs (LSTMwHour), parallel architecture of 1D-CNN and LSTM (CNNpLSTM), and the LSTM architecture which uses both daily and hourly input data (LSTMwDpH)
arXiv Detail & Related papers (2021-11-07T23:46:06Z) - End-to-end LSTM based estimation of volcano event epicenter localization [55.60116686945561]
An end-to-end based LSTM scheme is proposed to address the problem of volcano event localization.
LSTM was chosen due to its capability to capture the dynamics of time varying signals.
Results show that the LSTM based architecture provided a success rate, i.e., an error smaller than 1.0Km, equal to 48.5%.
arXiv Detail & Related papers (2021-10-27T17:11:33Z) - ANNETTE: Accurate Neural Network Execution Time Estimation with Stacked
Models [56.21470608621633]
We propose a time estimation framework to decouple the architectural search from the target hardware.
The proposed methodology extracts a set of models from micro- kernel and multi-layer benchmarks and generates a stacked model for mapping and network execution time estimation.
We compare estimation accuracy and fidelity of the generated mixed models, statistical models with the roofline model, and a refined roofline model for evaluation.
arXiv Detail & Related papers (2021-05-07T11:39:05Z) - Process Outcome Prediction: CNN vs. LSTM (with Attention) [0.15229257192293202]
We study the performance of Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) on time series problems.
Our findings show that all these neural networks achieve satisfactory to high predictive power.
We argue that CNNs' speed, early predictive power and robustness should pave the way for their application in process outcome prediction.
arXiv Detail & Related papers (2021-04-14T15:38:32Z) - High-Accuracy and Low-Latency Speech Recognition with Two-Head
Contextual Layer Trajectory LSTM Model [46.34788932277904]
We improve conventional hybrid LSTM acoustic models for high-accuracy and low-latency automatic speech recognition.
To achieve high accuracy, we use a contextual layer trajectory LSTM (cltLSTM), which decouples the temporal modeling and target classification tasks.
We further improve the training strategy with sequence-level teacher-student learning.
arXiv Detail & Related papers (2020-03-17T00:52:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.