A robust deep learning-based damage identification approach for SHM
considering missing data
- URL: http://arxiv.org/abs/2304.00040v1
- Date: Fri, 31 Mar 2023 18:00:56 GMT
- Title: A robust deep learning-based damage identification approach for SHM
considering missing data
- Authors: Fan Deng, Xiaoming Tao, Pengxiang Wei, Shiyin Wei
- Abstract summary: Missing data significantly impacts the conduction of Structural Health Monitoring method.
This paper develops a robust method for damage identification that considers the missing data occasions.
Results show that the missing data imputation and damage identification can be implemented together.
- Score: 12.46223206282221
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Data-driven method for Structural Health Monitoring (SHM), that mine the
hidden structural performance from the correlations among monitored time series
data, has received widely concerns recently. However, missing data
significantly impacts the conduction of this method. Missing data is a
frequently encountered issue in time series data in SHM and many other
real-world applications, that harms to the standardized data mining and
downstream tasks, such as condition assessment. Imputation approaches based on
spatiotemporal relations among monitoring data are developed to handle this
issue, however, no additional information is added during imputation. This
paper thus develops a robust method for damage identification that considers
the missing data occasions, based on long-short term memory (LSTM) model and
dropout mechanism in the autoencoder (AE) framework. Inputs channels are
randomly dropped to simulate the missing data in training, and reconstruction
errors are used as the loss function and the damage indicator. Quasi-static
response (cable tension) of a cable-stayed bridge released in 1st IPC-SHM is
employed to verify this proposed method, and results show that the missing data
imputation and damage identification can be implemented together in a unified
way.
Related papers
- Missing data imputation for noisy time-series data and applications in healthcare [5.586166090905021]
Imputation, i.e., filling in the missing values, is a common way to deal with noisy, missing time series data.
In this study, we compare imputation methods, including Multiple Imputation with Random Forest (MICE-RF) and advanced deep learning approaches.
Our results show that MICE-RF can effectively impute missing data compared to deep learning methods.
arXiv Detail & Related papers (2024-12-15T12:23:20Z) - DeepHYDRA: Resource-Efficient Time-Series Anomaly Detection in Dynamically-Configured Systems [3.44012349879073]
We present DeepHYDRA (Deep Hybrid DBSCAN/Reduction-Based Anomaly Detection)
It combines DBSCAN and learning-based anomaly detection.
It is shown to reliably detect different types of anomalies in both large and complex datasets.
arXiv Detail & Related papers (2024-05-13T13:47:15Z) - PULL: Reactive Log Anomaly Detection Based On Iterative PU Learning [58.85063149619348]
We propose PULL, an iterative log analysis method for reactive anomaly detection based on estimated failure time windows.
Our evaluation shows that PULL consistently outperforms ten benchmark baselines across three different datasets.
arXiv Detail & Related papers (2023-01-25T16:34:43Z) - DynImp: Dynamic Imputation for Wearable Sensing Data Through Sensory and
Temporal Relatedness [78.98998551326812]
We argue that traditional methods have rarely made use of both times-series dynamics of the data as well as the relatedness of the features from different sensors.
We propose a model, termed as DynImp, to handle different time point's missingness with nearest neighbors along feature axis.
We show that the method can exploit the multi-modality features from related sensors and also learn from history time-series dynamics to reconstruct the data under extreme missingness.
arXiv Detail & Related papers (2022-09-26T21:59:14Z) - Unsupervised Anomaly Detection in 3D Brain MRI using Deep Learning with
impured training data [53.122045119395594]
We study how unhealthy samples within the training data affect anomaly detection performance for brain MRI-scans.
We evaluate a method to identify falsely labeled samples directly during training based on the reconstruction error of the AE.
arXiv Detail & Related papers (2022-04-12T13:05:18Z) - Convolutional generative adversarial imputation networks for
spatio-temporal missing data in storm surge simulations [86.5302150777089]
Generative Adversarial Imputation Nets (GANs) and GAN-based techniques have attracted attention as unsupervised machine learning methods.
We name our proposed method as Con Conval Generative Adversarial Imputation Nets (Conv-GAIN)
arXiv Detail & Related papers (2021-11-03T03:50:48Z) - Imputation-Free Learning from Incomplete Observations [73.15386629370111]
We introduce the importance of guided gradient descent (IGSGD) method to train inference from inputs containing missing values without imputation.
We employ reinforcement learning (RL) to adjust the gradients used to train the models via back-propagation.
Our imputation-free predictions outperform the traditional two-step imputation-based predictions using state-of-the-art imputation methods.
arXiv Detail & Related papers (2021-07-05T12:44:39Z) - Medical data wrangling with sequential variational autoencoders [5.9207487081080705]
This paper proposes to model medical data records with heterogeneous data types and bursty missing data using sequential variational autoencoders (VAEs)
We show that Shi-VAE achieves the best performance in terms of using both metrics, with lower computational complexity than the GP-VAE model.
arXiv Detail & Related papers (2021-03-12T10:59:26Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - Data Anomaly Detection for Structural Health Monitoring of Bridges using
Shapelet Transform [0.0]
A number of Structural Health Monitoring (SHM) systems are deployed to monitor civil infrastructure.
The data measured by the SHM systems tend to be affected by multiple anomalies caused by faulty or broken sensors.
This paper proposes the use of a relatively new time series representation named Shapelet Transform to autonomously identify anomalies in SHM data.
arXiv Detail & Related papers (2020-08-31T01:11:04Z) - Data-Driven Failure Prediction in Brittle Materials: A Phase-Field Based
Machine Learning Framework [1.3858051019755282]
Failure in brittle materials led by micro- to macro-cracks under repetitive or increasing loads is often catastrophic.
We develop a supervised machine learning (ML) framework to predict failure in an isothermal, linear elastic and isotropic phase-field model.
Results indicate that the proposed framework is capable of predicting failure with acceptable accuracy even in the presence of high noise levels.
arXiv Detail & Related papers (2020-03-24T17:13:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.