Deep Learning for Multivariate Time Series Imputation: A Survey

• URL: http://arxiv.org/abs/2402.04059v2
• Date: Wed, 12 Feb 2025 13:16:29 GMT
• Title: Deep Learning for Multivariate Time Series Imputation: A Survey
• Authors: Jun Wang, Wenjie Du, Yiyuan Yang, Linglong Qian, Wei Cao, Keli Zhang, Wenjia Wang, Yuxuan Liang, Qingsong Wen,
• Abstract summary: Missing values are ubiquitous in time series data, posing challenges for accurate analysis and downstream applications.<n>Deep learning-based methods have successfully handled missing data by leveraging complex temporal dependencies and learned data distributions.<n>We propose a novel taxonomy that categorizes existing methods based on two key perspectives: imputation uncertainty and neural network architecture.
• Score: 34.31414745076129
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Missing values are ubiquitous in multivariate time series (MTS) data, posing significant challenges for accurate analysis and downstream applications. In recent years, deep learning-based methods have successfully handled missing data by leveraging complex temporal dependencies and learned data distributions. In this survey, we provide a comprehensive summary of deep learning approaches for multivariate time series imputation (MTSI) tasks. We propose a novel taxonomy that categorizes existing methods based on two key perspectives: imputation uncertainty and neural network architecture. Furthermore, we summarize existing MTSI toolkits with a particular emphasis on the PyPOTS Ecosystem, which provides an integrated and standardized foundation for MTSI research. Finally, we discuss key challenges and future research directions, which give insight for further MTSI research. This survey aims to serve as a valuable resource for researchers and practitioners in the field of time series analysis and missing data imputation tasks.

Related papers

• Multi-modal Time Series Analysis: A Tutorial and Survey [36.93906365779472]
  Multi-modal time series analysis has emerged as a prominent research area in data mining. However, effective analysis of multi-modal time series is hindered by data heterogeneity, modality gap, misalignment, and inherent noise. Recent advancements in multi-modal time series methods have exploited the multi-modal context via cross-modal interactions.
  arXiv  Detail & Related papers  (2025-03-17T20:30:02Z)
• Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models [104.17057231661371]
  Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs) Their success depends on large, diverse, and high-quality datasets, which are challenging to build due to regulatory, diversity, quality, and quantity constraints. This survey provides a comprehensive review of synthetic data for TSFMs and TSLLMs, analyzing data generation strategies, their role in model pretraining, fine-tuning, and evaluation, and identifying future research directions.
  arXiv  Detail & Related papers  (2025-03-14T13:53:46Z)
• Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement [55.2439260314328]
  Time Series Multi-Task Question Answering (Time-MQA) is a unified framework that enables natural language queries across multiple time series tasks. Central to Time-MQA is the TSQA dataset, a large-scale dataset containing $sim $200k question-answer pairs.
  arXiv  Detail & Related papers  (2025-02-26T13:47:13Z)
• Are Large Language Models Useful for Time Series Data Analysis? [3.44393516559102]
  Time series data plays a critical role across diverse domains such as healthcare, energy, and finance. This study investigates whether large language models (LLMs) are effective for time series data analysis.
  arXiv  Detail & Related papers  (2024-12-16T02:47:44Z)
• Deep Time Series Models: A Comprehensive Survey and Benchmark [74.28364194333447]
  Time series data is of great significance in real-world scenarios. Recent years have witnessed remarkable breakthroughs in the time series community. We release Time Series Library (TSLib) as a fair benchmark of deep time series models for diverse analysis tasks.
  arXiv  Detail & Related papers  (2024-07-18T08:31:55Z)
• TSI-Bench: Benchmarking Time Series Imputation [52.27004336123575]
  TSI-Bench is a comprehensive benchmark suite for time series imputation utilizing deep learning techniques. The TSI-Bench pipeline standardizes experimental settings to enable fair evaluation of imputation algorithms. TSI-Bench innovatively provides a systematic paradigm to tailor time series forecasting algorithms for imputation purposes.
  arXiv  Detail & Related papers  (2024-06-18T16:07:33Z)
• An Unsupervised Approach for Periodic Source Detection in Time Series [22.053675805215686]
  Detection of periodic patterns of interest within noisy time series data plays a critical role in various tasks. Existing learning techniques often rely on labels or clean versions of signals for detecting the periodicity. We propose a novel method to detect the periodicity in time series without the need for any labels.
  arXiv  Detail & Related papers  (2024-06-01T22:23:51Z)
• Advancing multivariate time series similarity assessment: an integrated computational approach [0.0]
  We propose an integrated computational approach for assessing the similarity of multivariate time series data. MTASA is built upon a hybrid methodology designed to optimize time series alignment, complemented by a multiprocessing engine. Results from this study highlight MTASA's superiority, achieving approximately 1.5 times greater accuracy and twice the speed compared to existing state-of-the-art integrated frameworks.
  arXiv  Detail & Related papers  (2024-03-16T23:52:25Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• Compatible Transformer for Irregularly Sampled Multivariate Time Series [75.79309862085303]
  We propose a transformer-based encoder to achieve comprehensive temporal-interaction feature learning for each individual sample. We conduct extensive experiments on 3 real-world datasets and validate that the proposed CoFormer significantly and consistently outperforms existing methods.
  arXiv  Detail & Related papers  (2023-10-17T06:29:09Z)
• Filling out the missing gaps: Time Series Imputation with Semi-Supervised Learning [7.8379910349669]
  We propose a semi-supervised imputation method, ST-Impute, that uses both unlabeled data along with downstream task's labeled data. ST-Impute is based on sparse self-attention and trains on tasks that mimic the imputation process.
  arXiv  Detail & Related papers  (2023-04-09T16:38:47Z)
• A Survey on Deep Learning based Time Series Analysis with Frequency Transformation [75.63783789488471]
  Frequency transformation (FT) has been increasingly incorporated into deep learning models to enhance state-of-the-art accuracy and efficiency in time series analysis. Despite the growing attention and the proliferation of research in this emerging field, there is currently a lack of a systematic review and in-depth analysis of deep learning-based time series models with FT. We present a comprehensive review that systematically investigates and summarizes the recent research advancements in deep learning-based time series analysis with FT.
  arXiv  Detail & Related papers  (2023-02-04T14:33:07Z)
• Novel Features for Time Series Analysis: A Complex Networks Approach [62.997667081978825]
  Time series data are ubiquitous in several domains as climate, economics and health care. Recent conceptual approach relies on time series mapping to complex networks. Network analysis can be used to characterize different types of time series.
  arXiv  Detail & Related papers  (2021-10-11T13:46:28Z)
• Time Series Analysis via Network Science: Concepts and Algorithms [62.997667081978825]
  This review provides a comprehensive overview of existing mapping methods for transforming time series into networks. We describe the main conceptual approaches, provide authoritative references and give insight into their advantages and limitations in a unified notation and language. Although still very recent, this research area has much potential and with this survey we intend to pave the way for future research on the topic.
  arXiv  Detail & Related papers  (2021-10-11T13:33:18Z)
• Deep Learning Schema-based Event Extraction: Literature Review and Current Trends [60.29289298349322]
  Event extraction technology based on deep learning has become a research hotspot. This paper fills the gap by reviewing the state-of-the-art approaches, focusing on deep learning-based models.
  arXiv  Detail & Related papers  (2021-07-05T16:32:45Z)
• Multi-Time Attention Networks for Irregularly Sampled Time Series [18.224344440110862]
  Irregular sampling occurs in many time series modeling applications. We propose a new deep learning framework for this setting that we call Multi-Time Attention Networks. Our results show that our approach performs as well or better than a range of baseline and recently proposed models.
  arXiv  Detail & Related papers  (2021-01-25T18:57:42Z)
• Time Series Data Imputation: A Survey on Deep Learning Approaches [4.4458738910060775]
  Time series data imputation is a well-studied problem with different categories of methods. Time series methods based on deep learning have made progress with the usage of models like RNN. We will review and discuss their model architectures, their pros and cons as well as their effects to show the development of the time series imputation methods.
  arXiv  Detail & Related papers  (2020-11-23T11:57:27Z)
• A Review of Deep Learning Methods for Irregularly Sampled Medical Time Series Data [7.735948372571363]
  Irregularly sampled time series (ISTS) data has irregular temporal intervals between observations and different sampling rates between sequences. Deep learning methods on EHRs data is critical for personalized treatment, precise diagnosis and medical management. In this paper, we review these deep learning methods from the perspectives of technology and task.
  arXiv  Detail & Related papers  (2020-10-23T15:51:23Z)
• Time Series Data Augmentation for Deep Learning: A Survey [35.2161833151567]
  We systematically review different data augmentation methods for time series data. We empirically compare different data augmentation methods for different tasks including time series classification, anomaly detection, and forecasting.
  arXiv  Detail & Related papers  (2020-02-27T23:38:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.