Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook

• URL: http://arxiv.org/abs/2310.10196v2
• Date: Fri, 20 Oct 2023 12:17:37 GMT
• Title: Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook
• Authors: Ming Jin, Qingsong Wen, Yuxuan Liang, Chaoli Zhang, Siqiao Xue, Xue Wang, James Zhang, Yi Wang, Haifeng Chen, Xiaoli Li, Shirui Pan, Vincent S. Tseng, Yu Zheng, Lei Chen, Hui Xiong
• Abstract summary: Temporal data, notably time series andtemporal-temporal data, are prevalent in real-world applications. Recent advances in large language and other foundational models have spurred increased use in time series andtemporal data mining.
• Score: 95.32949323258251
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Temporal data, notably time series and spatio-temporal data, are prevalent in real-world applications. They capture dynamic system measurements and are produced in vast quantities by both physical and virtual sensors. Analyzing these data types is vital to harnessing the rich information they encompass and thus benefits a wide range of downstream tasks. Recent advances in large language and other foundational models have spurred increased use of these models in time series and spatio-temporal data mining. Such methodologies not only enable enhanced pattern recognition and reasoning across diverse domains but also lay the groundwork for artificial general intelligence capable of comprehending and processing common temporal data. In this survey, we offer a comprehensive and up-to-date review of large models tailored (or adapted) for time series and spatio-temporal data, spanning four key facets: data types, model categories, model scopes, and application areas/tasks. Our objective is to equip practitioners with the knowledge to develop applications and further research in this underexplored domain. We primarily categorize the existing literature into two major clusters: large models for time series analysis (LM4TS) and spatio-temporal data mining (LM4STD). On this basis, we further classify research based on model scopes (i.e., general vs. domain-specific) and application areas/tasks. We also provide a comprehensive collection of pertinent resources, including datasets, model assets, and useful tools, categorized by mainstream applications. This survey coalesces the latest strides in large model-centric research on time series and spatio-temporal data, underscoring the solid foundations, current advances, practical applications, abundant resources, and future research opportunities.

Related papers

• Deep Time Series Models: A Comprehensive Survey and Benchmark [74.28364194333447]
  Time series data is of great significance in real-world scenarios. Recent years have witnessed remarkable breakthroughs in the time series community. We release Time Series Library (TSLib) as a fair benchmark of deep time series models for diverse analysis tasks.
  arXiv  Detail & Related papers  (2024-07-18T08:31:55Z)
• A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model [33.17908422599714]
  Large language foundation models have unveiled their capabilities for cross-task transferability, zero-shot/few-shot learning, and decision-making explainability. There are two main research lines, namely pre-training foundation models from scratch for time series and adapting large language foundation models for time series. This survey offers a 3E analytical framework for comprehensive examination of related research.
  arXiv  Detail & Related papers  (2024-05-03T03:12:55Z)
• A Survey on Diffusion Models for Time Series and Spatio-Temporal Data [92.1255811066468]
  We review the use of diffusion models in time series and S-temporal data, categorizing them by model, task type, data modality, and practical application domain. We categorize diffusion models into unconditioned and conditioned types discuss time series and S-temporal data separately. Our survey covers their application extensively in various fields including healthcare, recommendation, climate, energy, audio, and transportation.
  arXiv  Detail & Related papers  (2024-04-29T17:19:40Z)
• Review of Data-centric Time Series Analysis from Sample, Feature, and Period [37.33135447969283]
  A good time-series dataset is advantageous for the model's accuracy, robustness, and convergence. The emergence of data-centric AI represents a shift in the landscape from model refinement to prioritizing data quality. We systematically review different data-centric methods in time series analysis, covering a wide range of research topics.
  arXiv  Detail & Related papers  (2024-04-24T00:34:44Z)
• Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain [54.67888148566323]
  We introduce three large-scale time series forecasting datasets from the cloud operations domain. We show it is a strong zero-shot baseline and benefits from further scaling, both in model and dataset size. Accompanying these datasets and results is a suite of comprehensive benchmark results comparing classical and deep learning baselines to our pre-trained method.
  arXiv  Detail & Related papers  (2023-10-08T08:09:51Z)
• A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection [98.41798478488101]
  Time series analytics is crucial to unlocking the wealth of information implicit in available data. Recent advancements in graph neural networks (GNNs) have led to a surge in GNN-based approaches for time series analysis. This survey brings together a vast array of knowledge on GNN-based time series research, highlighting foundations, practical applications, and opportunities of graph neural networks for time series analysis.
  arXiv  Detail & Related papers  (2023-07-07T08:05:03Z)
• Graph Neural Network for spatiotemporal data: methods and applications [7.612070518526342]
  Graph neural networks (GNNs) have emerged as a powerful tool for understanding data with dependencies to each other. This article aims to provide an overview of the technologies and applications of GNNs in thetemporal domain.
  arXiv  Detail & Related papers  (2023-05-30T02:27:17Z)
• Statistical Deep Learning for Spatial and Spatio-Temporal Data [0.0]
  We present an overview of traditional statistical and machine learning perspectives for modeling spatial andtemporal data. We then focus on a variety of hybrid models that have recently been developed for latent process, data, and parameter specifications. These hybrid models integrate modeling ideas with deep neural network models in order to take advantage of the strengths of each modeling paradigm.
  arXiv  Detail & Related papers  (2022-06-05T16:49:10Z)
• A Comprehensive Study on Temporal Modeling for Online Action Detection [50.558313106389335]
  Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years. This paper aims to provide a comprehensive study on temporal modeling for OAD including four meta types of temporal modeling methods. We present several hybrid temporal modeling methods, which outperform the recent state-of-the-art methods with sizable margins on THUMOS-14 and TVSeries.
  arXiv  Detail & Related papers  (2020-01-21T13:12:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.