Large Language Models for Time Series: A Survey

• URL: http://arxiv.org/abs/2402.01801v3
• Date: Mon, 6 May 2024 20:48:41 GMT
• Title: Large Language Models for Time Series: A Survey
• Authors: Xiyuan Zhang, Ranak Roy Chowdhury, Rajesh K. Gupta, Jingbo Shang,
• Abstract summary: Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. LLMs present a significant potential for analysis of time series data, benefiting domains such as climate, IoT, healthcare, traffic, audio and finance.
• Score: 34.24258745427964
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data, benefiting domains such as climate, IoT, healthcare, traffic, audio and finance. This survey paper provides an in-depth exploration and a detailed taxonomy of the various methodologies employed to harness the power of LLMs for time series analysis. We address the inherent challenge of bridging the gap between LLMs' original text data training and the numerical nature of time series data, and explore strategies for transferring and distilling knowledge from LLMs to numerical time series analysis. We detail various methodologies, including (1) direct prompting of LLMs, (2) time series quantization, (3) aligning techniques, (4) utilization of the vision modality as a bridging mechanism, and (5) the combination of LLMs with tools. Additionally, this survey offers a comprehensive overview of the existing multimodal time series and text datasets and delves into the challenges and future opportunities of this emerging field. We maintain an up-to-date Github repository which includes all the papers and datasets discussed in the survey.

Related papers

• TableTime: Reformulating Time Series Classification as Zero-Shot Table Understanding via Large Language Models [54.44272772296578]
  Large language models (LLMs) have demonstrated their effectiveness in multivariate time series classification. LLMs directly encode embeddings for time series within the latent space of LLMs from scratch to align with semantic space of LLMs. We propose TableTime, which reformulates MTSC as a table understanding task.
  arXiv  Detail & Related papers  (2024-11-24T07:02:32Z)
• LLMs Meet Multimodal Generation and Editing: A Survey [89.76691959033323]
  This survey elaborates on multimodal generation and editing across various domains, comprising image, video, 3D, and audio. We summarize the notable advancements with milestone works in these fields and categorize these studies into LLM-based and CLIP/T5-based methods. We dig into tool-augmented multimodal agents that can leverage existing generative models for human-computer interaction.
  arXiv  Detail & Related papers  (2024-05-29T17:59:20Z)
• Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark [13.490168087823992]
  Large Language Models (LLMs) offer the potential for automatic time series analysis and reporting. We introduce a comprehensive taxonomy of time series features, a critical framework that delineates various characteristics inherent in time series data. This dataset acts as a solid foundation for assessing the proficiency of LLMs in comprehending time series.
  arXiv  Detail & Related papers  (2024-04-25T12:24:37Z)
• LLM Inference Unveiled: Survey and Roofline Model Insights [62.92811060490876]
  Large Language Model (LLM) inference is rapidly evolving, presenting a unique blend of opportunities and challenges. Our survey stands out from traditional literature reviews by not only summarizing the current state of research but also by introducing a framework based on roofline model. This framework identifies the bottlenecks when deploying LLMs on hardware devices and provides a clear understanding of practical problems.
  arXiv  Detail & Related papers  (2024-02-26T07:33:05Z)
• Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities [46.02234423159257]
  Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. Recent works treat large language models as emphzero-shot time series reasoners without further fine-tuning. Our study shows that LLMs perform well in predicting time series with clear patterns and trends, but face challenges with datasets lacking periodicity.
  arXiv  Detail & Related papers  (2024-02-16T17:15:28Z)
• Empowering Time Series Analysis with Large Language Models: A Survey [24.202539098675953]
  We provide a systematic overview of methods that leverage large language models for time series analysis. Specifically, we first state the challenges and motivations of applying language models in the context of time series. Next, we categorize existing methods into different groups (i.e., direct query, tokenization, prompt design, fine-tune, and model integration) and highlight the key ideas within each group.
  arXiv  Detail & Related papers  (2024-02-05T16:46:35Z)
• Position: What Can Large Language Models Tell Us about Time Series Analysis [69.70906014827547]
  We argue that current large language models (LLMs) have the potential to revolutionize time series analysis. Such advancement could unlock a wide range of possibilities, including time series modality switching and question answering.
  arXiv  Detail & Related papers  (2024-02-05T04:17:49Z)
• How to Bridge the Gap between Modalities: A Comprehensive Survey on Multimodal Large Language Model [12.890344377484759]
  This review paper explores Multimodal Large Language Models (MLLMs) MLLMs integrate Large Language Models (LLMs) like GPT-4 to handle multimodal data such as text and vision. Choosing the appropriate modality alignment method is crucial, as improper methods might require more parameters with limited performance improvement.
  arXiv  Detail & Related papers  (2023-11-10T09:51:24Z)
• Time-LLM: Time Series Forecasting by Reprogramming Large Language Models [110.20279343734548]
  Time series forecasting holds significant importance in many real-world dynamic systems. We present Time-LLM, a reprogramming framework to repurpose large language models for time series forecasting. Time-LLM is a powerful time series learner that outperforms state-of-the-art, specialized forecasting models.
  arXiv  Detail & Related papers  (2023-10-03T01:31:25Z)
• LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters [12.887118862534331]
  We propose a framework for time-series forecasting with pre-trained Large Language Models (LLMs) LLM4TS consists of a two-stage fine-tuning strategy to align LLMs with the nuances of time-series data, and the textitforecasting fine-tuning stage for downstream time-series forecasting tasks. Our framework features a novel two-level aggregation method that integrates multi-scale temporal data within pre-trained LLMs, enhancing their ability to interpret time-specific information.
  arXiv  Detail & Related papers  (2023-08-16T16:19:50Z)
• A Comprehensive Overview of Large Language Models [68.22178313875618]
  Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks. This article provides an overview of the existing literature on a broad range of LLM-related concepts.
  arXiv  Detail & Related papers  (2023-07-12T20:01:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.