A Comprehensive Survey on Generative Diffusion Models for Structured Data

• URL: http://arxiv.org/abs/2306.04139v2
• Date: Sat, 8 Jul 2023 18:08:01 GMT
• Title: A Comprehensive Survey on Generative Diffusion Models for Structured Data
• Authors: Heejoon Koo, To Eun Kim
• Abstract summary: generative diffusion models have achieved a rapid paradigm shift in deep generative models. Structured data has been received comparatively limited attention from the deep learning research community. This review serves as a catalyst for the research community, promoting developments in generative diffusion models for structured data.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In recent years, generative diffusion models have achieved a rapid paradigm shift in deep generative models by showing groundbreaking performance across various applications. Meanwhile, structured data, encompassing tabular and time series data, has been received comparatively limited attention from the deep learning research community, despite its omnipresence and extensive applications. Thus, there is still a lack of literature and its reviews on structured data modelling via diffusion models, compared to other data modalities such as visual and textual data. To address this gap, we present a comprehensive review of recently proposed diffusion models in the field of structured data. First, this survey provides a concise overview of the score-based diffusion model theory, subsequently proceeding to the technical descriptions of the majority of pioneering works that used structured data in both data-driven general tasks and domain-specific applications. Thereafter, we analyse and discuss the limitations and challenges shown in existing works and suggest potential research directions. We hope this review serves as a catalyst for the research community, promoting developments in generative diffusion models for structured data.

Related papers

• A Comprehensive Survey of Synthetic Tabular Data Generation [27.112327373017457]
  Tabular data is one of the most prevalent and critical data formats across diverse real-world applications. It is often constrained by challenges such as data scarcity, privacy concerns, and class imbalance. Synthetic data generation has emerged as a promising solution, leveraging generative models to learn the distribution of real datasets.
  arXiv  Detail & Related papers  (2025-04-23T08:33:34Z)
• Data augmentation using diffusion models to enhance inverse Ising inference [2.654300333196867]
  We show that diffusion models can enhance parameter inference by augmenting small datasets. This study serves as a proof-of-concept for using diffusion models for data augmentation in physics-related problems.
  arXiv  Detail & Related papers  (2025-03-13T08:29:17Z)
• Diffusion Models for Tabular Data: Challenges, Current Progress, and Future Directions [14.735104900041401]
  Diffusion models have emerged as superior alternatives to Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) Diffusion models have begun to showcase similar advantages over GANs and VAEs, achieving significant performance breakthroughs.
  arXiv  Detail & Related papers  (2025-02-24T13:01:33Z)
• Generative Models for Synthetic Urban Mobility Data: A Systematic Literature Review [44.99833362998488]
  This systematic review provides a structured comparative overview of the current state of this heterogeneous, active field of research. A special focus is put on the applicability of the reviewed models in practice.
  arXiv  Detail & Related papers  (2024-07-12T11:54:29Z)
• Diffusion Models in Low-Level Vision: A Survey [82.77962165415153]
  diffusion model-based solutions have emerged as widely acclaimed for their ability to produce samples of superior quality and diversity. We present three generic diffusion modeling frameworks and explore their correlations with other deep generative models. We summarize extended diffusion models applied in other tasks, including medical, remote sensing, and video scenarios.
  arXiv  Detail & Related papers  (2024-06-17T01:49:27Z)
• A Survey on Diffusion Models for Time Series and Spatio-Temporal Data [92.1255811066468]
  We review the use of diffusion models in time series and S-temporal data, categorizing them by model, task type, data modality, and practical application domain. We categorize diffusion models into unconditioned and conditioned types discuss time series and S-temporal data separately. Our survey covers their application extensively in various fields including healthcare, recommendation, climate, energy, audio, and transportation.
  arXiv  Detail & Related papers  (2024-04-29T17:19:40Z)
• An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization [59.63880337156392]
  Diffusion models have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. Despite the significant empirical success, theory of diffusion models is very limited. This paper provides a well-rounded theoretical exposure for stimulating forward-looking theories and methods of diffusion models.
  arXiv  Detail & Related papers  (2024-04-11T14:07:25Z)
• Towards Theoretical Understandings of Self-Consuming Generative Models [56.84592466204185]
  This paper tackles the emerging challenge of training generative models within a self-consuming loop. We construct a theoretical framework to rigorously evaluate how this training procedure impacts the data distributions learned by future models. We present results for kernel density estimation, delivering nuanced insights such as the impact of mixed data training on error propagation.
  arXiv  Detail & Related papers  (2024-02-19T02:08:09Z)
• The Rise of Diffusion Models in Time-Series Forecasting [5.808096811856718]
  The paper includes comprehensive background information on diffusion models, detailing their conditioning methods and reviewing their use in time-series forecasting. The analysis covers 11 specific time-series implementations, the intuition and theory behind them, the effectiveness on different datasets, and a comparison among each other.
  arXiv  Detail & Related papers  (2024-01-05T11:35:10Z)
• Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook [95.32949323258251]
  Temporal data, notably time series andtemporal-temporal data, are prevalent in real-world applications. Recent advances in large language and other foundational models have spurred increased use in time series andtemporal data mining.
  arXiv  Detail & Related papers  (2023-10-16T09:06:00Z)
• Diffusion Models for Time Series Applications: A Survey [23.003273147019446]
  Diffusion models are used in image, video, and text synthesis nowadays. We focus on diffusion-based methods for time series forecasting, imputation, and generation. We conclude the common limitation of diffusion-based methods and highlight potential future research directions.
  arXiv  Detail & Related papers  (2023-05-01T02:06:46Z)
• A Survey on Generative Diffusion Model [75.93774014861978]
  Diffusion models are an emerging class of deep generative models. They have certain limitations, including a time-consuming iterative generation process and confinement to high-dimensional Euclidean space. This survey presents a plethora of advanced techniques aimed at enhancing diffusion models.
  arXiv  Detail & Related papers  (2022-09-06T16:56:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.