Diffusion Models in NLP: A Survey

• URL: http://arxiv.org/abs/2303.07576v1
• Date: Tue, 14 Mar 2023 01:53:49 GMT
• Title: Diffusion Models in NLP: A Survey
• Authors: Yuansong Zhu, Yu Zhao
• Abstract summary: Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the research results of diffusion models in the field of natural language processing.
• Score: 1.5138755188783584
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the research results of diffusion models in the field of natural language processing, from text generation, text-driven image generation and other four aspects, and analyzes and summarizes the relevant literature materials sorted out, and finally records the experience and feelings of this topic literature review research.

Related papers

• Alignment of Diffusion Models: Fundamentals, Challenges, and Future [28.64041196069495]
  Diffusion models have emerged as the leading paradigm in generative modeling, excelling in various applications. Despite their success, these models often misalign with human intentions, generating outputs that may not match text prompts or possess desired properties. Inspired by the success of alignment in tuning large language models, recent studies have investigated aligning diffusion models with human expectations and preferences.
  arXiv  Detail & Related papers  (2024-09-11T13:21:32Z)
• A Comprehensive Survey on Diffusion Models and Their Applications [0.4218593777811082]
  Diffusion Models are probabilistic models that create realistic samples by simulating the diffusion process. These models have gained popularity in domains such as image processing, speech synthesis, and natural language processing. This review aims to facilitate a deeper understanding and broader adoption of Diffusion Models.
  arXiv  Detail & Related papers  (2024-07-01T17:10:29Z)
• Diffusion Models in Low-Level Vision: A Survey [82.77962165415153]
  diffusion model-based solutions have emerged as widely acclaimed for their ability to produce samples of superior quality and diversity. We present three generic diffusion modeling frameworks and explore their correlations with other deep generative models. We summarize extended diffusion models applied in other tasks, including medical, remote sensing, and video scenarios.
  arXiv  Detail & Related papers  (2024-06-17T01:49:27Z)
• An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization [59.63880337156392]
  Diffusion models have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. Despite the significant empirical success, theory of diffusion models is very limited. This paper provides a well-rounded theoretical exposure for stimulating forward-looking theories and methods of diffusion models.
  arXiv  Detail & Related papers  (2024-04-11T14:07:25Z)
• A Survey on Video Diffusion Models [103.03565844371711]
  The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision. Due to their impressive generative capabilities, diffusion models are gradually superseding methods based on GANs and auto-regressive Transformers. This paper presents a comprehensive review of video diffusion models in the AIGC era.
  arXiv  Detail & Related papers  (2023-10-16T17:59:28Z)
• A Survey of Diffusion Models in Natural Language Processing [11.233768932957771]
  Diffusion models capture the diffusion of information or signals across a network or manifold. This paper discusses the different formulations of diffusion models used in NLP, their strengths and limitations, and their applications.
  arXiv  Detail & Related papers  (2023-05-24T03:25:32Z)
• Diffusion Models for Time Series Applications: A Survey [23.003273147019446]
  Diffusion models are used in image, video, and text synthesis nowadays. We focus on diffusion-based methods for time series forecasting, imputation, and generation. We conclude the common limitation of diffusion-based methods and highlight potential future research directions.
  arXiv  Detail & Related papers  (2023-05-01T02:06:46Z)
• Diffusion Models for Non-autoregressive Text Generation: A Survey [94.4634088113513]
  Non-autoregressive (NAR) text generation has attracted much attention in the field of natural language processing. Recently, diffusion models have been introduced into NAR text generation, showing an improved text generation quality.
  arXiv  Detail & Related papers  (2023-03-12T05:11:09Z)
• Diffusion Models in Vision: A Survey [80.82832715884597]
  A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens.
  arXiv  Detail & Related papers  (2022-09-10T22:00:30Z)
• A Survey on Generative Diffusion Model [75.93774014861978]
  Diffusion models are an emerging class of deep generative models. They have certain limitations, including a time-consuming iterative generation process and confinement to high-dimensional Euclidean space. This survey presents a plethora of advanced techniques aimed at enhancing diffusion models.
  arXiv  Detail & Related papers  (2022-09-06T16:56:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.