Diffusion Models for Robotic Manipulation: A Survey

• URL: http://arxiv.org/abs/2504.08438v1
• Date: Fri, 11 Apr 2025 11:01:11 GMT
• Title: Diffusion Models for Robotic Manipulation: A Survey
• Authors: Rosa Wolf, Yitian Shi, Sheng Liu, Rania Rayyes,
• Abstract summary: Diffusion generative models have demonstrated remarkable success in visual domains such as image and video generation.<n>They have also emerged as a promising approach in robotics, especially in robot manipulations.<n>This survey provides a comprehensive review of state-of-the-art diffusion models in robotic manipulation.
• Score: 8.215325350337126
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Diffusion generative models have demonstrated remarkable success in visual domains such as image and video generation. They have also recently emerged as a promising approach in robotics, especially in robot manipulations. Diffusion models leverage a probabilistic framework, and they stand out with their ability to model multi-modal distributions and their robustness to high-dimensional input and output spaces. This survey provides a comprehensive review of state-of-the-art diffusion models in robotic manipulation, including grasp learning, trajectory planning, and data augmentation. Diffusion models for scene and image augmentation lie at the intersection of robotics and computer vision for vision-based tasks to enhance generalizability and data scarcity. This paper also presents the two main frameworks of diffusion models and their integration with imitation learning and reinforcement learning. In addition, it discusses the common architectures and benchmarks and points out the challenges and advantages of current state-of-the-art diffusion-based methods.

Related papers

• Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations [52.11801730860999]
  In recent years, the robot learning community has shown increasing interest in using deep generative models to capture the complexity of large datasets. We present the different types of models that the community has explored, such as energy-based models, diffusion models, action value maps, or generative adversarial networks. We also present the different types of applications in which deep generative models have been used, from grasp generation to trajectory generation or cost learning.
  arXiv  Detail & Related papers  (2024-08-08T11:34:31Z)
• A Comprehensive Survey on Diffusion Models and Their Applications [0.4218593777811082]
  Diffusion Models are probabilistic models that create realistic samples by simulating the diffusion process. These models have gained popularity in domains such as image processing, speech synthesis, and natural language processing. This review aims to facilitate a deeper understanding and broader adoption of Diffusion Models.
  arXiv  Detail & Related papers  (2024-07-01T17:10:29Z)
• Diffusion Models and Representation Learning: A Survey [3.8861148837000856]
  This survey explores the interplay between diffusion models and representation learning. It provides an overview of diffusion models' essential aspects, including mathematical foundations. Various approaches related to diffusion models and representation learning are detailed.
  arXiv  Detail & Related papers  (2024-06-30T17:59:58Z)
• Diffusion Models in Low-Level Vision: A Survey [82.77962165415153]
  diffusion model-based solutions have emerged as widely acclaimed for their ability to produce samples of superior quality and diversity.<n>We present three generic diffusion modeling frameworks and explore their correlations with other deep generative models.<n>We summarize extended diffusion models applied in other tasks, including medical, remote sensing, and video scenarios.
  arXiv  Detail & Related papers  (2024-06-17T01:49:27Z)
• An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization [59.63880337156392]
  Diffusion models have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. Despite the significant empirical success, theory of diffusion models is very limited. This paper provides a well-rounded theoretical exposure for stimulating forward-looking theories and methods of diffusion models.
  arXiv  Detail & Related papers  (2024-04-11T14:07:25Z)
• Deep Learning for Robust and Explainable Models in Computer Vision [0.0]
  This thesis presents various approaches that address robustness and explainability challenges for using ML and DL in practice. This thesis presents developments in computer vision models' robustness and explainability. In addition to the theoretical developments, this thesis demonstrates several applications of ML and DL in different contexts.
  arXiv  Detail & Related papers  (2024-03-27T15:17:10Z)
• Generative AI in Vision: A Survey on Models, Metrics and Applications [0.0]
  Generative AI models have revolutionized various fields by enabling the creation of realistic and diverse data samples. Among these models, diffusion models have emerged as a powerful approach for generating high-quality images, text, and audio. This survey paper provides a comprehensive overview of generative AI diffusion and legacy models, focusing on their underlying techniques, applications across different domains, and their challenges.
  arXiv  Detail & Related papers  (2024-02-26T07:47:12Z)
• SODA: Bottleneck Diffusion Models for Representation Learning [75.7331354734152]
  We introduce SODA, a self-supervised diffusion model, designed for representation learning. The model incorporates an image encoder, which distills a source view into a compact representation, that guides the generation of related novel views. We show that by imposing a tight bottleneck between the encoder and a denoising decoder, we can turn diffusion models into strong representation learners.
  arXiv  Detail & Related papers  (2023-11-29T18:53:34Z)
• Diffusion Models in Vision: A Survey [73.10116197883303]
  A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens.
  arXiv  Detail & Related papers  (2022-09-10T22:00:30Z)
• A Survey on Generative Diffusion Model [75.93774014861978]
  Diffusion models are an emerging class of deep generative models. They have certain limitations, including a time-consuming iterative generation process and confinement to high-dimensional Euclidean space. This survey presents a plethora of advanced techniques aimed at enhancing diffusion models.
  arXiv  Detail & Related papers  (2022-09-06T16:56:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.