Point Cloud Resampling with Learnable Heat Diffusion

• URL: http://arxiv.org/abs/2411.14120v1
• Date: Thu, 21 Nov 2024 13:44:18 GMT
• Title: Point Cloud Resampling with Learnable Heat Diffusion
• Authors: Wenqiang Xu, Wenrui Dai, Duoduo Xue, Ziyang Zheng, Chenglin Li, Junni Zou, Hongkai Xiong,
• Abstract summary: We propose a learnable heat diffusion framework for point cloud resampling. Unlike previous diffusion models with a fixed prior, the adaptive conditional prior selectively preserves geometric features of the point cloud.
• Score: 58.050130177241186
• License:
• Abstract: Generative diffusion models have shown empirical successes in point cloud resampling, generating a denser and more uniform distribution of points from sparse or noisy 3D point clouds by progressively refining noise into structure. However, existing diffusion models employ manually predefined schemes, which often fail to recover the underlying point cloud structure due to the rigid and disruptive nature of the geometric degradation. To address this issue, we propose a novel learnable heat diffusion framework for point cloud resampling, which directly parameterizes the marginal distribution for the forward process by learning the adaptive heat diffusion schedules and local filtering scales of the time-varying heat kernel, and consequently, generates an adaptive conditional prior for the reverse process. Unlike previous diffusion models with a fixed prior, the adaptive conditional prior selectively preserves geometric features of the point cloud by minimizing a refined variational lower bound, guiding the points to evolve towards the underlying surface during the reverse process. Extensive experimental results demonstrate that the proposed point cloud resampling achieves state-of-the-art performance in representative reconstruction tasks including point cloud denoising and upsampling.

Related papers

• Enhancing Diffusion-based Point Cloud Generation with Smoothness Constraint [5.140589325829964]
  Diffusion models have been popular for point cloud generation tasks. We propose incorporating the local smoothness constraint into the diffusion framework for point cloud generation. Experiments demonstrate the proposed model can generate realistic shapes and smoother point clouds, outperforming multiple state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-04-03T01:55:15Z)
• PCRDiffusion: Diffusion Probabilistic Models for Point Cloud Registration [28.633279452622475]
  We propose a new framework that formulates point cloud registration as a denoising diffusion process from noisy transformation to object transformation. During training stage, object transformation diffuses from ground-truth transformation to random distribution, and the model learns to reverse this noising process. In sampling stage, the model refines randomly generated transformation to the output result in a progressive way.
  arXiv  Detail & Related papers  (2023-12-11T01:56:42Z)
• DiffusionPCR: Diffusion Models for Robust Multi-Step Point Cloud Registration [73.37538551605712]
  Point Cloud Registration (PCR) estimates the relative rigid transformation between two point clouds. We propose formulating PCR as a denoising diffusion probabilistic process, mapping noisy transformations to the ground truth. Our experiments showcase the effectiveness of our DiffusionPCR, yielding state-of-the-art registration recall rates (95.3%/81.6%) on 3D and 3DLoMatch.
  arXiv  Detail & Related papers  (2023-12-05T18:59:41Z)
• A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling [10.390581335119098]
  We propose a conditional denoising diffusion probability model (DDPM) for point cloud upsampling, called PUDM. PUDM treats the sparse point cloud as a condition, and iteratively learns the transformation relationship between the dense point cloud and the noise. PUDM exhibits strong noise robustness in experimental results.
  arXiv  Detail & Related papers  (2023-12-03T12:41:41Z)
• A Variational Perspective on Solving Inverse Problems with Diffusion Models [101.831766524264]
  Inverse tasks can be formulated as inferring a posterior distribution over data. This is however challenging in diffusion models since the nonlinear and iterative nature of the diffusion process renders the posterior intractable. We propose a variational approach that by design seeks to approximate the true posterior distribution.
  arXiv  Detail & Related papers  (2023-05-07T23:00:47Z)
• Controllable Mesh Generation Through Sparse Latent Point Diffusion Models [105.83595545314334]
  We design a novel sparse latent point diffusion model for mesh generation. Our key insight is to regard point clouds as an intermediate representation of meshes, and model the distribution of point clouds instead. Our proposed sparse latent point diffusion model achieves superior performance in terms of generation quality and controllability.
  arXiv  Detail & Related papers  (2023-03-14T14:25:29Z)
• GECCO: Geometrically-Conditioned Point Diffusion Models [60.28388617034254]
  Diffusion models generating images conditionally on text have recently made a splash far beyond the computer vision community. Here, we tackle the related problem of generating point clouds, both unconditionally, and conditionally with images. For the latter, we introduce a novel geometrically-motivated conditioning scheme based on projecting sparse image features into the point cloud.
  arXiv  Detail & Related papers  (2023-03-10T13:45:44Z)
• ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories [144.03939123870416]
  We propose a novel conditional diffusion model by introducing conditions into the forward process. We use extra latent space to allocate an exclusive diffusion trajectory for each condition based on some shifting rules. We formulate our method, which we call textbfShiftDDPMs, and provide a unified point of view on existing related methods.
  arXiv  Detail & Related papers  (2023-02-05T12:48:21Z)
• Deep Point Set Resampling via Gradient Fields [11.5128379063303]
  3D point clouds acquired by scanning real-world objects or scenes have found a wide range of applications. They are often perturbed by noise or suffer from low density, which obstructs downstream tasks such as surface reconstruction and understanding. We propose a novel paradigm of point set resampling for restoration, which learns continuous gradient fields of point clouds.
  arXiv  Detail & Related papers  (2021-11-03T07:20:35Z)
• Diffusion Probabilistic Models for 3D Point Cloud Generation [12.257593992442732]
  We present a probabilistic model for point cloud generation that is critical for various 3D vision tasks. Inspired by the diffusion process in non-equilibrium thermodynamics, we view points in point clouds as particles in a thermodynamic system in contact with a heat bath. We derive the variational bound in closed form for training and provide implementations of the model.
  arXiv  Detail & Related papers  (2021-03-02T03:56:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.