Deep Point Set Resampling via Gradient Fields
- URL: http://arxiv.org/abs/2111.02045v1
- Date: Wed, 3 Nov 2021 07:20:35 GMT
- Title: Deep Point Set Resampling via Gradient Fields
- Authors: Haolan Chen, Bi'an Du, Shitong Luo and Wei Hu
- Abstract summary: 3D point clouds acquired by scanning real-world objects or scenes have found a wide range of applications.
They are often perturbed by noise or suffer from low density, which obstructs downstream tasks such as surface reconstruction and understanding.
We propose a novel paradigm of point set resampling for restoration, which learns continuous gradient fields of point clouds.
- Score: 11.5128379063303
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: 3D point clouds acquired by scanning real-world objects or scenes have found
a wide range of applications including immersive telepresence, autonomous
driving, surveillance, etc. They are often perturbed by noise or suffer from
low density, which obstructs downstream tasks such as surface reconstruction
and understanding. In this paper, we propose a novel paradigm of point set
resampling for restoration, which learns continuous gradient fields of point
clouds that converge points towards the underlying surface. In particular, we
represent a point cloud via its gradient field -- the gradient of the
log-probability density function, and enforce the gradient field to be
continuous, thus guaranteeing the continuity of the model for solvable
optimization. Based on the continuous gradient fields estimated via a proposed
neural network, resampling a point cloud amounts to performing gradient-based
Markov Chain Monte Carlo (MCMC) on the input noisy or sparse point cloud.
Further, we propose to introduce regularization into the gradient-based MCMC
during point cloud restoration, which essentially refines the intermediate
resampled point cloud iteratively and accommodates various priors in the
resampling process. Extensive experimental results demonstrate that the
proposed point set resampling achieves the state-of-the-art performance in
representative restoration tasks including point cloud denoising and
upsampling.
Related papers
- Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping [54.38209327518066]
Learning signed distance functions from point clouds is an important task in 3D computer vision.
We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision.
Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations.
arXiv Detail & Related papers (2024-07-04T03:35:02Z) - A Conditional Denoising Diffusion Probabilistic Model for Point Cloud
Upsampling [10.390581335119098]
We propose a conditional denoising diffusion probability model (DDPM) for point cloud upsampling, called PUDM.
PUDM treats the sparse point cloud as a condition, and iteratively learns the transformation relationship between the dense point cloud and the noise.
PUDM exhibits strong noise robustness in experimental results.
arXiv Detail & Related papers (2023-12-03T12:41:41Z) - Point Cloud Pre-training with Diffusion Models [62.12279263217138]
We propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif)
PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection.
arXiv Detail & Related papers (2023-11-25T08:10:05Z) - Dynamic Point Cloud Denoising via Gradient Fields [17.29921488701806]
3D dynamic point clouds provide a discrete representation of real-world objects or scenes in motion.
Point clouds acquired from sensors are usually perturbed by noise, which affects downstream tasks such as surface reconstruction and analysis.
We propose a novel gradient-field-based dynamic point cloud denoising method, exploiting the temporal correspondence via the estimation of gradient fields.
arXiv Detail & Related papers (2022-04-19T08:51:53Z) - PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point
Cloud Upsampling [56.463507980857216]
We propose a generative adversarial network for point cloud upsampling.
It can make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions.
arXiv Detail & Related papers (2022-03-02T07:47:46Z) - Point Cloud Denoising via Momentum Ascent in Gradient Fields [72.93429911044903]
gradient-based method was proposed to estimate the gradient fields from the noisy point clouds using neural networks.
We develop a momentum gradient ascent method that leverages the information of previous iterations in determining the trajectories of the points.
Experiments demonstrate that the proposed method outperforms state-of-the-art approaches with a variety of point clouds, noise types, and noise levels.
arXiv Detail & Related papers (2022-02-21T10:21:40Z) - Exploring the Devil in Graph Spectral Domain for 3D Point Cloud Attacks [19.703181080679176]
3D dynamic point clouds provide a discrete representation of real-world objects or scenes in motion.
Point clouds acquired from sensors are usually perturbed by noise, which affects downstream tasks such as surface reconstruction and analysis.
We propose a novel gradient-based dynamic point cloud denoising method, exploiting the temporal correspondence for the estimation of gradient fields.
arXiv Detail & Related papers (2022-02-15T09:16:12Z) - PU-Flow: a Point Cloud Upsampling Networkwith Normalizing Flows [58.96306192736593]
We present PU-Flow, which incorporates normalizing flows and feature techniques to produce dense points uniformly distributed on the underlying surface.
Specifically, we formulate the upsampling process as point in a latent space, where the weights are adaptively learned from local geometric context.
We show that our method outperforms state-of-the-art deep learning-based approaches in terms of reconstruction quality, proximity-to-surface accuracy, and computation efficiency.
arXiv Detail & Related papers (2021-07-13T07:45:48Z) - Learning Gradient Fields for Shape Generation [69.85355757242075]
A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape.
We generate point clouds by performing gradient ascent on an unnormalized probability density.
Our model directly predicts the gradient of the log density field and can be trained with a simple objective adapted from score-based generative models.
arXiv Detail & Related papers (2020-08-14T18:06:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.