Differentiable Manifold Reconstruction for Point Cloud Denoising

• URL: http://arxiv.org/abs/2007.13551v2
• Date: Sun, 9 Aug 2020 09:23:44 GMT
• Title: Differentiable Manifold Reconstruction for Point Cloud Denoising
• Authors: Shitong Luo, Wei Hu
• Abstract summary: 3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments. We propose to learn the underlying manifold of a noisy point cloud from differentiably subsampled points. We show that our method significantly outperforms state-of-the-art denoising methods under both synthetic noise and real world noise.
• Score: 23.33652755967715
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments, which obstructs downstream tasks such as surface reconstruction, rendering and so on. Previous works mostly infer the displacement of noisy points from the underlying surface, which however are not designated to recover the surface explicitly and may lead to sub-optimal denoising results. To this end, we propose to learn the underlying manifold of a noisy point cloud from differentiably subsampled points with trivial noise perturbation and their embedded neighborhood feature, aiming to capture intrinsic structures in point clouds. Specifically, we present an autoencoder-like neural network. The encoder learns both local and non-local feature representations of each point, and then samples points with low noise via an adaptive differentiable pooling operation. Afterwards, the decoder infers the underlying manifold by transforming each sampled point along with the embedded feature of its neighborhood to a local surface centered around the point. By resampling on the reconstructed manifold, we obtain a denoised point cloud. Further, we design an unsupervised training loss, so that our network can be trained in either an unsupervised or supervised fashion. Experiments show that our method significantly outperforms state-of-the-art denoising methods under both synthetic noise and real world noise. The code and data are available at https://github.com/luost26/DMRDenoise

Related papers

• Fast Learning of Signed Distance Functions from Noisy Point Clouds via Noise to Noise Mapping [54.38209327518066]
  Learning signed distance functions from point clouds is an important task in 3D computer vision. We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision. Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy observations.
  arXiv  Detail & Related papers  (2024-07-04T03:35:02Z)
• Mesh Denoising Transformer [104.5404564075393]
  Mesh denoising is aimed at removing noise from input meshes while preserving their feature structures. SurfaceFormer is a pioneering Transformer-based mesh denoising framework. New representation known as Local Surface Descriptor captures local geometric intricacies. Denoising Transformer module receives the multimodal information and achieves efficient global feature aggregation.
  arXiv  Detail & Related papers  (2024-05-10T15:27:43Z)
• Few-shot point cloud reconstruction and denoising via learned Guassian splats renderings and fine-tuned diffusion features [52.62053703535824]
  We propose a method to reconstruct point clouds from few images and to denoise point clouds from their rendering. To improve reconstruction in constraint settings, we regularize the training of a differentiable with hybrid surface and appearance. We demonstrate how these learned filters can be used to remove point cloud noise coming without 3D supervision.
  arXiv  Detail & Related papers  (2024-04-01T13:38:16Z)
• Learning Signed Distance Functions from Noisy 3D Point Clouds via Noise to Noise Mapping [52.25114448281418]
  Learning signed distance functions (SDFs) from 3D point clouds is an important task in 3D computer vision. We propose to learn SDFs via a noise to noise mapping, which does not require any clean point cloud or ground truth supervision for training. Our novelty lies in the noise to noise mapping which can infer a highly accurate SDF of a single object or scene from its multiple or even single noisy point cloud observations.
  arXiv  Detail & Related papers  (2023-06-02T09:52:04Z)
• NoiseTrans: Point Cloud Denoising with Transformers [4.143032261649984]
  We design a novel model, NoiseTrans, which uses transformer encoder architecture for point cloud denoising. We obtain structural similarity of point-based point clouds with the assistance of the transformer's core self-attention mechanism. Experiments show that our model outperforms state-of-the-art methods in various datasets and noise environments.
  arXiv  Detail & Related papers  (2023-04-24T04:01:23Z)
• Semi-signed neural fitting for surface reconstruction from unoriented point clouds [53.379712818791894]
  We propose SSN-Fitting to reconstruct a better signed distance field. SSN-Fitting consists of a semi-signed supervision and a loss-based region sampling strategy. We conduct experiments to demonstrate that SSN-Fitting achieves state-of-the-art performance under different settings.
  arXiv  Detail & Related papers  (2022-06-14T09:40:17Z)
• PD-Flow: A Point Cloud Denoising Framework with Normalizing Flows [20.382995180671205]
  Point cloud denoising aims to restore clean point clouds from raw observations corrupted by noise and outliers. We present a novel deep learning-based denoising model, that incorporates normalizing flows and noise disentanglement techniques.
  arXiv  Detail & Related papers  (2022-03-11T14:17:58Z)
• Score-Based Point Cloud Denoising [26.090445369658312]
  Point clouds acquired from scanning devices are often perturbed by noise, which affects downstream tasks such as surface reconstruction and analysis. We propose to increase the log-likelihood of each point from $p * n$ via gradient ascent -- iteratively updating each point's position. We derive objective functions for training the network and develop a denoising algorithm leveraging on the estimated scores.
  arXiv  Detail & Related papers  (2021-07-23T01:13:03Z)
• Learning Graph-Convolutional Representations for Point Cloud Denoising [31.557988478764997]
  We propose a deep neural network that can deal with the permutation-invariance problem encountered by learning-based point cloud processing methods. The network is fully-convolutional and can build complex hierarchies of features by dynamically constructing neighborhood graphs. It is especially robust both at high noise levels and in presence of structured noise such as the one encountered in real LiDAR scans.
  arXiv  Detail & Related papers  (2020-07-06T08:11:28Z)
• Non-Local Part-Aware Point Cloud Denoising [55.50360085086123]
  This paper presents a novel non-local part-aware deep neural network to denoise point clouds. We design the non-local learning unit (NLU) customized with a graph attention module to adaptively capture non-local semantically-related features. To enhance the denoising performance, we cascade a series of NLUs to progressively distill the noise features from the noisy inputs.
  arXiv  Detail & Related papers  (2020-03-14T13:51:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.