Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering

• URL: http://arxiv.org/abs/2208.06811v2
• Date: Wed, 3 May 2023 01:08:53 GMT
• Title: Contrastive Learning for Joint Normal Estimation and Point Cloud Filtering
• Authors: Dasith de Silva Edirimuni, Xuequan Lu, Gang Li, and Antonio Robles-Kelly
• Abstract summary: We propose a novel deep learning method to jointly estimate normals and filter point clouds. We first introduce a 3D patch based contrastive learning framework, with noise corruption as an augmentation. Experimental results show that our method well supports the two tasks simultaneously and preserves sharp features and fine details.
• Score: 12.602645108896636
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Point cloud filtering and normal estimation are two fundamental research problems in the 3D field. Existing methods usually perform normal estimation and filtering separately and often show sensitivity to noise and/or inability to preserve sharp geometric features such as corners and edges. In this paper, we propose a novel deep learning method to jointly estimate normals and filter point clouds. We first introduce a 3D patch based contrastive learning framework, with noise corruption as an augmentation, to train a feature encoder capable of generating faithful representations of point cloud patches while remaining robust to noise. These representations are consumed by a simple regression network and supervised by a novel joint loss, simultaneously estimating point normals and displacements that are used to filter the patch centers. Experimental results show that our method well supports the two tasks simultaneously and preserves sharp features and fine details. It generally outperforms state-of-the-art techniques on both tasks. Our source code is available at https://github.com/ddsediri/CLJNEPCF.

Related papers

• Inferring Neural Signed Distance Functions by Overfitting on Single Noisy Point Clouds through Finetuning Data-Driven based Priors [53.6277160912059]
  We propose a method to promote pros of data-driven based and overfitting-based methods for better generalization, faster inference, and higher accuracy in learning neural SDFs. We introduce a novel statistical reasoning algorithm in local regions which is able to finetune data-driven based priors without signed distance supervision, clean point cloud, or point normals.
  arXiv  Detail & Related papers  (2024-10-25T16:48:44Z)
• StraightPCF: Straight Point Cloud Filtering [50.66412286723848]
  Point cloud filtering is a fundamental 3D vision task, which aims to remove noise while recovering the underlying clean surfaces. We introduce StraightPCF, a new deep learning based method for point cloud filtering. It works by moving noisy points along straight paths, thus reducing discretization errors while ensuring faster convergence to the clean surfaces.
  arXiv  Detail & Related papers  (2024-05-14T05:41:59Z)
• NeuralGF: Unsupervised Point Normal Estimation by Learning Neural Gradient Function [55.86697795177619]
  Normal estimation for 3D point clouds is a fundamental task in 3D geometry processing. We introduce a new paradigm for learning neural gradient functions, which encourages the neural network to fit the input point clouds. Our excellent results on widely used benchmarks demonstrate that our method can learn more accurate normals for both unoriented and oriented normal estimation tasks.
  arXiv  Detail & Related papers  (2023-11-01T09:25:29Z)
• Weighted Point Cloud Normal Estimation [16.26518988623745]
  We introduce a weighted normal estimation method for 3D point cloud data. We propose a novel weighted normal regression technique that predicts point-wise weights from local point patches. Our method can robustly handle noisy and complex point clouds, achieving state-of-the-art performance on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2023-05-06T10:46:56Z)
• IterativePFN: True Iterative Point Cloud Filtering [18.51768749680731]
  A fundamental 3D vision task is the removal of noise, known as point cloud filtering or denoising. We propose IterativePFN (iterative point cloud filtering network), which consists of multiple Iterations that model the true iterative filtering process internally. Our method is able to obtain better performance compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-04-04T04:47:44Z)
• PCDNF: Revisiting Learning-based Point Cloud Denoising via Joint Normal Filtering [10.411935152370136]
  We propose an end-to-end network, named PCDNF, to denoise point clouds via joint normal filtering. In particular, we introduce an auxiliary normal filtering task to help the overall network remove noise more effectively. In addition to the overall architecture, our network has two novel modules.
  arXiv  Detail & Related papers  (2022-09-02T03:10:21Z)
• Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation [79.60988242843437]
  We propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously. Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-04-18T07:18:25Z)
• IDEA-Net: Dynamic 3D Point Cloud Interpolation via Deep Embedding Alignment [58.8330387551499]
  We formulate the problem as estimation of point-wise trajectories (i.e., smooth curves) We propose IDEA-Net, an end-to-end deep learning framework, which disentangles the problem under the assistance of the explicitly learned temporal consistency. We demonstrate the effectiveness of our method on various point cloud sequences and observe large improvement over state-of-the-art methods both quantitatively and visually.
  arXiv  Detail & Related papers  (2022-03-22T10:14:08Z)
• Deep Point Cloud Normal Estimation via Triplet Learning [12.271669779096076]
  We propose a novel normal estimation method for point clouds. It consists of two phases: (a) feature encoding which learns representations of local patches, and (b) normal estimation that takes the learned representation as input and regresses the normal vector. Our method preserves sharp features and achieves better normal estimation results on CAD-like shapes.
  arXiv  Detail & Related papers  (2021-10-20T11:16:00Z)
• Deep Feature-preserving Normal Estimation for Point Cloud Filtering [14.411519695767634]
  We propose a novel feature-preserving normal estimation method for point cloud filtering. It is a learning method and thus achieves automatic prediction for normals. Various experiments demonstrate that our method outperforms state-of-the-art normal estimation methods and point cloud filtering techniques.
  arXiv  Detail & Related papers  (2020-04-24T07:05:48Z)
• Learning multiview 3D point cloud registration [74.39499501822682]
  We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Our approach outperforms the state-of-the-art by a significant margin, while being end-to-end trainable and computationally less costly.
  arXiv  Detail & Related papers  (2020-01-15T03:42:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.