Surface Reconstruction from Point Clouds: A Survey and a Benchmark

• URL: http://arxiv.org/abs/2205.02413v1
• Date: Thu, 5 May 2022 03:02:57 GMT
• Title: Surface Reconstruction from Point Clouds: A Survey and a Benchmark
• Authors: Zhangjin Huang, Yuxin Wen, Zihao Wang, Jinjuan Ren, and Kui Jia
• Abstract summary: This paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. We contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data. We study how different methods generalize in terms of reconstructing complex surface shapes.
• Score: 34.78096555134551
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reconstruction of a continuous surface of two-dimensional manifold from its raw, discrete point cloud observation is a long-standing problem. The problem is technically ill-posed, and becomes more difficult considering that various sensing imperfections would appear in the point clouds obtained by practical depth scanning. In literature, a rich set of methods has been proposed, and reviews of existing methods are also provided. However, existing reviews are short of thorough investigations on a common benchmark. The present paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction. To this end, we contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data; the benchmark includes object- and scene-level surfaces and takes into account various sensing imperfections that are commonly encountered in practical depth scanning. We conduct thorough empirical studies by comparing existing methods on the constructed benchmark, and pay special attention on robustness of existing methods against various scanning imperfections; we also study how different methods generalize in terms of reconstructing complex surface shapes. Our studies help identify the best conditions under which different methods work, and suggest some empirical findings. For example, while deep learning methods are increasingly popular, our systematic studies suggest that, surprisingly, a few classical methods perform even better in terms of both robustness and generalization; our studies also suggest that the practical challenges of misalignment of point sets from multi-view scanning, missing of surface points, and point outliers remain unsolved by all the existing surface reconstruction methods. We expect that the benchmark and our studies would be valuable both for practitioners and as a guidance for new innovations in future research.

Related papers

• Deep Learning-Based Object Pose Estimation: A Comprehensive Survey [73.74933379151419]
  We discuss the recent advances in deep learning-based object pose estimation. Our survey also covers multiple input data modalities, degrees-of-freedom of output poses, object properties, and downstream tasks.
  arXiv  Detail & Related papers  (2024-05-13T14:44:22Z)
• Guided Depth Map Super-resolution: A Survey [88.54731860957804]
  Guided depth map super-resolution (GDSR) aims to reconstruct a high-resolution (HR) depth map from a low-resolution (LR) observation with the help of a paired HR color image. A myriad of novel and effective approaches have been proposed recently, especially with powerful deep learning techniques. This survey is an effort to present a comprehensive survey of recent progress in GDSR.
  arXiv  Detail & Related papers  (2023-02-19T15:43:54Z)
• A Survey and Benchmark of Automatic Surface Reconstruction from Point Clouds [12.58355339505807]
  We present both traditional and learning-based methods for surface reconstruction from point clouds. Traditional approaches often simplify the problem by imposing handcrafted priors on either the input point clouds or the resulting surface. Deep learning models have the capability directly learn the properties of input point clouds.
  arXiv  Detail & Related papers  (2023-01-31T14:18:19Z)
• Deflectometry for specular surfaces: an overview [0.0]
  Deflectometry as a technical approach to assessing reflective surfaces has now existed for almost 40 years. Different aspects and variations of the method have been studied in multiple theses and research articles, and reviews are also becoming available for certain subtopics.
  arXiv  Detail & Related papers  (2022-04-10T22:17:47Z)
• Recent Few-Shot Object Detection Algorithms: A Survey with Performance Comparison [54.357707168883024]
  Few-Shot Object Detection (FSOD) mimics the humans' ability of learning to learn. FSOD intelligently transfers the learned generic object knowledge from the common heavy-tailed, to the novel long-tailed object classes. We give an overview of FSOD, including the problem definition, common datasets, and evaluation protocols.
  arXiv  Detail & Related papers  (2022-03-27T04:11:28Z)
• An Investigation of Replay-based Approaches for Continual Learning [79.0660895390689]
  Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF) Several solution classes have been proposed, of which so-called replay-based approaches seem very promising due to their simplicity and robustness. We empirically investigate replay-based approaches of continual learning and assess their potential for applications.
  arXiv  Detail & Related papers  (2021-08-15T15:05:02Z)
• A Survey on Deep Semi-supervised Learning [51.26862262550445]
  We first present a taxonomy for deep semi-supervised learning that categorizes existing methods. We then offer a detailed comparison of these methods in terms of the type of losses, contributions, and architecture differences.
  arXiv  Detail & Related papers  (2021-02-28T16:22:58Z)
• A Unifying Review of Deep and Shallow Anomaly Detection [38.202998314502786]
  We aim to identify the common underlying principles as well as the assumptions that are often made implicitly by various methods. We provide an empirical assessment of major existing methods that is enriched by the use of recent explainability techniques. We outline critical open challenges and identify specific paths for future research in anomaly detection.
  arXiv  Detail & Related papers  (2020-09-24T14:47:54Z)
• Deep Learning Based Single Sample Per Person Face Recognition: A Survey [15.183859288214354]
  We focus on the deep learning-based methods in this paper, classifying them into virtual sample methods and generic learning methods. There are three types of generic learning methods: combining traditional methods and deep features, improving the loss function, and improving network structure.
  arXiv  Detail & Related papers  (2020-06-09T13:24:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.