Representation Learning of Point Cloud Upsampling in Global and Local Inputs

• URL: http://arxiv.org/abs/2501.07076v1
• Date: Mon, 13 Jan 2025 06:13:25 GMT
• Title: Representation Learning of Point Cloud Upsampling in Global and Local Inputs
• Authors: Tongxu Zhang, Bei Wang,
• Abstract summary: Our study investigates the factors influencing point cloud upsampling on both global and local levels through representation learning. The goal is to address issues of sparsity and noise in point clouds by leveraging prior knowledge from both global and local inputs. Experiments were conducted on a series of autoencoder-based models utilizing deep learning, yielding interpretability for both global and local inputs.
• Score: 1.4045865137356779
• License:
• Abstract: In recent years, point cloud upsampling has been widely applied in fields such as 3D reconstruction. Our study investigates the factors influencing point cloud upsampling on both global and local levels through representation learning. Specifically, the paper inputs global and local information of the same point cloud model object into two encoders to extract these features, fuses them, and then feeds the combined features into an upsampling decoder. The goal is to address issues of sparsity and noise in point clouds by leveraging prior knowledge from both global and local inputs. And the proposed framework can be applied to any state-of-the-art point cloud upsampling neural network. Experiments were conducted on a series of autoencoder-based models utilizing deep learning, yielding interpretability for both global and local inputs, and it has been proven in the results that our proposed framework can further improve the upsampling effect in previous SOTA works. At the same time, the Saliency Map reflects the differences between global and local feature inputs, as well as the effectiveness of training with both inputs in parallel.

Related papers

• Asynchronous Feedback Network for Perceptual Point Cloud Quality Assessment [18.65004981045047]
  We propose a novel asynchronous feedback quality prediction network (AFQ-Net) Motivated by human visual perception mechanisms, AFQ-Net employs a dual-branch structure to deal with global and local features. We conduct comprehensive experiments on three datasets and achieve superior performance over the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-07-13T08:52:44Z)
• InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalization [17.96808017359983]
  We propose InvariantOODG, which learns invariability between point clouds with different distributions. We define a set of learnable anchor points that locate the most useful local regions and two types of transformations to augment the input point clouds. The experimental results demonstrate the effectiveness of the proposed model on 3D domain generalization benchmarks.
  arXiv  Detail & Related papers  (2024-01-08T09:41:22Z)
• Learning Continuous Implicit Field with Local Distance Indicator for Arbitrary-Scale Point Cloud Upsampling [55.05706827963042]
  Point cloud upsampling aims to generate dense and uniformly distributed point sets from a sparse point cloud. Previous methods typically split a sparse point cloud into several local patches, upsample patch points, and merge all upsampled patches. We propose a novel approach that learns an unsigned distance field guided by local priors for point cloud upsampling.
  arXiv  Detail & Related papers  (2023-12-23T01:52:14Z)
• Bidirectional Knowledge Reconfiguration for Lightweight Point Cloud Analysis [74.00441177577295]
  Point cloud analysis faces computational system overhead, limiting its application on mobile or edge devices. This paper explores feature distillation for lightweight point cloud models. We propose bidirectional knowledge reconfiguration to distill informative contextual knowledge from the teacher to the student.
  arXiv  Detail & Related papers  (2023-10-08T11:32:50Z)
• Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation [79.60988242843437]
  We propose a novel approach that achieves self-supervised and magnification-flexible point clouds upsampling simultaneously. Experimental results demonstrate that our self-supervised learning based scheme achieves competitive or even better performance than supervised learning based state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-04-18T07:18:25Z)
• OMNet: Learning Overlapping Mask for Partial-to-Partial Point Cloud Registration [31.108056345511976]
  OMNet is a global feature based iterative network for partial-to-partial point cloud registration. We learn masks in a coarse-to-fine manner to reject non-overlapping regions, which converting the partial-to-partial registration to the registration of the same shapes.
  arXiv  Detail & Related papers  (2021-03-01T11:59:59Z)
• SPU-Net: Self-Supervised Point Cloud Upsampling by Coarse-to-Fine Reconstruction with Self-Projection Optimization [52.20602782690776]
  It is expensive and tedious to obtain large scale paired sparse-canned point sets for training from real scanned sparse data. We propose a self-supervised point cloud upsampling network, named SPU-Net, to capture the inherent upsampling patterns of points lying on the underlying object surface. We conduct various experiments on both synthetic and real-scanned datasets, and the results demonstrate that we achieve comparable performance to the state-of-the-art supervised methods.
  arXiv  Detail & Related papers  (2020-12-08T14:14:09Z)
• Self-Sampling for Neural Point Cloud Consolidation [83.31236364265403]
  We introduce a novel technique for neural point cloud consolidation which learns from only the input point cloud. We repeatedly self-sample the input point cloud with global subsets that are used to train a deep neural network. We demonstrate the ability to consolidate point sets from a variety of shapes, while eliminating outliers and noise.
  arXiv  Detail & Related papers  (2020-08-14T17:16:02Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• An Explicit Local and Global Representation Disentanglement Framework with Applications in Deep Clustering and Unsupervised Object Detection [9.609936822226633]
  We propose a framework, called SPLIT, which allows us to disentangle local and global information. Our framework adds generative assumption to the variational autoencoder (VAE) framework. We show that the framework can effectively disentangle local and global information within these models.
  arXiv  Detail & Related papers  (2020-01-24T12:09:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.