Are All Point Clouds Suitable for Completion? Weakly Supervised Quality
Evaluation Network for Point Cloud Completion
- URL: http://arxiv.org/abs/2303.01804v1
- Date: Fri, 3 Mar 2023 09:24:29 GMT
- Title: Are All Point Clouds Suitable for Completion? Weakly Supervised Quality
Evaluation Network for Point Cloud Completion
- Authors: Jieqi Shi, Peiliang Li, Xiaozhi Chen and Shaojie Shen
- Abstract summary: We propose a quality evaluation network to score the point clouds and help judge the quality of the point cloud.
We verify our network using detection and flow estimation tasks on KITTI, a real-world dataset for autonomous driving.
- Score: 34.087139118297706
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In the practical application of point cloud completion tasks, real data
quality is usually much worse than the CAD datasets used for training. A small
amount of noisy data will usually significantly impact the overall system's
accuracy. In this paper, we propose a quality evaluation network to score the
point clouds and help judge the quality of the point cloud before applying the
completion model. We believe our scoring method can help researchers select
more appropriate point clouds for subsequent completion and reconstruction and
avoid manual parameter adjustment. Moreover, our evaluation model is fast and
straightforward and can be directly inserted into any model's training or use
process to facilitate the automatic selection and post-processing of point
clouds. We propose a complete dataset construction and model evaluation method
based on ShapeNet. We verify our network using detection and flow estimation
tasks on KITTI, a real-world dataset for autonomous driving. The experimental
results show that our model can effectively distinguish the quality of point
clouds and help in practical tasks.
Related papers
- Point Cloud Pre-training with Diffusion Models [62.12279263217138]
We propose a novel pre-training method called Point cloud Diffusion pre-training (PointDif)
PointDif achieves substantial improvement across various real-world datasets for diverse downstream tasks such as classification, segmentation and detection.
arXiv Detail & Related papers (2023-11-25T08:10:05Z) - AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud
Registration [69.21282992341007]
Auto Synth automatically generates 3D training data for point cloud registration.
We replace the point cloud registration network with a much smaller surrogate network, leading to a $4056.43$ speedup.
Our results on TUD-L, LINEMOD and Occluded-LINEMOD evidence that a neural network trained on our searched dataset yields consistently better performance than the same one trained on the widely used ModelNet40 dataset.
arXiv Detail & Related papers (2023-09-20T09:29:44Z) - Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models [64.49254199311137]
We propose a novel Instance-aware Dynamic Prompt Tuning (IDPT) strategy for pre-trained point cloud models.
The essence of IDPT is to develop a dynamic prompt generation module to perceive semantic prior features of each point cloud instance.
In experiments, IDPT outperforms full fine-tuning in most tasks with a mere 7% of the trainable parameters.
arXiv Detail & Related papers (2023-04-14T16:03:09Z) - AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware
Transformers [94.11915008006483]
We present a new method that reformulates point cloud completion as a set-to-set translation problem.
We design a new model, called PoinTr, which adopts a Transformer encoder-decoder architecture for point cloud completion.
Our method attains 6.53 CD on PCN, 0.81 CD on ShapeNet-55 and 0.392 MMD on real-world KITTI.
arXiv Detail & Related papers (2023-01-11T16:14:12Z) - Upsampling Autoencoder for Self-Supervised Point Cloud Learning [11.19408173558718]
We propose a self-supervised pretraining model for point cloud learning without human annotations.
Upsampling operation encourages the network to capture both high-level semantic information and low-level geometric information of the point cloud.
We find that our UAE outperforms previous state-of-the-art methods in shape classification, part segmentation and point cloud upsampling tasks.
arXiv Detail & Related papers (2022-03-21T07:20:37Z) - Graph-Guided Deformation for Point Cloud Completion [35.10606375236494]
We propose a Graph-Guided Deformation Network, which respectively regards the input data and intermediate generation as controlling and supporting points.
Our key insight is to simulate the least square Laplacian deformation process via mesh deformation methods, which brings adaptivity for modeling variation in geometry details.
We are the first to refine the point cloud completion task by mimicing traditional graphics algorithms with GCN-guided deformation.
arXiv Detail & Related papers (2021-11-11T12:55:26Z) - Planning with Learned Dynamic Model for Unsupervised Point Cloud
Registration [25.096635750142227]
We develop a latent dynamic model of point clouds, consisting of a transformation network and evaluation network.
We employ the cross-entropy method (CEM) to iteratively update the planning policy by maximizing the rewards in the point cloud registration process.
Experimental results on ModelNet40 and 7Scene benchmark datasets demonstrate that our method can yield good registration performance in an unsupervised manner.
arXiv Detail & Related papers (2021-08-05T13:47:11Z) - Cascaded Refinement Network for Point Cloud Completion with
Self-supervision [74.80746431691938]
We introduce a two-branch network for shape completion.
The first branch is a cascaded shape completion sub-network to synthesize complete objects.
The second branch is an auto-encoder to reconstruct the original partial input.
arXiv Detail & Related papers (2020-10-17T04:56:22Z) - SoftPoolNet: Shape Descriptor for Point Cloud Completion and
Classification [93.54286830844134]
We propose a method for 3D object completion and classification based on point clouds.
For the decoder stage, we propose regional convolutions, a novel operator aimed at maximizing the global activation entropy.
We evaluate our approach on different 3D tasks such as object completion and classification, achieving state-of-the-art accuracy.
arXiv Detail & Related papers (2020-08-17T14:32:35Z) - Self-supervised Learning of Point Clouds via Orientation Estimation [19.31778462735251]
We leverage 3D self-supervision for learning downstream tasks on point clouds with fewer labels.
A point cloud can be rotated in infinitely many ways, which provides a rich label-free source for self-supervision.
arXiv Detail & Related papers (2020-08-01T17:49:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.