SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network
- URL: http://arxiv.org/abs/2104.07861v2
- Date: Mon, 19 Apr 2021 03:18:00 GMT
- Title: SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network
- Authors: Mingmei Cheng, Le Hui, Jin Xie, Jian Yang
- Abstract summary: We propose a semi-supervised semantic point cloud segmentation network, named SSPC-Net.
We train the semantic segmentation network by inferring the labels of unlabeled points from the few annotated 3D points.
Our method can achieve better performance than the current semi-supervised segmentation method with fewer annotated 3D points.
- Score: 21.818744369503197
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Point cloud semantic segmentation is a crucial task in 3D scene
understanding. Existing methods mainly focus on employing a large number of
annotated labels for supervised semantic segmentation. Nonetheless, manually
labeling such large point clouds for the supervised segmentation task is
time-consuming. In order to reduce the number of annotated labels, we propose a
semi-supervised semantic point cloud segmentation network, named SSPC-Net,
where we train the semantic segmentation network by inferring the labels of
unlabeled points from the few annotated 3D points. In our method, we first
partition the whole point cloud into superpoints and build superpoint graphs to
mine the long-range dependencies in point clouds. Based on the constructed
superpoint graph, we then develop a dynamic label propagation method to
generate the pseudo labels for the unsupervised superpoints. Particularly, we
adopt a superpoint dropout strategy to dynamically select the generated pseudo
labels. In order to fully exploit the generated pseudo labels of the
unsupervised superpoints, we furthermore propose a coupled attention mechanism
for superpoint feature embedding. Finally, we employ the cross-entropy loss to
train the semantic segmentation network with the labels of the supervised
superpoints and the pseudo labels of the unsupervised superpoints. Experiments
on various datasets demonstrate that our semi-supervised segmentation method
can achieve better performance than the current semi-supervised segmentation
method with fewer annotated 3D points. Our code is available at
https://github.com/MMCheng/SSPC-Net.
Related papers
- Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance
Segmentation [10.968271388503986]
We propose a 3D instance segmentation framework that can achieve good performance by annotating only one point for each instance.
Our method achieves state-of-the-art performance in the weakly supervised point cloud instance segmentation task, and even outperforms some fully supervised methods.
arXiv Detail & Related papers (2022-10-11T15:22:22Z) - Box2Seg: Learning Semantics of 3D Point Clouds with Box-Level
Supervision [65.19589997822155]
We introduce a neural architecture, termed Box2Seg, to learn point-level semantics of 3D point clouds with bounding box-level supervision.
We show that the proposed network can be trained with cheap, or even off-the-shelf bounding box-level annotations and subcloud-level tags.
arXiv Detail & Related papers (2022-01-09T09:07:48Z) - Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds [59.63231842439687]
We train a semantic point cloud segmentation network with only a small portion of points being labeled.
We propose a cross-sample feature reallocating module to transfer similar features and therefore re-route the gradients across two samples.
Our weakly supervised method with only 10% and 1% of labels can produce compatible results with the fully supervised counterpart.
arXiv Detail & Related papers (2021-07-23T14:34:57Z) - SCSS-Net: Superpoint Constrained Semi-supervised Segmentation Network
for 3D Indoor Scenes [6.3364439467281315]
We propose a superpoint constrained semi-supervised segmentation network for 3D point clouds, named as SCSS-Net.
Specifically, we use the pseudo labels predicted from unlabeled point clouds for self-training, and the superpoints produced by geometry-based and color-based Region Growing algorithms are combined to modify and delete pseudo labels with low confidence.
arXiv Detail & Related papers (2021-07-08T04:43:21Z) - One Thing One Click: A Self-Training Approach for Weakly Supervised 3D
Semantic Segmentation [78.36781565047656]
We propose "One Thing One Click," meaning that the annotator only needs to label one point per object.
We iteratively conduct the training and label propagation, facilitated by a graph propagation module.
Our results are also comparable to those of the fully supervised counterparts.
arXiv Detail & Related papers (2021-04-06T02:27:25Z) - SegGroup: Seg-Level Supervision for 3D Instance and Semantic
Segmentation [88.22349093672975]
We design a weakly supervised point cloud segmentation algorithm that only requires clicking on one point per instance to indicate its location for annotation.
With over-segmentation for pre-processing, we extend these location annotations into segments as seg-level labels.
We show that our seg-level supervised method (SegGroup) achieves comparable results with the fully annotated point-level supervised methods.
arXiv Detail & Related papers (2020-12-18T13:23:34Z) - Few-shot 3D Point Cloud Semantic Segmentation [138.80825169240302]
We propose a novel attention-aware multi-prototype transductive few-shot point cloud semantic segmentation method.
Our proposed method shows significant and consistent improvements compared to baselines in different few-shot point cloud semantic segmentation settings.
arXiv Detail & Related papers (2020-06-22T08:05:25Z) - Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation
on Point Clouds [67.0904905172941]
We propose a weakly supervised approach to predict point-level results using weak labels on 3D point clouds.
To the best of our knowledge, this is the first method that uses cloud-level weak labels on raw 3D space to train a point cloud semantic segmentation network.
arXiv Detail & Related papers (2020-03-29T14:13:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.