Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds

• URL: http://arxiv.org/abs/2107.11267v3
• Date: Mon, 1 Apr 2024 08:28:33 GMT
• Title: Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds
• Authors: Jiacheng Wei, Guosheng Lin, Kim-Hui Yap, Fayao Liu, Tzu-Yi Hung,
• Abstract summary: We train a semantic point cloud segmentation network with only a small portion of points being labeled. We propose a cross-sample feature reallocating module to transfer similar features and therefore re-route the gradients across two samples. Our weakly supervised method with only 10% and 1% of labels can produce compatible results with the fully supervised counterpart.
• Score: 59.63231842439687
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semantic segmentation on 3D point clouds is an important task for 3D scene understanding. While dense labeling on 3D data is expensive and time-consuming, only a few works address weakly supervised semantic point cloud segmentation methods to relieve the labeling cost by learning from simpler and cheaper labels. Meanwhile, there are still huge performance gaps between existing weakly supervised methods and state-of-the-art fully supervised methods. In this paper, we train a semantic point cloud segmentation network with only a small portion of points being labeled. We argue that we can better utilize the limited supervision information as we densely propagate the supervision signal from the labeled points to other points within and across the input samples. Specifically, we propose a cross-sample feature reallocating module to transfer similar features and therefore re-route the gradients across two samples with common classes and an intra-sample feature redistribution module to propagate supervision signals on unlabeled points across and within point cloud samples. We conduct extensive experiments on public datasets S3DIS and ScanNet. Our weakly supervised method with only 10% and 1% of labels can produce compatible results with the fully supervised counterpart.

Related papers

• Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud [69.36717778451667]
  Existing methods for large-scale point cloud semantic segmentation require expensive, tedious and error-prone manual point-wise annotations. We propose an effective weakly supervised method containing two components to solve the problem. The experimental results show the large gain against existing weakly supervised and comparable results to fully supervised methods.
  arXiv  Detail & Related papers  (2022-12-09T09:42:26Z)
• Image Understands Point Cloud: Weakly Supervised 3D Semantic Segmentation via Association Learning [59.64695628433855]
  We propose a novel cross-modality weakly supervised method for 3D segmentation, incorporating complementary information from unlabeled images. Basically, we design a dual-branch network equipped with an active labeling strategy, to maximize the power of tiny parts of labels. Our method even outperforms the state-of-the-art fully supervised competitors with less than 1% actively selected annotations.
  arXiv  Detail & Related papers  (2022-09-16T07:59:04Z)
• SCSS-Net: Superpoint Constrained Semi-supervised Segmentation Network for 3D Indoor Scenes [6.3364439467281315]
  We propose a superpoint constrained semi-supervised segmentation network for 3D point clouds, named as SCSS-Net. Specifically, we use the pseudo labels predicted from unlabeled point clouds for self-training, and the superpoints produced by geometry-based and color-based Region Growing algorithms are combined to modify and delete pseudo labels with low confidence.
  arXiv  Detail & Related papers  (2021-07-08T04:43:21Z)
• SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network [21.818744369503197]
  We propose a semi-supervised semantic point cloud segmentation network, named SSPC-Net. We train the semantic segmentation network by inferring the labels of unlabeled points from the few annotated 3D points. Our method can achieve better performance than the current semi-supervised segmentation method with fewer annotated 3D points.
  arXiv  Detail & Related papers  (2021-04-16T02:37:27Z)
• Few-shot 3D Point Cloud Semantic Segmentation [138.80825169240302]
  We propose a novel attention-aware multi-prototype transductive few-shot point cloud semantic segmentation method. Our proposed method shows significant and consistent improvements compared to baselines in different few-shot point cloud semantic segmentation settings.
  arXiv  Detail & Related papers  (2020-06-22T08:05:25Z)
• Weakly Supervised Semantic Point Cloud Segmentation:Towards 10X Fewer Labels [77.65554439859967]
  We propose a weakly supervised point cloud segmentation approach which requires only a tiny fraction of points to be labelled in the training stage. Experiments are done on three public datasets with different degrees of weak supervision.
  arXiv  Detail & Related papers  (2020-04-08T16:14:41Z)
• Multi-Path Region Mining For Weakly Supervised 3D Semantic Segmentation on Point Clouds [67.0904905172941]
  We propose a weakly supervised approach to predict point-level results using weak labels on 3D point clouds. To the best of our knowledge, this is the first method that uses cloud-level weak labels on raw 3D space to train a point cloud semantic segmentation network.
  arXiv  Detail & Related papers  (2020-03-29T14:13:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.