Data Augmentation-free Unsupervised Learning for 3D Point Cloud
Understanding
- URL: http://arxiv.org/abs/2210.02798v1
- Date: Thu, 6 Oct 2022 10:18:16 GMT
- Title: Data Augmentation-free Unsupervised Learning for 3D Point Cloud
Understanding
- Authors: Guofeng Mei and Cristiano Saltori and Fabio Poiesi and Jian Zhang and
Elisa Ricci and Nicu Sebe and Qiang Wu
- Abstract summary: We propose an augmentation-free unsupervised approach for point clouds to learn transferable point-level features via soft clustering, named SoftClu.
We exploit the affiliation of points to their clusters as a proxy to enable self-training through a pseudo-label prediction task.
- Score: 61.30276576646909
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Unsupervised learning on 3D point clouds has undergone a rapid evolution,
especially thanks to data augmentation-based contrastive methods. However, data
augmentation is not ideal as it requires a careful selection of the type of
augmentations to perform, which in turn can affect the geometric and semantic
information learned by the network during self-training. To overcome this
issue, we propose an augmentation-free unsupervised approach for point clouds
to learn transferable point-level features via soft clustering, named SoftClu.
SoftClu assumes that the points belonging to a cluster should be close to each
other in both geometric and feature spaces. This differs from typical
contrastive learning, which builds similar representations for a whole point
cloud and its augmented versions. We exploit the affiliation of points to their
clusters as a proxy to enable self-training through a pseudo-label prediction
task. Under the constraint that these pseudo-labels induce the equipartition of
the point cloud, we cast SoftClu as an optimal transport problem. We formulate
an unsupervised loss to minimize the standard cross-entropy between
pseudo-labels and predicted labels. Experiments on downstream applications,
such as 3D object classification, part segmentation, and semantic segmentation,
show the effectiveness of our framework in outperforming state-of-the-art
techniques.
Related papers
- PointMoment:Mixed-Moment-based Self-Supervised Representation Learning
for 3D Point Clouds [11.980787751027872]
We propose PointMoment, a novel framework for point cloud self-supervised representation learning.
Our framework does not require any special techniques such as asymmetric network architectures, gradient stopping, etc.
arXiv Detail & Related papers (2023-12-06T08:49:55Z) - A Data-efficient Framework for Robotics Large-scale LiDAR Scene Parsing [10.497309421830671]
Existing state-of-the-art 3D point clouds understanding methods only perform well in a fully supervised manner.
This work presents a general and simple framework to tackle point clouds understanding when labels are limited.
arXiv Detail & Related papers (2023-12-03T02:38:51Z) - Clustering based Point Cloud Representation Learning for 3D Analysis [80.88995099442374]
We propose a clustering based supervised learning scheme for point cloud analysis.
Unlike current de-facto, scene-wise training paradigm, our algorithm conducts within-class clustering on the point embedding space.
Our algorithm shows notable improvements on famous point cloud segmentation datasets.
arXiv Detail & Related papers (2023-07-27T03:42:12Z) - Dual Adaptive Transformations for Weakly Supervised Point Cloud
Segmentation [78.6612285236938]
We propose a novel DAT (textbfDual textbfAdaptive textbfTransformations) model for weakly supervised point cloud segmentation.
We evaluate our proposed DAT model with two popular backbones on the large-scale S3DIS and ScanNet-V2 datasets.
arXiv Detail & Related papers (2022-07-19T05:43:14Z) - Unsupervised Learning on 3D Point Clouds by Clustering and Contrasting [11.64827192421785]
unsupervised representation learning is a promising direction to auto-extract features without human intervention.
This paper proposes a general unsupervised approach, named textbfConClu, to perform the learning of point-wise and global features.
arXiv Detail & Related papers (2022-02-05T12:54:17Z) - Guided Point Contrastive Learning for Semi-supervised Point Cloud
Semantic Segmentation [90.2445084743881]
We present a method for semi-supervised point cloud semantic segmentation to adopt unlabeled point clouds in training to boost the model performance.
Inspired by the recent contrastive loss in self-supervised tasks, we propose the guided point contrastive loss to enhance the feature representation and model generalization ability.
arXiv Detail & Related papers (2021-10-15T16:38:54Z) - Unsupervised Representation Learning for 3D Point Cloud Data [66.92077180228634]
We propose a simple yet effective approach for unsupervised point cloud learning.
In particular, we identify a very useful transformation which generates a good contrastive version of an original point cloud.
We conduct experiments on three downstream tasks which are 3D object classification, shape part segmentation and scene segmentation.
arXiv Detail & Related papers (2021-10-13T10:52:45Z) - Dense Supervision Propagation for Weakly Supervised Semantic Segmentation on 3D Point Clouds [59.63231842439687]
We train a semantic point cloud segmentation network with only a small portion of points being labeled.
We propose a cross-sample feature reallocating module to transfer similar features and therefore re-route the gradients across two samples.
Our weakly supervised method with only 10% and 1% of labels can produce compatible results with the fully supervised counterpart.
arXiv Detail & Related papers (2021-07-23T14:34:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.