A Systematic Survey on Deep Learning Architectures for Point Cloud Classification and Segmentation

• URL: http://arxiv.org/abs/2605.17131v1
• Date: Sat, 16 May 2026 19:37:41 GMT
• Title: A Systematic Survey on Deep Learning Architectures for Point Cloud Classification and Segmentation
• Abstract summary: Point cloud stands as the most widely adopted format for representing 3D shapes and scenes due to its simplicity and geometric fidelity.<n>Its inherent unordered and irregular nature, exacerbated by sensor noise and occlusions, introduces unique challenges for machine learning based methodologies.<n>Our focus is directed towards deep learning models for three fundamental tasks in 3D vision: point cloud classification, part segmentation, and semantic segmentation.
• Score: 2.3895981099137535
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Point cloud stands as the most widely adopted format for representing 3D shapes and scenes due to its simplicity and geometric fidelity. However, its inherent unordered and irregular nature, exacerbated by sensor noise and occlusions, introduces unique challenges for machine learning based methodologies. To combat these issues, diverse strategies have been developed, including converting to a format that has orderliness, extracting local geometry, and permutation-invariant or self-attention-based processing. In this paper, our focus is directed towards deep learning models for three fundamental tasks in 3D vision: point cloud classification, part segmentation, and semantic segmentation. We begin by formally defining point cloud data, followed by an in-depth discussion on its structural characteristics. Then, we categorize notable works based on their backbone structure and evaluate their performance on popular benchmarks. Beyond empirical comparison, we offer insights into architectural innovations and limitations. We also outline open challenges and promising future directions for 3D point cloud understanding.

Related papers

• 3D Scene Graphs: Open Challenges and Future Directions [56.932031090019855]
  3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment.<n>This survey provides a unified and critical review of 3DSGs, with particular emphasis on open challenges and future directions.
  arXiv  Detail & Related papers  (2026-06-15T08:14:08Z)
• Towards Foundation Models for 3D Scene Understanding: Instance-Aware Self-Supervised Learning for Point Clouds [53.82500407523346]
  PointINS is an instance-oriented self-supervised framework that enriches point cloud representations through geometry-aware learning.<n>PointINS achieves on average +3.5% mAP improvement for indoor instance segmentation and +4.1% PQ gain for outdoor panoptic segmentation.
  arXiv  Detail & Related papers  (2026-03-26T08:31:06Z)
• A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation [0.20649496811699863]
  This paper analyzes recent progress in deep learning methods employed for point cloud processing. It serves as a comprehensive review on two major tasks in 3D point cloud processing-- namely, 3D shape classification and semantic segmentation.
  arXiv  Detail & Related papers  (2024-05-20T09:33:27Z)
• Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Images [71.91424164693422]
  We introduce an explicit point-based human reconstruction framework called HaP.<n>Our approach is featured by fully-explicit point cloud estimation, manipulation, generation, and refinement in the 3D geometric space.<n>Our results may indicate a paradigm rollback to the fully-explicit and geometry-centric algorithm design.
  arXiv  Detail & Related papers  (2023-11-06T05:52:29Z)
• Edge Aware Learning for 3D Point Cloud [8.12405696290333]
  This paper proposes an innovative approach to Hierarchical Edge Aware 3D Point Cloud Learning (HEA-Net) It seeks to address the challenges of noise in point cloud data, and improve object recognition and segmentation by focusing on edge features. We present an innovative edge-aware learning methodology, specifically designed to enhance point cloud classification and segmentation.
  arXiv  Detail & Related papers  (2023-09-23T20:12:32Z)
• Clustering based Point Cloud Representation Learning for 3D Analysis [80.88995099442374]
  We propose a clustering based supervised learning scheme for point cloud analysis. Unlike current de-facto, scene-wise training paradigm, our algorithm conducts within-class clustering on the point embedding space. Our algorithm shows notable improvements on famous point cloud segmentation datasets.
  arXiv  Detail & Related papers  (2023-07-27T03:42:12Z)
• PointResNet: Residual Network for 3D Point Cloud Segmentation and Classification [18.466814193413487]
  Point cloud segmentation and classification are some of the primary tasks in 3D computer vision. In this paper, we propose PointResNet, a residual block-based approach. Our model directly processes the 3D points, using a deep neural network for the segmentation and classification tasks.
  arXiv  Detail & Related papers  (2022-11-20T17:39:48Z)
• Point Discriminative Learning for Unsupervised Representation Learning on 3D Point Clouds [54.31515001741987]
  We propose a point discriminative learning method for unsupervised representation learning on 3D point clouds. We achieve this by imposing a novel point discrimination loss on the middle level and global level point features. Our method learns powerful representations and achieves new state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-08-04T15:11:48Z)
• Shape-Oriented Convolution Neural Network for Point Cloud Analysis [59.405388577930616]
  Point cloud is a principal data structure adopted for 3D geometric information encoding. Shape-oriented message passing scheme dubbed ShapeConv is proposed to focus on the representation learning of the underlying shape formed by each local neighboring point.
  arXiv  Detail & Related papers  (2020-04-20T16:11:51Z)
• Review: deep learning on 3D point clouds [9.73176900969663]
  Point cloud is one of the most significant data formats for 3D representation. Deep learning is now the most powerful tool for data processing in computer vision.
  arXiv  Detail & Related papers  (2020-01-17T12:55:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.