Cross-Shape Attention for Part Segmentation of 3D Point Clouds

• URL: http://arxiv.org/abs/2003.09053v6
• Date: Wed, 5 Jul 2023 16:26:28 GMT
• Title: Cross-Shape Attention for Part Segmentation of 3D Point Clouds
• Authors: Marios Loizou, Siddhant Garg, Dmitry Petrov, Melinos Averkiou, Evangelos Kalogerakis
• Abstract summary: We propose a cross-shape attention mechanism to enable interactions between a shape's point-wise features and those of other shapes. The mechanism assesses both the degree of interaction between points and also mediates feature propagation across shapes. Our approach yields state-of-the-art results in the popular PartNet dataset.
• Score: 11.437076464287822
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We present a deep learning method that propagates point-wise feature representations across shapes within a collection for the purpose of 3D shape segmentation. We propose a cross-shape attention mechanism to enable interactions between a shape's point-wise features and those of other shapes. The mechanism assesses both the degree of interaction between points and also mediates feature propagation across shapes, improving the accuracy and consistency of the resulting point-wise feature representations for shape segmentation. Our method also proposes a shape retrieval measure to select suitable shapes for cross-shape attention operations for each test shape. Our experiments demonstrate that our approach yields state-of-the-art results in the popular PartNet dataset.

Related papers

• Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transform [62.27337227010514]
  We introduce a novel self-supervised Rotation-Invariant 3D correspondence learner with Local Shape Transform, dubbed RIST. RIST learns to establish dense correspondences between shapes even under challenging intra-class variations and arbitrary orientations. RIST demonstrates state-of-the-art performances on 3D part label transfer and semantic keypoint transfer given arbitrarily rotated point cloud pairs.
  arXiv  Detail & Related papers  (2024-04-17T08:09:25Z)
• Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation [50.376243444909136]
  We present a unified framework to predict both point-wise correspondences and shape between 3D shapes. We combine the deep functional map framework with classical surface deformation models to map shapes in both spectral and spatial domains.
  arXiv  Detail & Related papers  (2024-02-29T07:26:23Z)
• ShapeMatcher: Self-Supervised Joint Shape Canonicalization, Segmentation, Retrieval and Deformation [47.94499636697971]
  We present ShapeMatcher, a unified self-supervised learning framework for joint shape canonicalization, segmentation, retrieval and deformation. The key insight of ShapeMaker is the simultaneous training of the four highly-associated processes: canonicalization, segmentation, retrieval, and deformation.
  arXiv  Detail & Related papers  (2023-11-18T15:44:57Z)
• Geometrically Consistent Partial Shape Matching [50.29468769172704]
  Finding correspondences between 3D shapes is a crucial problem in computer vision and graphics. An often neglected but essential property of matching geometrics is consistency. We propose a novel integer linear programming partial shape matching formulation.
  arXiv  Detail & Related papers  (2023-09-10T12:21:42Z)
• Zero-Shot 3D Shape Correspondence [67.18775201037732]
  We propose a novel zero-shot approach to computing correspondences between 3D shapes. We exploit the exceptional reasoning capabilities of recent foundation models in language and vision. Our approach produces highly plausible results in a zero-shot manner, especially between strongly non-isometric shapes.
  arXiv  Detail & Related papers  (2023-06-05T21:14:23Z)
• Prototype-Aware Heterogeneous Task for Point Cloud Completion [35.47134205562422]
  Point cloud completion aims at recovering original shape information from partial point clouds. Existing methods usually succeed in completion for standard shape, while failing to generate local details of point clouds for some non-standard shapes. In this work, we design an effective way to distinguish standard/non-standard shapes with the help of intra-class shape representation.
  arXiv  Detail & Related papers  (2022-09-05T02:43:06Z)
• Cloud Sphere: A 3D Shape Representation via Progressive Deformation [21.216503294296317]
  This paper is dedicated to discovering distinctive information from the shape formation process. A Progressive Deformation-based Auto-Encoder is proposed to learn the stage-aware description. Experimental results show that the proposed PDAE has the ability to reconstruct 3D shapes with high fidelity.
  arXiv  Detail & Related papers  (2021-12-21T12:10:23Z)
• Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds [8.156355030558172]
  Representing complex 3D objects as simple geometric primitives, known as shape abstraction, is important for geometric modeling, structural analysis, and shape synthesis. We propose an unsupervised shape abstraction method to map a point cloud into a compact cuboid representation.
  arXiv  Detail & Related papers  (2021-06-07T09:15:16Z)
• Shape-Oriented Convolution Neural Network for Point Cloud Analysis [59.405388577930616]
  Point cloud is a principal data structure adopted for 3D geometric information encoding. Shape-oriented message passing scheme dubbed ShapeConv is proposed to focus on the representation learning of the underlying shape formed by each local neighboring point.
  arXiv  Detail & Related papers  (2020-04-20T16:11:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.