PointSea: Point Cloud Completion via Self-structure Augmentation
- URL: http://arxiv.org/abs/2502.17053v3
- Date: Wed, 26 Feb 2025 07:12:43 GMT
- Title: PointSea: Point Cloud Completion via Self-structure Augmentation
- Authors: Zhe Zhu, Honghua Chen, Xing He, Mingqiang Wei,
- Abstract summary: Point cloud completion is a fundamental yet not well-solved problem in 3D vision.<n>We propose PointSea for global-to-local point cloud completion.
- Score: 22.84159461045977
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Point cloud completion is a fundamental yet not well-solved problem in 3D vision. Current approaches often rely on 3D coordinate information and/or additional data (e.g., images and scanning viewpoints) to fill in missing parts. Unlike these methods, we explore self-structure augmentation and propose PointSea for global-to-local point cloud completion. In the global stage, consider how we inspect a defective region of a physical object, we may observe it from various perspectives for a better understanding. Inspired by this, PointSea augments data representation by leveraging self-projected depth images from multiple views. To reconstruct a compact global shape from the cross-modal input, we incorporate a feature fusion module to fuse features at both intra-view and inter-view levels. In the local stage, to reveal highly detailed structures, we introduce a point generator called the self-structure dual-generator. This generator integrates both learned shape priors and geometric self-similarities for shape refinement. Unlike existing efforts that apply a unified strategy for all points, our dual-path design adapts refinement strategies conditioned on the structural type of each point, addressing the specific incompleteness of each point. Comprehensive experiments on widely-used benchmarks demonstrate that PointSea effectively understands global shapes and generates local details from incomplete input, showing clear improvements over existing methods.
Related papers
- PointCFormer: a Relation-based Progressive Feature Extraction Network for Point Cloud Completion [19.503392612245474]
Point cloud completion aims to reconstruct the complete 3D shape from incomplete point clouds.<n>We introduce PointCFormer, a transformer framework optimized for robust global retention and precise local detail capture.<n>PointCFormer demonstrates state-of-the-art performance on several widely used benchmarks.
arXiv Detail & Related papers (2024-12-11T14:37:21Z) - Focus on Neighbors and Know the Whole: Towards Consistent Dense Multiview Text-to-Image Generator for 3D Creation [64.07560335451723]
CoSER is a novel consistent dense Multiview Text-to-Image Generator for Text-to-3D.
It achieves both efficiency and quality by meticulously learning neighbor-view coherence.
It aggregates information along motion paths explicitly defined by physical principles to refine details.
arXiv Detail & Related papers (2024-08-23T15:16:01Z) - Self-supervised 3D Point Cloud Completion via Multi-view Adversarial Learning [61.14132533712537]
We propose MAL-SPC, a framework that effectively leverages both object-level and category-specific geometric similarities to complete missing structures.
Our MAL-SPC does not require any 3D complete supervision and only necessitates a single partial point cloud for each object.
arXiv Detail & Related papers (2024-07-13T06:53:39Z) - SVDFormer: Complementing Point Cloud via Self-view Augmentation and
Self-structure Dual-generator [30.483163963846206]
We propose a novel network, SVDFormer, to tackle two specific challenges in point cloud completion.
We first design a Self-view Fusion Network that leverages multiple-view depth image information to observe incomplete self-shape.
We then introduce a refinement module, called Self-structure Dual-generator, in which we incorporate learned shape priors and geometric self-similarities for producing new points.
arXiv Detail & Related papers (2023-07-17T13:55:31Z) - Variational Relational Point Completion Network for Robust 3D
Classification [59.80993960827833]
Vari point cloud completion methods tend to generate global shape skeletons hence lack fine local details.
This paper proposes a variational framework, point Completion Network (VRCNet) with two appealing properties.
VRCNet shows great generalizability and robustness on real-world point cloud scans.
arXiv Detail & Related papers (2023-04-18T17:03:20Z) - Semantic Segmentation for Real Point Cloud Scenes via Bilateral
Augmentation and Adaptive Fusion [38.05362492645094]
Real point cloud scenes can intuitively capture complex surroundings in the real world, but due to 3D data's raw nature, it is very challenging for machine perception.
We concentrate on the essential visual task, semantic segmentation, for large-scale point cloud data collected in reality.
By comparing with state-of-the-art networks on three different benchmarks, we demonstrate the effectiveness of our network.
arXiv Detail & Related papers (2021-03-12T04:13:20Z) - PMP-Net: Point Cloud Completion by Learning Multi-step Point Moving
Paths [54.459879603473034]
We design a novel neural network, named PMP-Net, to mimic the behavior of an earth mover.
It moves each point of the incomplete input to complete the point cloud, where the total distance of point moving paths should be shortest.
It learns a strict and unique correspondence on point-level, which can capture the detailed topology and structure relationships between the incomplete shape and the complete target.
arXiv Detail & Related papers (2020-12-07T01:34:38Z) - Detail Preserved Point Cloud Completion via Separated Feature
Aggregation [26.566021924980706]
Point cloud shape completion is a challenging problem in 3D vision and robotics.
We propose two different feature aggregation strategies, named global & local feature aggregation(GLFA) and residual feature aggregation(RFA)
Our proposed network outperforms current state-of-the art methods especially on detail preservation.
arXiv Detail & Related papers (2020-07-05T16:11:55Z) - Point Cloud Completion by Skip-attention Network with Hierarchical
Folding [61.59710288271434]
We propose Skip-Attention Network (SA-Net) for 3D point cloud completion.
First, we propose a skip-attention mechanism to effectively exploit the local structure details of incomplete point clouds.
Second, in order to fully utilize the selected geometric information encoded by skip-attention mechanism at different resolutions, we propose a novel structure-preserving decoder.
arXiv Detail & Related papers (2020-05-08T06:23:51Z) - Cascaded Refinement Network for Point Cloud Completion [74.80746431691938]
We propose a cascaded refinement network together with a coarse-to-fine strategy to synthesize the detailed object shapes.
Considering the local details of partial input with the global shape information together, we can preserve the existing details in the incomplete point set.
We also design a patch discriminator that guarantees every local area has the same pattern with the ground truth to learn the complicated point distribution.
arXiv Detail & Related papers (2020-04-07T13:03:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.