ProjFormer: Point Cloud Completion via Geometric-Projective Transformer and Cross-Modal Semantic Constraints

• URL: http://arxiv.org/abs/2608.15104v1
• Date: Sat, 15 Aug 2026 08:05:48 GMT
• Title: ProjFormer: Point Cloud Completion via Geometric-Projective Transformer and Cross-Modal Semantic Constraints
• Abstract summary: ProjFormer is a cross-modal framework that enforces geometry-consistent 2D-3D interaction through explicit projection and adaptive feature routing.<n> Experiments show that, under a lightweight design, ProjFormer delivers competitive performance with improved structural completeness.
• Score: 50.4059685962603
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Point cloud completion is inherently ill-posed due to severe sparsity and ambiguity in partial observations. Existing multi-view methods alleviate this by incorporating 2D semantics, but often rely on learned attention and fixed fusion, which lack geometric consistency and adaptability. We propose ProjFormer, a cross-modal framework that enforces geometry-consistent 2D-3D interaction through explicit projection and adaptive feature routing. A Projective Guided View Attention module aligns 3D points with multi-view features via deterministic projection, enabling efficient and geometrically consistent aggregation. Building on this, a geometry-aware routing network performs point-wise adaptive fusion of structural and observation-driven features for progressive refinement. Experiments show that, under a lightweight design, ProjFormer delivers competitive performance with improved structural completeness.

Related papers

• Stable and Scalable Bundle Adjustment of Holistic 3D Structures [99.03818732955783]
  We present a new version of Bundle Adjustment (BA) for 3D computer vision.<n>BA is developed to jointly optimize cameras, poses and 3D points.<n>By group-induced measurements and cross-feature reprojection, we preserve the sparsity of classical point-only 3D regularization.
  arXiv  Detail & Related papers  (2026-09-03T16:08:03Z)
• TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection [13.394581946335949]
  We propose TDFNet, the first Tri-projection Deformable Fusion Network for panoramic salient object detection.<n>We exploit complementary projection representations to alleviate geometric distortions and improve detection performance.<n>TDFNet simultaneously preserves global spatial continuity, local geometric details, and fine-grained boundary information.
  arXiv  Detail & Related papers  (2026-08-26T13:54:44Z)
• MAGE: View-guided Point Cloud Completion with Efficient Modality Alignment and Adaptive Geometry Enhancement [19.44604826924269]
  View-based point cloud completion aims to recover a complete 3D shape from a partial point cloud, guided by a single-view image.<n>Existing approaches often suffer from limited performance due to weak modality alignment and limited self-geometry enhancement.<n>We propose a unified geometry-aware framework that integrates efficient modality alignment and adaptive geometry enhancement.
  arXiv  Detail & Related papers  (2026-06-30T05:25:29Z)
• A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation [34.48829831555172]
  Cross-view fusion framework enhances robustness of 6-DoF grasp pose estimation in corner views.<n>We propose a self-supervised contrastive learning strategy that leverages cross-view associations to regularize point cloud features.<n>Our framework achieves strong performance on the GraspNet-1Billion benchmark and in real-world applications.
  arXiv  Detail & Related papers  (2026-06-05T03:45:10Z)
• Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images [81.94999489820974]
  UniSplat is a feed-forward framework for learning 3D representations from unposed multi-view images.<n>We introduce a dual-masking strategy that strengthens geometry induction in the encoder.<n>Second, we develop a coarse-to-fine Gaussian splatting strategy that reduces appearance-semantics inconsistencies.<n>Third, we introduce a pose-conditioned recalibration mechanism that interrelates predicted 3D point and semantic maps into the image plane.
  arXiv  Detail & Related papers  (2026-04-12T10:36:18Z)
• SPAN: Spatial-Projection Alignment for Monocular 3D Object Detection [49.12928389918159]
  Existing monocular 3D detectors typically tame the pronounced nonlinear regression of 3D bounding box through decoupled prediction paradigm.<n>We propose novel Spatial-Projection Alignment (SPAN) with two pivotal components.<n>SPAN enforces an explicit global spatial constraint between the predicted and ground-truth 3D bounding boxes, thereby rectifying spatial drift caused by decoupled attribute regression.<n>3D-2D Projection Alignment ensures that the projected 3D box is aligned tightly within its corresponding 2D detection bounding box on the image plane, mitigating projection misalignment overlooked in previous works.
  arXiv  Detail & Related papers  (2025-11-10T04:48:48Z)
• ESCAPE: Equivariant Shape Completion via Anchor Point Encoding [79.59829525431238]
  We introduce ESCAPE, a framework designed to achieve rotation-equivariant shape completion.<n>ESCAPE employs a distinctive encoding strategy by selecting anchor points from a shape and representing all points as a distance to all anchor points.<n>ESCAPE achieves robust, high-quality reconstructions across arbitrary rotations and translations.
  arXiv  Detail & Related papers  (2024-12-01T20:05:14Z)
• SeMv-3D: Towards Concurrency of Semantic and Multi-view Consistency in General Text-to-3D Generation [122.47961178994456]
  SeMv-3D is a novel framework that jointly enhances semantic alignment and multi-view consistency in GT23D generation.<n>At its core, we introduce Triplane Prior Learning (TPL), which effectively learns triplane priors.<n>We also present Prior-based Semantic Aligning in Triplanes (SAT), which enables consistent any-view synthesis.
  arXiv  Detail & Related papers  (2024-10-10T07:02:06Z)
• Robust 3D Tracking with Quality-Aware Shape Completion [67.9748164949519]
  We propose a synthetic target representation composed of dense and complete point clouds depicting the target shape precisely by shape completion for robust 3D tracking. Specifically, we design a voxelized 3D tracking framework with shape completion, in which we propose a quality-aware shape completion mechanism to alleviate the adverse effect of noisy historical predictions.
  arXiv  Detail & Related papers  (2023-12-17T04:50:24Z)
• SVDFormer: Complementing Point Cloud via Self-view Augmentation and Self-structure Dual-generator [30.483163963846206]
  We propose a novel network, SVDFormer, to tackle two specific challenges in point cloud completion. We first design a Self-view Fusion Network that leverages multiple-view depth image information to observe incomplete self-shape. We then introduce a refinement module, called Self-structure Dual-generator, in which we incorporate learned shape priors and geometric self-similarities for producing new points.
  arXiv  Detail & Related papers  (2023-07-17T13:55:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.