Point Cloud Diffusion with Global and Local Reconstruction for Instance-Level 3D Anomaly Detection

• URL: http://arxiv.org/abs/2606.25740v1
• Date: Wed, 24 Jun 2026 12:11:05 GMT
• Title: Point Cloud Diffusion with Global and Local Reconstruction for Instance-Level 3D Anomaly Detection
• Abstract summary: We propose textbfPCDiff, a point cloud diffusion framework for instance-level 3D anomaly generation and detection.<n>In the generation phase, an instance-level multi-modal attention is embedded into the generation framework, where anomalies are conditioned with texture gradient, image patch, text and mask.<n>In the detection phase, a joint local-global reconstruction algorithm is introduced to ensure local anomaly restoration and global geometric consistency.
• Score: 53.26344422459608
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D anomaly detection in point clouds is critical for high-precision industrial manufacturing. Reconstruction-based methods have laid a strong foundation by detecting 3D anomalies through comparisons between defective inputs and their reconstructed normal counterparts. However, existing methods still suffer from two challenges: 1) the foreground weak defective regions such as scratches are hard to reconstruct and detect, where the anomaly deviations in normalized point clouds can be as small as $10^{-3}$; 2) the background non-defective regions are prone to get positional bias in reconstruction, which leads to false positives. To address these challenges, we propose \textbf{PCDiff}, a point cloud diffusion framework for instance-level 3D anomaly generation and detection. In the generation phase, an instance-level multi-modal attention is embedded into the generation framework, where anomalies are conditioned with texture gradient, image patch, text and mask. The instance-level condition enables the high-quality generation of weak-defective anomalies. In the detection phase, a joint local-global reconstruction algorithm is introduced to ensure local anomaly restoration and global geometric consistency, which preserves background normal structure while restoring the foreground defect. Extensive experiments demonstrate that the proposed PCDiff significantly outperforms state-of-the-art methods in both 3D anomaly generation fidelity and reconstruction quality, leading to substantial improvements in anomaly detection accuracy.

Related papers

• DOC-GS: Dual-Domain Observation and Calibration for Reliable Sparse-View Gaussian Splatting [80.43237927269575]
  In this paper, we revisit sparse-view 3DGS reconstruction from a new perspective.<n>We identify the core challenge as the unobservability of Gaussian primitive reliability.<n>Motivated by this observation, we propose a unified Dual-domain Observation and geometrics in rendered images framework.
  arXiv  Detail & Related papers  (2026-04-08T07:01:24Z)
• Hierarchical Point-Patch Fusion with Adaptive Patch Codebook for 3D Shape Anomaly Detection [24.451730437527804]
  3D shape anomaly detection is a crucial task for industrial inspection and geometric analysis.<n>Existing deep learning approaches typically learn representations of normal shapes and identify anomalies.<n>We propose a hierarchical point-patch anomaly scoring network that jointly models regional part features and local point features.
  arXiv  Detail & Related papers  (2026-04-05T05:37:27Z)
• A Semantically Disentangled Unified Model for Multi-category 3D Anomaly Detection [3.991584682799934]
  3D anomaly detection targets the detection and localization of defects in 3D point clouds trained solely on normal data.<n>We propose the Semantically Disentangled Unified Model for 3D Anomaly Detection, which reconstructs features conditioned on disentangled semantic representations.<n>Our method achieves state-of-the-art for both unified and category-specific models, improving object-level AUROC by 2.8% and 9.1%, respectively.
  arXiv  Detail & Related papers  (2026-03-26T08:26:46Z)
• Correcting Deviations from Normality: A Reformulated Diffusion Model for Multi-Class Unsupervised Anomaly Detection [15.572896213775438]
  This paper introduces a reformulation of the standard diffusion model geared toward selective region alteration.<n>By modeling anomalies as noise in the latent space, our proposed textbfDeviation correction diffusion (Ours) model preserves the normal regions and encourages transformations on anomalous areas.<n> Comprehensive evaluations demonstrate the superiority of our method in accurately identifying and localizing anomalies in complex images.
  arXiv  Detail & Related papers  (2025-03-25T05:14:40Z)
• Towards Zero-shot 3D Anomaly Localization [58.62650061201283]
  3DzAL is a novel patch-level contrastive learning framework for 3D anomaly detection and localization.<n>We show that 3DzAL outperforms the state-of-the-art anomaly detection and localization performance.
  arXiv  Detail & Related papers  (2024-12-05T16:25:27Z)
• R3D-AD: Reconstruction via Diffusion for 3D Anomaly Detection [12.207437451118036]
  3D anomaly detection plays a crucial role in monitoring parts for localized inherent defects in precision manufacturing. Embedding-based and reconstruction-based approaches are among the most popular and successful methods. We propose R3D-AD, reconstructing anomalous point clouds by diffusion model for precise 3D anomaly detection.
  arXiv  Detail & Related papers  (2024-07-15T16:10:58Z)
• Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection [59.41026558455904]
  We focus on multi-modal anomaly detection. Specifically, we investigate early multi-modal approaches that attempted to utilize models pre-trained on large-scale visual datasets. We propose a Local-to-global Self-supervised Feature Adaptation (LSFA) method to finetune the adaptors and learn task-oriented representation toward anomaly detection.
  arXiv  Detail & Related papers  (2024-01-06T07:30:41Z)
• Generating and Reweighting Dense Contrastive Patterns for Unsupervised Anomaly Detection [59.34318192698142]
  We introduce a prior-less anomaly generation paradigm and develop an innovative unsupervised anomaly detection framework named GRAD. PatchDiff effectively expose various types of anomaly patterns. experiments on both MVTec AD and MVTec LOCO datasets also support the aforementioned observation.
  arXiv  Detail & Related papers  (2023-12-26T07:08:06Z)
• Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
  This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting. Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
  arXiv  Detail & Related papers  (2023-11-27T13:14:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.