A 3D Multimodal Feature for Infrastructure Anomaly Detection

• URL: http://arxiv.org/abs/2502.05779v1
• Date: Sun, 09 Feb 2025 05:16:31 GMT
• Title: A 3D Multimodal Feature for Infrastructure Anomaly Detection
• Abstract summary: Ageing structures require periodic inspections to identify structural defects.<n>Previous work has used geometric distortions to locate cracks in synthetic masonry bridge point clouds but has struggled to detect small cracks.<n>This study proposes a novel 3D multimodal feature, 3DMulti-FPFHI, that combines a customized Fast Point Feature Histogram with an intensity feature.
• Score: 5.590622098314783
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Ageing structures require periodic inspections to identify structural defects. Previous work has used geometric distortions to locate cracks in synthetic masonry bridge point clouds but has struggled to detect small cracks. To address this limitation, this study proposes a novel 3D multimodal feature, 3DMulti-FPFHI, that combines a customized Fast Point Feature Histogram (FPFH) with an intensity feature. This feature is integrated into the PatchCore anomaly detection algorithm and evaluated through statistical and parametric analyses. The method is further evaluated using point clouds of a real masonry arch bridge and a full-scale experimental model of a concrete tunnel. Results show that the 3D intensity feature enhances inspection quality by improving crack detection; it also enables the identification of water ingress which introduces intensity anomalies. The 3DMulti-FPFHI outperforms FPFH and a state-of-the-art multimodal anomaly detection method. The potential of the method to address diverse infrastructure anomaly detection scenarios is highlighted by the minimal requirements for data compared to learning-based methods. The code and related point cloud dataset are available at https://github.com/Jingyixiong/3D-Multi-FPFHI.

Related papers

• Anomaly Factory 3D: A Modular Framework for Diverse Pseudo-Anomaly Synthesis in Unsupervised 3D Anomaly Detection [0.0]
  Anomaly Factory 3D (AF3AD) is a modular framework that synthesizes diverse pseudo-anomalies from normal point clouds.<n> AF3AD is designed as a standalone synthesis tool to facilitate adoption across different 3D anomaly detection paradigms.
  arXiv  Detail & Related papers  (2026-06-28T03:55:44Z)
• CoGeoAD: Hierarchical Color-Geometric Fusion with Multi-View Attention for Zero-Shot 3D Anomaly Detection [5.069582722808145]
  CoGeoAD is a unified CLIP-based framework that fuses color and geometric features by constructing pixel-aligned paired multi-view images.<n>Experiments on the MVTec3D-AD and Eyecandies benchmarks demonstrate that CoGeoAD achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-06-24T01:12:22Z)
• Real-IAD MVN: A Multi-View Normal Vector Dataset and Benchmark for High-Fidelity Industrial Anomaly Detection [13.79855998324516]
  We introduce Real-IAD-MVN (Multi-View Normal), a large-scale industrial dataset.<n>By upgrading our acquisition system, Real-IAD-MVN captures high-fidelity surface normal maps from five distinct viewpoints.<n>This provides a comprehensive geometric representation at a micro-detail level, making previously invisible side-wall and occluded defects explicitly detectable.
  arXiv  Detail & Related papers  (2026-05-08T02:34:51Z)
• Learning Discriminative Signed Distance Functions from Multi-scale Level-of-detail Features for 3D Anomaly Detection [25.28219474762596]
  A surface-based method is proposed for 3D anomaly detection, which learns a discriminative signed distance function using multi-scale level-of-detail features.<n> Experimental results demonstrate that the proposed method achieves an average object-level AUROC of 92.1% and 85.9% on the Anomaly-ShapeNet and Real3D-AD datasets.
  arXiv  Detail & Related papers  (2026-05-05T07:16:47Z)
• Text-Guided Multimodal Unified Industrial Anomaly Detection [71.95719669933312]
  We propose a unified multimodal industrial anomaly detection framework guided by text semantics.<n>The framework consists of two core modules: a Geometry-Aware Cross-Modal Mapper and an Object-Conditioned Textual Feature Adaptor.<n>Our method achieves state-of-the-art performance in classification and localization under unsupervised settings.
  arXiv  Detail & Related papers  (2026-04-24T13:21:22Z)
• DMP-3DAD: Cross-Category 3D Anomaly Detection via Realistic Depth Map Projection with Few Normal Samples [15.21047221062711]
  Cross-category anomaly detection for 3D point clouds aims to determine whether an unseen object belongs to a target category.<n>Most existing methods rely on category-specific training, which limits their flexibility in few-shot scenarios.<n>DMP-3DAD is a training-free framework for cross-category 3D anomaly detection based on multi-view realistic depth map projection.
  arXiv  Detail & Related papers  (2026-02-11T12:47:38Z)
• CASL: Curvature-Augmented Self-supervised Learning for 3D Anomaly Detection [49.74534277563012]
  We propose a Curvature-Augmented Self-supervised Learning (CASL) framework based on a reconstruction paradigm.<n>Our approach introduces multi-scale curvature prompts to guide the decoder in predicting the spatial coordinates of each point.<n>It achieves leading detection performance through straightforward anomaly classification fine-tuning.
  arXiv  Detail & Related papers  (2025-11-17T02:58:09Z)
• Proto-FG3D: Prototype-based Interpretable Fine-Grained 3D Shape Classification [59.68055837500357]
  We propose the first prototype-based framework named Proto-FG3D for fine-grained 3D shape classification.<n>Proto-FG3D establishes joint multi-view and multi-category representation learning via Prototype Association.<n>Proto-FG3D surpasses state-of-the-art methods in accuracy, transparent predictions, and ad-hoc interpretability with visualizations.
  arXiv  Detail & Related papers  (2025-05-23T09:31:02Z)
• Exploring the Magnitude-Shape Plot Framework for Anomaly Detection in Crowded Video Scenes [3.6961981570832374]
  This study explores video anomaly detection within a Functional Data Analysis framework, focusing on the application of the Magnitude-Shape (MS) Plot.<n>Autoencoders are used to learn and reconstruct normal behavioral patterns from anomaly-free training data.<n>The MS-Plot offers a statistically principled and interpretable framework for anomaly detection.
  arXiv  Detail & Related papers  (2024-12-29T05:58:50Z)
• Adaptive Signal Analysis for Automated Subsurface Defect Detection Using Impact Echo in Concrete Slabs [0.0]
  This pilot study presents a novel, automated, and scalable methodology for detecting subsurface defect-prone regions in concrete slabs.<n>The approach integrates advanced signal processing, clustering, and visual analytics to identify subsurface anomalies.<n>The results demonstrate the robustness of the methodology, consistently identifying defect-prone areas with minimal false positives and few missed defects.
  arXiv  Detail & Related papers  (2024-12-23T20:05:53Z)
• M3DM-NR: RGB-3D Noisy-Resistant Industrial Anomaly Detection via Multimodal Denoising [63.39134873744748]
  Existing industrial anomaly detection methods primarily concentrate on unsupervised learning with pristine RGB images. This paper proposes a novel noise-resistant M3DM-NR framework to leverage strong multi-modal discriminative capabilities of CLIP. Extensive experiments show that M3DM-NR outperforms state-of-the-art methods in 3D-RGB multi-modal noisy anomaly detection.
  arXiv  Detail & Related papers  (2024-06-04T12:33:02Z)
• Towards Unified 3D Object Detection via Algorithm and Data Unification [70.27631528933482]
  We build the first unified multi-modal 3D object detection benchmark MM- Omni3D and extend the aforementioned monocular detector to its multi-modal version. We name the designed monocular and multi-modal detectors as UniMODE and MM-UniMODE, respectively.
  arXiv  Detail & Related papers  (2024-02-28T18:59:31Z)
• S$^3$-MonoDETR: Supervised Shape&Scale-perceptive Deformable Transformer for Monocular 3D Object Detection [21.96072831561483]
  This paper proposes a novel Supervised Shape&Scale-perceptive Deformable Attention'' (S$3$-DA) module for monocular 3D object detection. Benefiting from this, S$3$-DA effectively estimates receptive fields for query points belonging to any category, enabling them to generate robust query features. Experiments on KITTI and Open datasets demonstrate that S$3$-DA significantly improves the detection accuracy.
  arXiv  Detail & Related papers  (2023-09-02T12:36:38Z)
• Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection [54.041049052843604]
  We present STEMD, a novel end-to-end framework that enhances the DETR-like paradigm for multi-frame 3D object detection. First, to model the inter-object spatial interaction and complex temporal dependencies, we introduce the spatial-temporal graph attention network. Finally, it poses a challenge for the network to distinguish between the positive query and other highly similar queries that are not the best match.
  arXiv  Detail & Related papers  (2023-07-01T13:53:14Z)
• Multimodal Industrial Anomaly Detection via Hybrid Fusion [59.16333340582885]
  We propose a novel multimodal anomaly detection method with hybrid fusion scheme. Our model outperforms the state-of-the-art (SOTA) methods on both detection and segmentation precision on MVTecD-3 AD dataset.
  arXiv  Detail & Related papers  (2023-03-01T15:48:27Z)
• Probabilistic and Geometric Depth: Detecting Objects in Perspective [78.00922683083776]
  3D object detection is an important capability needed in various practical applications such as driver assistance systems. Monocular 3D detection, as an economical solution compared to conventional settings relying on binocular vision or LiDAR, has drawn increasing attention recently but still yields unsatisfactory results. This paper first presents a systematic study on this problem and observes that the current monocular 3D detection problem can be simplified as an instance depth estimation problem.
  arXiv  Detail & Related papers  (2021-07-29T16:30:33Z)
• Exploring Data Augmentation for Multi-Modality 3D Object Detection [82.9988604088494]
  It is counter-intuitive that multi-modality methods based on point cloud and images perform only marginally better or sometimes worse than approaches that solely use point cloud. We propose a pipeline, named transformation flow, to bridge the gap between single and multi-modality data augmentation with transformation reversing and replaying. Our method also wins the best PKL award in the 3rd nuScenes detection challenge.
  arXiv  Detail & Related papers  (2020-12-23T15:23:16Z)
• D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features [51.04841465193678]
  We leverage a 3D fully convolutional network for 3D point clouds. We propose a novel and practical learning mechanism that densely predicts both a detection score and a description feature for each 3D point. Our method achieves state-of-the-art results in both indoor and outdoor scenarios.
  arXiv  Detail & Related papers  (2020-03-06T12:51:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.