SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detection

• URL: http://arxiv.org/abs/2604.05632v1
• Date: Tue, 07 Apr 2026 09:35:29 GMT
• Title: SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detection
• Abstract summary: Multi-view anomaly detection aims to identify surface defects on complex objects using observations captured from multiple viewpoints.<n>Existing unsupervised methods often suffer from feature inconsistency arising from viewpoint variations and modality discrepancies.<n>We propose a unified framework for multimodal multi-view anomaly detection using semantic and geometric alignment.
• Score: 2.272894689841013
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Multi-view anomaly detection aims to identify surface defects on complex objects using observations captured from multiple viewpoints. However, existing unsupervised methods often suffer from feature inconsistency arising from viewpoint variations and modality discrepancies. To address these challenges, we propose a Semantic and Geometric Alignment Network (SGANet), a unified framework for multimodal multi-view anomaly detection that effectively combines semantic and geometric alignment to learn physically coherent feature representations across viewpoints and modalities. SGANet consists of three key components. The Selective Cross-view Feature Refinement Module (SCFRM) selectively aggregates informative patch features from adjacent views to enhance cross-view feature interaction. The Semantic-Structural Patch Alignment (SSPA) enforces semantic alignment across modalities while maintaining structural consistency under viewpoint transformations. The Multi-View Geometric Alignment (MVGA) further aligns geometrically corresponding patches across viewpoints. By jointly modeling feature interaction, semantic and structural consistency, and global geometric correspondence, SGANet effectively enhances anomaly detection performance in multimodal multi-view settings. Extensive experiments on the SiM3D and Eyecandies datasets demonstrate that SGANet achieves state-of-the-art performance in both anomaly detection and localization, validating its effectiveness in realistic industrial scenarios.

Related papers

• GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment [32.33973839948303]
  Multi-view anomaly detection (MvAD) detects defects by exploiting complementary observations from multiple camera viewpoints.<n>Existing methods typically fall into two extremes: voxel-based fusion provides explicit geometric alignment but requires costly 3D construction and class-specific assumptions.<n>We propose GeoMAD, a unified multi-view, multi-class AD framework that addresses both geometric correspondence deficiency and distributional inconsistency.
  arXiv  Detail & Related papers  (2026-08-27T07:15:15Z)
• ProjFormer: Point Cloud Completion via Geometric-Projective Transformer and Cross-Modal Semantic Constraints [50.4059685962603]
  ProjFormer is a cross-modal framework that enforces geometry-consistent 2D-3D interaction through explicit projection and adaptive feature routing.<n> Experiments show that, under a lightweight design, ProjFormer delivers competitive performance with improved structural completeness.
  arXiv  Detail & Related papers  (2026-08-15T08:05:48Z)
• GeoMamba: A Geometry-driven MambaVision Framework and Dataset for Fine-grained Optical-SAR Object Retrieval [54.741349848771144]
  GeoMamba is a geometry-driven framework for optical-SAR fine-grained retrieval.<n>GFI module enhances cross-modal feature interaction and incorporates structural priors.<n>GeoMamba outperforms existing methods, achieving 63.3% mAP and 77.0% Rank-1 accuracy in all-to-all retrieval setting.
  arXiv  Detail & Related papers  (2026-05-19T12:08:09Z)
• Text-Guided Multimodal Unified Industrial Anomaly Detection [71.95719669933312]
  We propose a unified multimodal industrial anomaly detection framework guided by text semantics.<n>The framework consists of two core modules: a Geometry-Aware Cross-Modal Mapper and an Object-Conditioned Textual Feature Adaptor.<n>Our method achieves state-of-the-art performance in classification and localization under unsupervised settings.
  arXiv  Detail & Related papers  (2026-04-24T13:21:22Z)
• Unify the Views: View-Consistent Prototype Learning for Few-Shot Segmentation [23.546777614096424]
  Few-shot segmentation (FSS) has gained significant attention for its ability to generalize to novel classes with limited supervision.<n>This paper tackles these challenges by introducing VINE, a unified framework that models structural consistency and discrimination to refine class-specific prototypes.
  arXiv  Detail & Related papers  (2026-03-06T06:36:42Z)
• COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation [58.47973015036709]
  3D pose estimation from sparse multi-views is a critical task for action recognition, sports analysis, and human-robot interaction.<n>We propose COMPOSE, a novel framework that formulates multi-view pose correspondence matching as a hypergraph problem.<n> COMPOSE achieves improvements of up to 23% in average precision over previous optimization-based methods and up to 11% over self-supervised end-to-end learned methods.
  arXiv  Detail & Related papers  (2026-01-14T18:50:17Z)
• MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning [18.21720738180151]
  Two-view correspondence learning is a key task in computer vision.<n>We propose a Multi-Graph Contextual Attention Network (MGCA-Net)<n>We show that MGCA-Net significantly outperforms existing SOTA methods in the outlier rejection and camera pose estimation tasks.
  arXiv  Detail & Related papers  (2025-12-29T10:58:40Z)
• Unsupervised Multi-View Visual Anomaly Detection via Progressive Homography-Guided Alignment [14.782512101141016]
  Unsupervised visual anomaly detection from multi-view images presents a significant challenge.<n>ViewSense-AD (VSAD) learns viewpoint-invariant representations by explicitly modeling geometric consistency across views.<n>Anomaly detection is performed by comparing multi-level features from the diffusion model against a learned memory bank of normal prototypes.
  arXiv  Detail & Related papers  (2025-11-24T05:01:16Z)
• SegMASt3R: Geometry Grounded Segment Matching [23.257530861472656]
  We leverage the spatial understanding of 3D foundation models to tackle wide-baseline segment matching.<n>We propose an architecture that uses the inductive bias of these 3D foundation models to match segments across image pairs with up to 180 degree view-point change rotation.
  arXiv  Detail & Related papers  (2025-10-06T17:31:32Z)
• GCRPNet: Graph-Enhanced Contextual and Regional Perception Network for Salient Object Detection in Optical Remote Sensing Images [68.33481681452675]
  We propose a graph-enhanced contextual and regional perception network (GCRPNet)<n>It builds upon the Mamba architecture to simultaneously capture long-range dependencies and enhance regional feature representation.<n>It performs adaptive patch scanning on feature maps processed via multi-scale convolutions, thereby capturing rich local region information.
  arXiv  Detail & Related papers  (2025-08-14T11:31:43Z)
• SeMv-3D: Towards Concurrency of Semantic and Multi-view Consistency in General Text-to-3D Generation [122.47961178994456]
  SeMv-3D is a novel framework that jointly enhances semantic alignment and multi-view consistency in GT23D generation.<n>At its core, we introduce Triplane Prior Learning (TPL), which effectively learns triplane priors.<n>We also present Prior-based Semantic Aligning in Triplanes (SAT), which enables consistent any-view synthesis.
  arXiv  Detail & Related papers  (2024-10-10T07:02:06Z)
• Towards Unified 3D Object Detection via Algorithm and Data Unification [70.27631528933482]
  We build the first unified multi-modal 3D object detection benchmark MM- Omni3D and extend the aforementioned monocular detector to its multi-modal version. We name the designed monocular and multi-modal detectors as UniMODE and MM-UniMODE, respectively.
  arXiv  Detail & Related papers  (2024-02-28T18:59:31Z)
• Multi-Spectral Image Stitching via Spatial Graph Reasoning [52.27796682972484]
  We propose a spatial graph reasoning based multi-spectral image stitching method. We embed multi-scale complementary features from the same view position into a set of nodes. By introducing long-range coherence along spatial and channel dimensions, the complementarity of pixel relations and channel interdependencies aids in the reconstruction of aligned multi-view features.
  arXiv  Detail & Related papers  (2023-07-31T15:04:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.