Gated Spatial Redundancy Projection for Pathology Transformer Attentions

• URL: http://arxiv.org/abs/2608.08374v2
• Date: Wed, 12 Aug 2026 19:21:05 GMT
• Title: Gated Spatial Redundancy Projection for Pathology Transformer Attentions
• Abstract summary: Gated Spatial Redundancy Projection (Gated SRP) is a lightweight correction module for self-attention layers.<n>Gated SRP estimates a local redundancy axis from neighbouring value, projects the attention output onto this axis, and applies a learned signed gate to correct the redundancy-aligned component geometrically.
• Score: 9.268049949671958
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Transformer models are increasingly used for whole-slide image analysis in computational pathology. Yet, WSIs differ fundamentally from natural images: neighbouring patches often contain highly similar tissue type, stain, texture, and cellular composition. We identify this local spatial redundancy as a pathology-specific failure mode of self-attention, where dominant neighbourhood features can be repeatedly mixed into patch-tokens and weaken subtle diagnostic or prognostic deviations. We propose Gated Spatial Redundancy Projection (Gated SRP), a lightweight drop-in correction module for self-attention layers. For each patch token and attention head, Gated SRP estimates a local redundancy axis from neighbouring value vectors, projects the attention output onto this axis, and applies a learned signed gate to correct the redundancy-aligned component geometrically. Across five TCGA survival cohorts, Gated SRP obtains the highest mean C-index among the compared attention variants in all cohorts, with an average improvement over the base attention, while adding only +0.02% parameters. Across five slide-level classification datasets, it improves the base attention on 12 of 16 reported metrics and achieves the best AUC on three datasets. Code is publicly available at https://github.com/AtlasAnalyticsLab/GatedSRP.

Related papers

• Bridging Vision Foundation Model Priors with CLIP for Spatial-aware Few-shot Anomaly Detection in Medical Images [48.646448077284276]
  We propose Spatial-FAD, a framework for effective few-shot medical anomaly detection.<n>It improves lesion localization by combining VFM spatial priors with CLIP semantics.<n>Our method achieves an average improvement of over 11.4% in Dice score and 1.8% in AUC.
  arXiv  Detail & Related papers  (2026-09-11T05:21:01Z)
• Explaining RhythmFormer: A Systematic XAI Analysis of Periodic Sparse Attention for Remote Photoplethysmography [1.647210198730602]
  Photoplethys transformers achieve low heart-rate error on benchmarks, yet their decisions remain opaque.<n>Existing XAI is dominated by qualitative heatmap inspection without quantitative faithfulness metrics or physiology-grounded validation.<n>We adapt four methods (raw attention, rollout, flow, Beyond Intuition) to quantifying RhythmFormer's bi-level attention with top-$k$ selection.
  arXiv  Detail & Related papers  (2026-06-11T19:10:06Z)
• HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation [50.46910397782266]
  Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real HSIs suffer from degradations like noise, blur, and resolution loss.<n>We present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances hyperspectral image restoration by augmenting limited training images with synthetic data that closely matches the target distribution using no extra data.
  arXiv  Detail & Related papers  (2026-05-13T14:14:13Z)
• Deep EM with Hierarchical Latent Label Modelling for Multi-Site Prostate Lesion Segmentation [12.493998903996589]
  We propose a hierarchical expectation-maximisation (HierEM) framework that alternates between inferring a voxel-wise posterior distribution over the latent mask, and training a CNN using this posterior as a soft target.<n> Experiments on three cohorts demonstrate that the proposed hierarchical EM framework enhances cross-site generalisation.
  arXiv  Detail & Related papers  (2026-03-15T15:03:20Z)
• Using Unsupervised Domain Adaptation Semantic Segmentation for Pulmonary Embolism Detection in Computed Tomography Pulmonary Angiogram (CTPA) Images [0.0]
  unsupervised domain adaptation (UDA) framework is proposed, utilizing a Transformer backbone and a Mean-Teacher architecture for cross-center semantic segmentation.<n>The primary focus is placed on enhancing pseudo-label reliability by learning deep structural information within the feature space.<n> Experimental validation conducted on cross-center datasets (FUMPE and CAD-PE) demonstrates significant performance gains.
  arXiv  Detail & Related papers  (2026-02-23T14:33:24Z)
• UWarp: A Whole Slide Image Registration Pipeline to Characterize Scanner-Induced Local Domain Shift [0.8636895084411372]
  We present a domain shift analysis framework based on UWarp, a novel registration tool to align histological slides scanned under varying conditions.<n>Experiments demonstrate that UWarp outperforms existing open-source registration methods, achieving a median target registration error (TRE) of less than 4 pixels.<n>We apply UWarp to characterize scanner-induced local domain shift in the predictions of Breast-NEOprAIdict, a deep learning model for breast cancer pathological response prediction.
  arXiv  Detail & Related papers  (2025-03-26T15:48:38Z)
• ConDiSR: Contrastive Disentanglement and Style Regularization for Single Domain Generalization [42.810247034149214]
  Medical data often exhibits distribution shifts, which cause test-time performance degradation for deep learning models trained using standard pipelines. This study highlights the importance and challenges of exploring Single Domain Generalization frameworks in the context of the classification task.
  arXiv  Detail & Related papers  (2024-03-14T13:50:44Z)
• A graph-transformer for whole slide image classification [11.968797693846476]
  We present a Graph-Transformer (GT) that fuses a graph-based representation of an whole slide image (WSI) and a vision transformer for processing pathology images, called GTP, to predict disease grade. Our findings demonstrate GTP as an interpretable and effective deep learning framework for WSI-level classification.
  arXiv  Detail & Related papers  (2022-05-19T16:32:10Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Augmenting Convolutional networks with attention-based aggregation [55.97184767391253]
  We show how to augment any convolutional network with an attention-based global map to achieve non-local reasoning. We plug this learned aggregation layer with a simplistic patch-based convolutional network parametrized by 2 parameters (width and depth) It yields surprisingly competitive trade-offs between accuracy and complexity, in particular in terms of memory consumption.
  arXiv  Detail & Related papers  (2021-12-27T14:05:41Z)
• Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
  This paper explores a relatively less-studied methodology based on classification. We propose new techniques to push its frontier in two aspects. Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
  arXiv  Detail & Related papers  (2020-11-19T05:42:02Z)
• Collaborative Boundary-aware Context Encoding Networks for Error Map Prediction [65.44752447868626]
  We propose collaborative boundaryaware context encoding networks called AEP-Net for error prediction task. Specifically, we propose a collaborative feature transformation branch for better feature fusion between images and masks, and precise localization of error regions. The AEP-Net achieves an average DSC of 0.8358, 0.8164 for error prediction task, and shows a high Pearson correlation coefficient of 0.9873.
  arXiv  Detail & Related papers  (2020-06-25T12:42:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.