SpaCRD: Multimodal Deep Fusion of Histology and Spatial Transcriptomics for Cancer Region Detection

• URL: http://arxiv.org/abs/2603.06186v1
• Date: Fri, 06 Mar 2026 11:46:33 GMT
• Title: SpaCRD: Multimodal Deep Fusion of Histology and Spatial Transcriptomics for Cancer Region Detection
• Abstract summary: We propose SpaCRD, a transfer learning-based method that deeply integrates histology images and ST data to enable reliable CTR detection.<n>Once trained on source data, SpaCRD can be readily generalized to accurately detect cancerous regions across samples from different platforms and batches.
• Score: 28.47842822036658
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate detection of cancer tissue regions (CTR) enables deeper analysis of the tumor microenvironment and offers crucial insights into treatment response. Traditional CTR detection methods, which typically rely on the rich cellular morphology in histology images, are susceptible to a high rate of false positives due to morphological similarities across different tissue regions. The groundbreaking advances in spatial transcriptomics (ST) provide detailed cellular phenotypes and spatial localization information, offering new opportunities for more accurate cancer region detection. However, current methods are unable to effectively integrate histology images with ST data, especially in the context of cross-sample and cross-platform/batch settings for accomplishing the CTR detection. To address this challenge, we propose SpaCRD, a transfer learning-based method that deeply integrates histology images and ST data to enable reliable CTR detection across diverse samples, platforms, and batches. Once trained on source data, SpaCRD can be readily generalized to accurately detect cancerous regions across samples from different platforms and batches. The core of SpaCRD is a category-regularized variational reconstruction-guided bidirectional cross-attention fusion network, which enables the model to adaptively capture latent co-expression patterns between histological features and gene expression from multiple perspectives. Extensive benchmark analysis on 23 matched histology-ST datasets spanning various disease types, platforms, and batches demonstrates that SpaCRD consistently outperforms existing eight state-of-the-art methods in CTR detection.

Related papers

• Whole-body CT attenuation and volume charts from routine clinical scans via evidence-grounded LLM report filtering [5.261511162432881]
  We develop an evidence-grounded, cross-verified large language model ensemble to filter pathological findings from radiology reports.<n>Five LLMs, first, flag structure-level abnormality candidates grounded in verbatim report evidence.<n>We establish comprehensive whole-body reference charts for 106 anatomical structures across adulthood, accounting for age, sex, contrast enhancement, and acquisition parameters.
  arXiv  Detail & Related papers  (2026-05-07T09:40:01Z)
• Cross-Slice Knowledge Transfer via Masked Multi-Modal Heterogeneous Graph Contrastive Learning for Spatial Gene Expression Inference [7.79162872496708]
  SpaHGC is a graph-based model that captures both intra-slice and inter-slice spot-spot relationships from histology images.<n>It integrates local spatial context within the target slide and cross-slide similarities computed from image embeddings extracted by a pathology foundation model.<n>SpaHGC significantly outperforms the existing nine state-of-the-art methods across all evaluation metrics.
  arXiv  Detail & Related papers  (2026-03-24T05:49:00Z)
• A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
  We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
  arXiv  Detail & Related papers  (2025-12-15T10:22:43Z)
• Boosting Pathology Foundation Models via Few-shot Prompt-tuning for Rare Cancer Subtyping [80.92960114162746]
  We propose PathPT, a novel framework that exploits the potential of vision-language pathology foundation models.<n>PathPT converts WSI-level supervision into fine-grained tile-level guidance by leveraging the zero-shot capabilities of VL models.<n>Results show that PathPT consistently delivers superior performance, achieving substantial gains in subtyping accuracy and cancerous region grounding ability.
  arXiv  Detail & Related papers  (2025-08-21T18:04:41Z)
• MEATRD: Multimodal Anomalous Tissue Region Detection Enhanced with Spatial Transcriptomics [11.792057304685692]
  We propose MEATRD, a novel ATR detection method that integrates histology image and ST data.<n>MEATRD is trained to reconstruct image patches and gene expression profiles of normal tissue spots from their multimodal embeddings.<n>Extensive evaluations across eight real ST datasets reveal MEATRD's superior performance in ATR detection.
  arXiv  Detail & Related papers  (2024-12-14T03:09:04Z)
• TopOC: Topological Deep Learning for Ovarian and Breast Cancer Diagnosis [3.262230127283452]
  Topological data analysis offers a unique approach by extracting essential information through the evaluation of topological patterns across different color channels. We show that the inclusion of topological features significantly improves the differentiation of tumor types in ovarian and breast cancers.
  arXiv  Detail & Related papers  (2024-10-13T12:24:13Z)
• Lesion-Aware Cross-Phase Attention Network for Renal Tumor Subtype Classification on Multi-Phase CT Scans [17.708032663036512]
  Multi-phase computed tomography (CT) has been widely used for the preoperative diagnosis of kidney cancer. Deep learning-based approaches have been recently explored for differential diagnosis of kidney cancer, but they do not explicitly model the relationships between CT phases in the network design. We propose a novel lesion-aware cross-phase attention network (LACPANet) that can effectively capture temporal dependencies of renal lesions across CT phases.
  arXiv  Detail & Related papers  (2024-06-24T05:15:15Z)
• Classification of lung cancer subtypes on CT images with synthetic pathological priors [41.75054301525535]
  Cross-scale associations exist in the image patterns between the same case's CT images and its pathological images. We propose self-generating hybrid feature network (SGHF-Net) for accurately classifying lung cancer subtypes on CT images.
  arXiv  Detail & Related papers  (2023-08-09T02:04:05Z)
• Correlated Feature Aggregation by Region Helps Distinguish Aggressive from Indolent Clear Cell Renal Cell Carcinoma Subtypes on CT [1.455251203143627]
  Renal cell carcinoma (RCC) is a common cancer that varies in clinical behavior. Determining aggressiveness on CT images is clinically important as it facilitates risk stratification and treatment planning. This study aims to use machine learning methods to identify radiology features that correlate with features on pathology to facilitate assessment of cancer aggressiveness on CT images instead of histology.
  arXiv  Detail & Related papers  (2022-09-29T09:39:31Z)
• Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays [65.88435151891369]
  Radiomics-Guided Transformer (RGT) fuses textitglobal image information with textitlocal knowledge-guided radiomics information. RGT consists of an image Transformer branch, a radiomics Transformer branch, and fusion layers that aggregate image and radiomic information.
  arXiv  Detail & Related papers  (2022-07-10T06:32:56Z)
• Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based Sparse PCA Network [93.22587316229954]
  We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E) We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
  arXiv  Detail & Related papers  (2021-10-27T19:28:36Z)
• Topological Data Analysis of copy number alterations in cancer [70.85487611525896]
  We explore the potential to capture information contained in cancer genomic information using a novel topology-based approach. We find that this technique has the potential to extract meaningful low-dimensional representations in cancer somatic genetic data.
  arXiv  Detail & Related papers  (2020-11-22T17:31:23Z)
• Co-Heterogeneous and Adaptive Segmentation from Multi-Source and Multi-Phase CT Imaging Data: A Study on Pathological Liver and Lesion Segmentation [48.504790189796836]
  We present a novel segmentation strategy, co-heterogenous and adaptive segmentation (CHASe) We propose a versatile framework that fuses appearance based semi-supervision, mask based adversarial domain adaptation, and pseudo-labeling. CHASe can further improve pathological liver mask Dice-Sorensen coefficients by ranges of $4.2% sim 9.4%$.
  arXiv  Detail & Related papers  (2020-05-27T06:58:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.