Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model
- URL: http://arxiv.org/abs/2606.03644v1
- Date: Fri, 29 May 2026 16:41:14 GMT
- Title: Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model
- Abstract summary: We present a spatial transcriptomics-guided alignment framework for Molecular Profiling (STAMP)<n>STAMP applies a pathway-informed alignment strategy that aggregates transcriptomic data into biologically functional pathways.<n>The clinical utility of these augmented representations was validated through a multi-tier evaluation framework.
- Score: 43.24445461533517
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times. While pathology foundation models (PFMs) have demonstrated potential for inferring molecular phenotypes from routine hematoxylin and eosin (H&E) whole-slide images (WSIs), current architectures primarily rely on vision-centric self-supervised learning or vision-language alignment, lacking the spatially resolved molecular supervision required to connect subtle morphological features with underlying genomic alterations. Spatial transcriptomics (ST) emerges as a transformative technology that enables transcriptomic quantification within intact tissue sections, thereby preserving the precise spatial link between histology and molecular profiles. In this study, we present a Spatial Transcriptomics-guided Alignment framework for Molecular Profiling (STAMP), which endows PFMs with intrinsic molecular awareness. To support this paradigm, we curated HumanST-1k, a human ST dataset spanning diverse anatomical organs and sequencing platforms. This atlas yields 1.8 million pairs of H&E patches and corresponding transcriptomic profiles, providing a corpus that links histological structures with their molecular states. To mitigate the technical noise inherent to raw transcriptomics, STAMP applies a pathway-informed alignment strategy that aggregates transcriptomic data into biologically functional pathways, which are subsequently integrated into PFMs via parameter-efficient fine-tuning. This alignment enriches the representation space of PFMs and unlocks their capacity to resolve sub-visual molecular signatures. The clinical utility of these augmented representations was validated through a multi-tier evaluation framework.
Related papers
- PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images [51.428093790826814]
We propose pathology Autorgressive modeling (PathAR) to factorize structure and appearance for modality-label-conditioned pathology generation.<n>PathAR stabilizes morphology under heterogeneous modality-specific appearances and enables spatially aligned image-mask pair generation.
arXiv Detail & Related papers (2026-06-01T01:43:48Z) - A Multimodal Foundation Model of Spatial Transcriptomics and Histology for Biological Discovery and Clinical Prediction [13.466764029232898]
We present textbfours (textbfSpatial textbfTranscriptomics and histtextbfOlogy textbfRepresentation textbfModel), a foundation model trained on 1.2 million spatially resolved transcriptomic profiles with matched histology across 18 organs.
arXiv Detail & Related papers (2026-04-04T08:00:26Z) - MINT: Molecularly Informed Training with Spatial Transcriptomics Supervision for Pathology Foundation Models [5.15189458127282]
We propose MINT, a fine-tuning framework that incorporates spatial transcriptomics supervision into pretrained pathology Vision Transformers.<n> MINT appends a learnable ST token to the ViT input to encode transcriptomic information separately from the morphological CLS token.<n> MINT achieves the best overall performance on both HEST-Bench for gene expression prediction and general pathology tasks.
arXiv Detail & Related papers (2026-03-09T02:29:10Z) - Towards Spatial Transcriptomics-driven Pathology Foundation Models [32.70436266943553]
We introduce a vision-omics self-supervised learning framework that infuses localized molecular information into pathology vision encoders.<n>We instantiate SEAL by training on over 700,000 paired gene expression spot-tissue region examples spanning tumor and normal samples from 14 organs.<n> SEAL encoders exhibit robust domain generalization on out-of-distribution and enable new cross-modal capabilities such as gene-to-image retrieval.
arXiv Detail & Related papers (2026-02-15T15:06:45Z) - Fusing Pixels and Genes: Spatially-Aware Learning in Computational Pathology [46.83014413674925]
STAMP is a spatial transcriptomics-augmented multimodal pathology representation learning framework.<n>Our study shows that self-supervised, gene-guided training provides a robust and task-agnostic signal for learning pathology image representations.<n>We validate STAMP across six datasets and four downstream tasks, where it consistently achieves strong performance.
arXiv Detail & Related papers (2026-02-15T00:59:13Z) - Aligned Manifold Property and Topology Point Clouds for Learning Molecular Properties [55.2480439325792]
This work introduces AMPTCR, a molecular surface representation that combines local quantum-derived scalar fields and custom topological descriptors within an aligned point cloud format.<n>For molecular weight, results confirm that AMPTCR encodes physically meaningful data, with a validation R2 of 0.87.<n>In the bacterial inhibition task, AMPTCR enables both classification and direct regression of E. coli inhibition values.
arXiv Detail & Related papers (2025-07-22T04:35:50Z) - MIRROR: Multi-Modal Pathological Self-Supervised Representation Learning via Modality Alignment and Retention [57.044719143401664]
Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease.<n>We present MIRROR, a novel multi-modal representation learning method designed to foster both modality alignment and retention.<n>Extensive evaluations on TCGA cohorts for cancer subtyping and survival analysis highlight MIRROR's superior performance.
arXiv Detail & Related papers (2025-03-01T07:02:30Z) - Pre-trained Molecular Language Models with Random Functional Group Masking [54.900360309677794]
We propose a SMILES-based underlineem Molecular underlineem Language underlineem Model, which randomly masking SMILES subsequences corresponding to specific molecular atoms.
This technique aims to compel the model to better infer molecular structures and properties, thus enhancing its predictive capabilities.
arXiv Detail & Related papers (2024-11-03T01:56:15Z) - Focus on Focus: Focus-oriented Representation Learning and Multi-view Cross-modal Alignment for Glioma Grading [15.492493684721175]
multimodal deep learning has achieved a promising performance in glioma grading.
We introduce a novel Focus on Focus (FoF) framework with paired pathology-genomic training and applicable pathology-only inference.
Experiments on the TCGA GBM-LGG dataset demonstrate that our FoF framework significantly improves the glioma grading.
arXiv Detail & Related papers (2024-08-16T04:54:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.