From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology

• URL: http://arxiv.org/abs/2608.03508v2
• Date: Thu, 13 Aug 2026 06:18:40 GMT
• Title: From Multi-Resolution Cells to Gigapixel Whole Slide Images Foundation Model for Computational Pathology
• Abstract summary: Multi-Resolution Pyramid Transformer (MRPT)<n>Pre-trained in a multi-resolution self-supervised manner on 624M patches, 2.4M regions, and 36K Whole Slide Images (WSIs)
• Score: 40.79247708160045
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Vision Transformers (ViTs) and their hierarchical variants have achieved strong performance in Computational Pathology (CPath). However, most are pre-trained on single-resolution Whole Slide Images (WSIs), limiting their generalization across arbitrary resolutions. Gigapixel WSIs inherently contain diagnostic patterns at multiple scales, including cellular morphologies, tissue architectures, and global context, mirroring how expert pathologists examine WSIs. We introduce Multi-Resolution Pyramid Transformer (MRPT), a model that hierarchically aggregates multi-resolution information from cellular to tissue and WSI levels. MRPT employs a biologically meaningful Consecutive Cross-Resolution Attention (CCRA) mechanism to capture scale-independent interactions and enforces multi-resolution semantic consistency by aligning embeddings across resolutions, yielding robust and generalizable WSI representations. Pre-trained in a multi-resolution self-supervised manner on 624M patches, 2.4M regions, and 36K WSIs, MRPT learns rich coarse-to-fine histopathology features. Extensive experiments on 34 diverse datasets show that MRPT surpasses recent foundation models and Multimodal Large Language Models (MLLMs) in cancer subtype classification, tissue phenotyping, and Visual Question Answering (VQA) for WSI understanding.

Related papers

• MuViT: Multi-Resolution Vision Transformers for Learning Across Scales in Microscopy [1.9116784879310027]
  We introduce MuViT, a transformer architecture built to fuse true multi-resolution observations from the same underlying image.<n>Across synthetic benchmarks, kidney histopathology, and high-resolution mouse-brain microscopy, MuViT delivers consistent improvements over strong ViT and CNN baselines.
  arXiv  Detail & Related papers  (2026-02-27T17:48:54Z)
• Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentation [56.52520416420957]
  We propose Multimodal Causal-Driven Representation Learning (MCDRL) to tackle domain generalization in medical image segmentation.<n>MCDRL consistently outperforms competing methods, yielding superior segmentation accuracy and exhibiting robust generalizability.
  arXiv  Detail & Related papers  (2025-08-07T03:41:41Z)
• WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Image [39.06747701238473]
  We present WSI-LLaVA, a framework for gigapixel WSI understanding that employs a three-stage training approach.<n> Experimental results demonstrate that WSI-LLaVA outperforms existing models across all capability dimensions.
  arXiv  Detail & Related papers  (2024-12-03T03:57:24Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.<n>Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• URCDM: Ultra-Resolution Image Synthesis in Histopathology [4.393805955844748]
  Ultra-Resolution Cascaded Diffusion Models (URCDMs) are capable of synthesising entire histopathology images at high resolutions. We evaluate our method on three separate datasets, consisting of brain, breast and kidney tissue. URCDMs consistently generate outputs across various resolutions that trained evaluators cannot distinguish from real images.
  arXiv  Detail & Related papers  (2024-07-18T08:31:55Z)
• PLUTO: Pathology-Universal Transformer [4.920983796208486]
  We propose PathoLogy Universal TransfOrmer (PLUTO): a light-weight pathology FM that is pre-trained on a diverse dataset of 195 million image tiles. We design task-specific adaptation heads that utilize PLUTO's output embeddings for tasks which span pathology scales. We find that PLUTO matches or outperforms existing task-specific baselines and pathology-specific foundation models.
  arXiv  Detail & Related papers  (2024-05-13T16:40:17Z)
• A self-supervised framework for learning whole slide representations [52.774822784847565]
  We present Slide Pre-trained Transformers (SPT) for gigapixel-scale self-supervision of whole slide images. We benchmark SPT visual representations on five diagnostic tasks across three biomedical microscopy datasets.
  arXiv  Detail & Related papers  (2024-02-09T05:05:28Z)
• AMIGO: Sparse Multi-Modal Graph Transformer with Shared-Context Processing for Representation Learning of Giga-pixel Images [53.29794593104923]
  We present a novel concept of shared-context processing for whole slide histopathology images. AMIGO uses the celluar graph within the tissue to provide a single representation for a patient. We show that our model is strongly robust to missing information to an extent that it can achieve the same performance with as low as 20% of the data.
  arXiv  Detail & Related papers  (2023-03-01T23:37:45Z)
• Diagnose Like a Pathologist: Transformer-Enabled Hierarchical Attention-Guided Multiple Instance Learning for Whole Slide Image Classification [39.41442041007595]
  Multiple Instance Learning and transformers are increasingly popular in histopathology Whole Slide Image (WSI) classification. We propose a Hierarchical Attention-Guided Multiple Instance Learning framework to fully exploit the WSIs. Within this framework, an Integrated Attention Transformer is proposed to further enhance the performance of the transformer.
  arXiv  Detail & Related papers  (2023-01-19T15:38:43Z)
• Hierarchical Transformer for Survival Prediction Using Multimodality Whole Slide Images and Genomics [63.76637479503006]
  Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. This paper proposes a hierarchical-based multimodal transformer framework that learns a hierarchical mapping between pathology images and corresponding genes. Our architecture requires fewer GPU resources compared with benchmark methods while maintaining better WSI representation ability.
  arXiv  Detail & Related papers  (2022-11-29T23:47:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.