HistDiST: Histopathological Diffusion-based Stain Transfer
- URL: http://arxiv.org/abs/2505.06793v2
- Date: Fri, 19 Sep 2025 09:55:38 GMT
- Title: HistDiST: Histopathological Diffusion-based Stain Transfer
- Abstract summary: HistDiST is a Latent Diffusion Model (LDM) based framework for high-fidelity H&E-to-IHC translation.<n>HistDiST significantly outperforms existing methods, achieving a 28% improvement in MRA on evaluations H&E-to-Ki6767.
- Score: 4.936165689668498
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Hematoxylin and Eosin (H&E) staining is the cornerstone of histopathology but lacks molecular specificity. While Immunohistochemistry (IHC) provides molecular insights, it is costly and complex, motivating H&E-to-IHC translation as a cost-effective alternative. Existing translation methods are mainly GAN-based, often struggling with training instability and limited structural fidelity, while diffusion-based approaches remain underexplored. We propose HistDiST, a Latent Diffusion Model (LDM) based framework for high-fidelity H&E-to-IHC translation. HistDiST introduces a dual-conditioning strategy, utilizing Phikon-extracted morphological embeddings alongside VAE-encoded H&E representations to ensure pathology-relevant context and structural consistency. To overcome brightness biases, we incorporate a rescaled noise schedule, v-prediction, and trailing timesteps, enforcing a zero-SNR condition at the final timestep. During inference, DDIM inversion preserves the morphological structure, while an eta-cosine noise schedule introduces controlled stochasticity, balancing structural consistency and molecular fidelity. Moreover, we propose Molecular Retrieval Accuracy (MRA), a novel pathology-aware metric leveraging GigaPath embeddings to assess molecular relevance. Extensive evaluations on MIST and BCI datasets demonstrate that HistDiST significantly outperforms existing methods, achieving a 28% improvement in MRA on the H&E-to-Ki67 translation task, highlighting its effectiveness in capturing true IHC semantics.
Related papers
- Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment [55.16957949238588]
We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer.<n>It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency.<n>To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples.
arXiv Detail & Related papers (2026-07-28T07:54:43Z) - Dementia Etiology Diagnosis via Collaborative Meta Knowledge Enhancement [81.27196033392559]
We propose a Collaborative Meta Knowledge Enhancement (COME) framework for dementia etiology diagnosis.<n>COME injects multi-center acquisition semantics, source identifiers, and modality indicators as heterogeneity-aware embeddings into a unified Transformer architecture for scale-up training.<n>Our method achieves state-of-the-art in-domain performance with a mean macro-averaged AUC of 85.62% and a 4.29-point gain over the strongest baseline.
arXiv Detail & Related papers (2026-07-24T04:26:47Z) - Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model [43.24445461533517]
We present a spatial transcriptomics-guided alignment framework for Molecular Profiling (STAMP)<n>STAMP applies a pathway-informed alignment strategy that aggregates transcriptomic data into biologically functional pathways.<n>The clinical utility of these augmented representations was validated through a multi-tier evaluation framework.
arXiv Detail & Related papers (2026-05-29T16:41:14Z) - Multi-View Synergistic Learning with Vision-Language Adaption for Low-Resource Biomedical Image Classification [59.24009931000134]
Multi-View Synergistic Learning (MVSL) is a unified framework that addresses adaptation paradigms, representation granularity, and disease semantic relationships.<n>MVSL decouples the adaptation of visual and textual encoders to respect their distinct representational characteristics.<n>It further introduces multi-granularity contrastive learning to explicitly model both global image semantics and localized lesion-level evidence.<n>MVSL consistently outperforms state-of-the-art methods in few-shot and zero-shot classification settings.
arXiv Detail & Related papers (2026-04-27T02:41:27Z) - HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology [3.5196641463125]
HistDiT architecture establishes a new benchmark for visual fidelity in virtual histological staining.<n>Our model outperforms existing baselines as demonstrated through rigorous quantitative and qualitative evaluations.
arXiv Detail & Related papers (2026-04-09T14:39:37Z) - Prototype-driven fusion of pathology and spatial transcriptomics for interpretable survival prediction [0.17835405096329152]
Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL)<n> spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.<n>We introduce PathoSpatial, an interpretable end-to-end framework integrating WSIs and ST to learn spatially informed prognostic representations.
arXiv Detail & Related papers (2026-02-12T21:59:07Z) - UniPACT: A Multimodal Framework for Prognostic Question Answering on Raw ECG and Structured EHR [15.533178197005208]
We propose a unified framework for prognostic question answering that bridges this modality gap.<n>UniPACT's core contribution is a structured prompting mechanism that converts numerical EHR data into semantically rich text.<n>We evaluate it on the comprehensive MDS-ED benchmark, it achieves a state-of-the-art mean AUROC of 89.37% across a diverse set of prognostic tasks.
arXiv Detail & Related papers (2026-01-25T17:35:52Z) - How well can off-the-shelf LLMs elucidate molecular structures from mass spectra using chain-of-thought reasoning? [51.286853421822705]
Large language models (LLMs) have shown promise for reasoning-intensive scientific tasks, but their capability for chemical interpretation is still unclear.<n>We introduce a Chain-of-Thought (CoT) prompting framework and benchmark that evaluate how LLMs reason about mass spectral data to predict molecular structures.<n>Our evaluation across metrics of SMILES validity, formula consistency, and structural similarity reveals that while LLMs can produce syntactically valid and partially plausible structures, they fail to achieve chemical accuracy or link reasoning to correct molecular predictions.
arXiv Detail & Related papers (2026-01-09T20:08:42Z) - A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
arXiv Detail & Related papers (2025-12-15T10:22:43Z) - From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC [37.284994932355865]
We introduce Star-Diff, a structure-aware staining restoration diffusion model that reformulates virtual staining as an image restoration task.<n>By combining residual and noise-based generation pathways, Star-Diff maintains tissue structure while modeling realistic biomarker variability.<n> Experiments on the BCI dataset demonstrate that Star-Diff achieves state-of-the-art (SOTA) performance in both visual fidelity and diagnostic relevance.
arXiv Detail & Related papers (2025-08-04T15:36:58Z) - Conditional Chemical Language Models are Versatile Tools in Drug Discovery [0.0]
We present SAFE-T, a chemical modeling framework that conditions on biological context to prioritize molecules.<n>It supports principled scoring of molecules across tasks such as virtual screening, drug-target interaction prediction, and activity cliff detection.<n>It consistently achieves performance comparable to or better than existing approaches.
arXiv Detail & Related papers (2025-07-14T13:42:39Z) - USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining [4.4558198609443345]
We propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN.<n>We remove weakly paired terms in the joint marginal distribution, thereby significantly improving the content consistency and pathological semantic consistency of the generated results.<n>Our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance.
arXiv Detail & Related papers (2025-07-08T10:14:04Z) - SCFANet: Style Distribution Constraint Feature Alignment Network For Pathological Staining Translation [0.11999555634662631]
Style Distribution Constraint Feature Alignment Network (SCFANet)<n>SCFANet incorporates two innovative modules: the Style Distribution Constrainer (SDC) and Feature Alignment Learning (FAL)<n>Our SCFANet model outperforms existing methods, achieving precise transformation of H&E-stained images into their IHC-stained counterparts.
arXiv Detail & Related papers (2025-04-01T07:29:53Z) - PH2ST:ST-Prompt Guided Histological Hypergraph Learning for Spatial Gene Expression Prediction [9.420121324844066]
We propose PH2ST, a prompt-guided hypergraph learning framework, to guide multi-scale histological representation learning for spatial gene expression prediction.<n> PH2ST not only outperforms existing state-of-the-art methods, but also shows strong potential for practical applications such as imputing missing spots, ST super-resolution, and local-to-global prediction.
arXiv Detail & Related papers (2025-03-21T03:10:43Z) - MIRROR: Multi-Modal Pathological Self-Supervised Representation Learning via Modality Alignment and Retention [52.106879463828044]
Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease.<n>We present MIRROR, a novel multi-modal representation learning method designed to foster both modality alignment and retention.<n>Extensive evaluations on TCGA cohorts for cancer subtyping and survival analysis highlight MIRROR's superior performance.
arXiv Detail & Related papers (2025-03-01T07:02:30Z) - Detecting Neurocognitive Disorders through Analyses of Topic Evolution and Cross-modal Consistency in Visual-Stimulated Narratives [84.03001845263]
Early detection of neurocognitive disorders (NCDs) is crucial for timely intervention and disease management.<n>We propose two novel dynamic macrostructural approaches to measure cross-modal consistency between speech and visual stimuli.<n> Experimental results validated the efficiency of proposed approaches in NCD detection, with TITAN achieving superior performance both on the CU-MARVEL-RABBIT corpus and the ADReSS corpus.
arXiv Detail & Related papers (2025-01-07T12:16:26Z) - TopoTxR: A topology-guided deep convolutional network for breast parenchyma learning on DCE-MRIs [49.69047720285225]
We propose a novel topological approach that explicitly extracts multi-scale topological structures to better approximate breast parenchymal structures.
We empirically validate emphTopoTxR using the VICTRE phantom breast dataset.
Our qualitative and quantitative analyses suggest differential topological behavior of breast tissue in treatment-na"ive imaging.
arXiv Detail & Related papers (2024-11-05T19:35:10Z) - Advancing H&E-to-IHC Stain Translation in Breast Cancer: A Multi-Magnification and Attention-Based Approach [13.88935300094334]
We propose a novel model integrating attention mechanisms and multi-magnification information processing.
Our model employs a multi-magnification processing strategy to extract and utilize information from various magnifications within pathology images.
Rigorous testing on a publicly available breast cancer dataset demonstrates superior performance compared to existing methods.
arXiv Detail & Related papers (2024-08-04T04:55:10Z) - An interpretable generative multimodal neuroimaging-genomics framework for decoding Alzheimer's disease [13.213387075528017]
Alzheimer's disease (AD) is the most prevalent form of dementia worldwide, encompassing a prodromal stage known as Mild Cognitive Impairment (MCI)<n>The objective of the work was to capture structural and functional modulations of brain structure and function relying on multimodal MRI data and Single Nucleotide Polymorphisms.
arXiv Detail & Related papers (2024-06-19T07:31:47Z) - Mix-Domain Contrastive Learning for Unpaired H&E-to-IHC Stain Translation [14.719264181466766]
We propose a Mix-Domain Contrastive Learning method to leverage the supervision information in unpaired H&E-to-IHC stain translation.
With the mix-domain pathology information aggregation, MDCL enhances the pathological consistency between the corresponding patches and the component discrepancy of the patches from the different positions of the generated IHC image.
arXiv Detail & Related papers (2024-06-17T17:47:44Z) - Boundary Guided Semantic Learning for Real-time COVID-19 Lung Infection
Segmentation System [69.40329819373954]
The coronavirus disease 2019 (COVID-19) continues to have a negative impact on healthcare systems around the world.
At the current stage, automatically segmenting the lung infection area from CT images is essential for the diagnosis and treatment of COVID-19.
We propose a boundary guided semantic learning network (BSNet) in this paper.
arXiv Detail & Related papers (2022-09-07T05:01:38Z) - Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based
Sparse PCA Network [93.22587316229954]
We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E)
We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
arXiv Detail & Related papers (2021-10-27T19:28:36Z) - Efficient Learning and Decoding of the Continuous-Time Hidden Markov
Model for Disease Progression Modeling [119.50438407358862]
We present the first complete characterization of efficient EM-based learning methods for CT-HMM models.
We show that EM-based learning consists of two challenges: the estimation of posterior state probabilities and the computation of end-state conditioned statistics.
We demonstrate the use of CT-HMMs with more than 100 states to visualize and predict disease progression using a glaucoma dataset and an Alzheimer's disease dataset.
arXiv Detail & Related papers (2021-10-26T20:06:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.