From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC
- URL: http://arxiv.org/abs/2508.02528v1
- Date: Mon, 04 Aug 2025 15:36:58 GMT
- Title: From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC
- Authors: Jingsong Liu, Xiaofeng Deng, Han Li, Azar Kazemi, Christian Grashei, Gesa Wilkens, Xin You, Tanja Groll, Nassir Navab, Carolin Mogler, Peter J. Schüffler,
- Abstract summary: We introduce Star-Diff, a structure-aware staining restoration diffusion model that reformulates virtual staining as an image restoration task.<n>By combining residual and noise-based generation pathways, Star-Diff maintains tissue structure while modeling realistic biomarker variability.<n> Experiments on the BCI dataset demonstrate that Star-Diff achieves state-of-the-art (SOTA) performance in both visual fidelity and diagnostic relevance.
- Score: 37.284994932355865
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Hematoxylin and eosin (H&E) staining is the clinical standard for assessing tissue morphology, but it lacks molecular-level diagnostic information. In contrast, immunohistochemistry (IHC) provides crucial insights into biomarker expression, such as HER2 status for breast cancer grading, but remains costly and time-consuming, limiting its use in time-sensitive clinical workflows. To address this gap, virtual staining from H&E to IHC has emerged as a promising alternative, yet faces two core challenges: (1) Lack of fair evaluation of synthetic images against misaligned IHC ground truths, and (2) preserving structural integrity and biological variability during translation. To this end, we present an end-to-end framework encompassing both generation and evaluation in this work. We introduce Star-Diff, a structure-aware staining restoration diffusion model that reformulates virtual staining as an image restoration task. By combining residual and noise-based generation pathways, Star-Diff maintains tissue structure while modeling realistic biomarker variability. To evaluate the diagnostic consistency of the generated IHC patches, we propose the Semantic Fidelity Score (SFS), a clinical-grading-task-driven metric that quantifies class-wise semantic degradation based on biomarker classification accuracy. Unlike pixel-level metrics such as SSIM and PSNR, SFS remains robust under spatial misalignment and classifier uncertainty. Experiments on the BCI dataset demonstrate that Star-Diff achieves state-of-the-art (SOTA) performance in both visual fidelity and diagnostic relevance. With rapid inference and strong clinical alignment,it presents a practical solution for applications such as intraoperative virtual IHC synthesis.
Related papers
- USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining [4.4558198609443345]
We propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN.<n>We remove weakly paired terms in the joint marginal distribution, thereby significantly improving the content consistency and pathological semantic consistency of the generated results.<n>Our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance.
arXiv Detail & Related papers (2025-07-08T10:14:04Z) - Score-based Diffusion Model for Unpaired Virtual Histology Staining [7.648204151998162]
Hematoxylin and eosin (H&E) staining visualizes histology but lacks specificity for diagnostic markers.<n>Hematoxylin and eosin (H&E) staining provides protein-targeted staining but is restricted by tissue availability and antibody specificity.<n>Virtual staining, i.e., translating the H&E image to its IHC counterpart while preserving tissue structure, is promising for efficient IHC generation.<n>This study proposes a mutual-information (MI)-guided score-based diffusion model for unpaired virtual staining.
arXiv Detail & Related papers (2025-06-29T11:02:45Z) - HistDiST: Histopathological Diffusion-based Stain Transfer [6.197687155055788]
HistDiST is a Latent Diffusion Model (LDM) based framework for high-fidelity H&E-to-IHC translation.<n>HistDiST significantly outperforms existing methods, achieving a 28% improvement in MRA on evaluations H&E-to-Ki6767.
arXiv Detail & Related papers (2025-05-11T00:19:22Z) - SCFANet: Style Distribution Constraint Feature Alignment Network For Pathological Staining Translation [0.11999555634662631]
Style Distribution Constraint Feature Alignment Network (SCFANet)<n>SCFANet incorporates two innovative modules: the Style Distribution Constrainer (SDC) and Feature Alignment Learning (FAL)<n>Our SCFANet model outperforms existing methods, achieving precise transformation of H&E-stained images into their IHC-stained counterparts.
arXiv Detail & Related papers (2025-04-01T07:29:53Z) - GS-TransUNet: Integrated 2D Gaussian Splatting and Transformer UNet for Accurate Skin Lesion Analysis [44.99833362998488]
We present a novel approach that combines 2D Gaussian splatting with the Transformer UNet architecture for automated skin cancer diagnosis.<n>Our findings illustrate significant advancements in the precision of segmentation and classification.<n>This integration sets new benchmarks in the field and highlights the potential for further research into multi-task medical image analysis methodologies.
arXiv Detail & Related papers (2025-02-23T23:28:47Z) - StealthDiffusion: Towards Evading Diffusion Forensic Detection through Diffusion Model [62.25424831998405]
StealthDiffusion is a framework that modifies AI-generated images into high-quality, imperceptible adversarial examples.
It is effective in both white-box and black-box settings, transforming AI-generated images into high-quality adversarial forgeries.
arXiv Detail & Related papers (2024-08-11T01:22:29Z) - Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland
Markers in the Colon [1.741980945827445]
Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading.
Pathologists do need differentchemical (IHC) stains to analyze specific structures or cells.
Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading.
arXiv Detail & Related papers (2023-08-25T05:24:23Z) - Texture Characterization of Histopathologic Images Using Ecological
Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate.
It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
arXiv Detail & Related papers (2022-02-27T02:19:09Z) - Assessing glaucoma in retinal fundus photographs using Deep Feature
Consistent Variational Autoencoders [63.391402501241195]
glaucoma is challenging to detect since it remains asymptomatic until the symptoms are severe.
Early identification of glaucoma is generally made based on functional, structural, and clinical assessments.
Deep learning methods have partially solved this dilemma by bypassing the marker identification stage and analyzing high-level information directly to classify the data.
arXiv Detail & Related papers (2021-10-04T16:06:49Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for
Biomarker Identification and Disease Classification [49.53651166356737]
We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers.
We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
arXiv Detail & Related papers (2021-01-27T19:28:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.