Progressive Translation of H&E to IHC with Enhanced Structural Fidelity
- URL: http://arxiv.org/abs/2511.01698v1
- Date: Mon, 03 Nov 2025 16:06:46 GMT
- Title: Progressive Translation of H&E to IHC with Enhanced Structural Fidelity
- Authors: Yuhang Kang, Ziyu Su, Tianyang Wang, Zaibo Li, Wei Chen, Muhammad Khalid Khan Niazi,
- Abstract summary: Compared to hematoxylin-eosin (H&E) staining, gradientchemistry (IHC) provides high-resolution protein localization.<n>Despite its diagnostic value, IHC remains a costly and labor-intensive technique.<n>We propose a novel network architecture that follows a progressive structure, incorporating color and cell border generation logic.
- Score: 8.881744407746845
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Compared to hematoxylin-eosin (H&E) staining, immunohistochemistry (IHC) not only maintains the structural features of tissue samples, but also provides high-resolution protein localization, which is essential for aiding in pathology diagnosis. Despite its diagnostic value, IHC remains a costly and labor-intensive technique. Its limited scalability and constraints in multiplexing further hinder widespread adoption, especially in resource-limited settings. Consequently, researchers are increasingly exploring computational stain translation techniques to synthesize IHC-equivalent images from H&E-stained slides, aiming to extract protein-level information more efficiently and cost-effectively. However, most existing stain translation techniques rely on a linearly weighted summation of multiple loss terms within a single objective function, strategy that often overlooks the interdepedence among these components-resulting in suboptimal image quality and an inability to simultaneously preserve structural authenticity and color fidelity. To address this limitation, we propose a novel network architecture that follows a progressive structure, incorporating color and cell border generation logic, which enables each visual aspect to be optimized in a stage-wise and decoupled manner. To validate the effectiveness of our proposed network architecture, we build upon the Adaptive Supervised PatchNCE (ASP) framework as our baseline. We introduce additional loss functions based on 3,3'-diaminobenzidine (DAB) chromogen concentration and image gradient, enhancing color fidelity and cell boundary clarity in the generated IHC images. By reconstructing the generation pipeline using our structure-color-cell boundary progressive mechanism, experiments on HER2 and ER datasets demonstrated that the model significantly improved visual quality and achieved finer structural details.
Related papers
- StepVAR: Structure-Texture Guided Pruning for Visual Autoregressive Models [98.72926158261937]
We propose a training-free token pruning framework for Visual AutoRegressive models.<n>We employ a lightweight high-pass filter to capture local texture details, while leveraging Principal Component Analysis (PCA) to preserve global structural information.<n>To maintain valid next-scale prediction under sparse tokens, we introduce a nearest neighbor feature propagation strategy.
arXiv Detail & Related papers (2026-03-02T11:35:05Z) - SaDiT: Efficient Protein Backbone Design via Latent Structural Tokenization and Diffusion Transformers [50.18388227899971]
We present SaDiT, a novel framework that accelerates protein backbone generation by integrating SaProt Tokenization with a Diffusion Transformer (DiT) architecture.<n>Experiments demonstrate that SaDiT outperforms state-of-the-art models, including RFDiffusion and Proteina, in both computational speed and structural viability.
arXiv Detail & Related papers (2026-02-06T13:50:13Z) - Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction [72.80209358480424]
overdose of iodinated contrast media (ICM) can cause kidney damage and life-threatening allergic reactions.<n>Deep learning methods can generate CT images of normal-dose ICM from low-dose ICM, reducing the required dose.<n>We propose a Structure-constrained Language-informed Diffusion Model (SLDM) that integrates structural synergy and spatial intelligence.
arXiv Detail & Related papers (2026-01-28T06:54:06Z) - PAINT: Pathology-Aware Integrated Next-Scale Transformation for Virtual Immunohistochemistry [17.230315436967356]
Virtualchemistry aims to computationally synthesize molecular staining patterns from routine Hematoxylin and Eosin (H&E) images.<n>We propose Pathology-Aware Integrated Next-Scale Transformation (PAINT), a visual autoregressive framework that reformulates the synthesis process as a structure-first conditional generation task.
arXiv Detail & Related papers (2026-01-22T14:49:30Z) - A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
arXiv Detail & Related papers (2025-12-15T10:22:43Z) - Curvilinear Structure-preserving Unpaired Cross-domain Medical Image Translation [29.978321741632197]
Unpaired image-to-image translation has emerged as a crucial technique in medical imaging.<n>Existing approaches often distort fine curvilinear structures, such as microvasculature.<n>We propose Curvilinear Structure-preserving Translation (CST), a framework that explicitly preserves fine curvilinear structures during unpaired translation.
arXiv Detail & Related papers (2025-10-22T15:24:32Z) - PRINTER:Deformation-Aware Adversarial Learning for Virtual IHC Staining with In Situ Fidelity [18.922782766983378]
PRINTER is a weakly-supervised framework that integrates PRototype-drIven content and staiNing patTERn decoupling and deformation-aware adversarial learning strategies.<n>Our work provides a robust and scalable solution for virtual staining, advancing the field of computational pathology.
arXiv Detail & Related papers (2025-09-01T07:53:05Z) - From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC [37.284994932355865]
We introduce Star-Diff, a structure-aware staining restoration diffusion model that reformulates virtual staining as an image restoration task.<n>By combining residual and noise-based generation pathways, Star-Diff maintains tissue structure while modeling realistic biomarker variability.<n> Experiments on the BCI dataset demonstrate that Star-Diff achieves state-of-the-art (SOTA) performance in both visual fidelity and diagnostic relevance.
arXiv Detail & Related papers (2025-08-04T15:36:58Z) - Score-based Diffusion Model for Unpaired Virtual Histology Staining [7.648204151998162]
Hematoxylin and eosin (H&E) staining visualizes histology but lacks specificity for diagnostic markers.<n>Hematoxylin and eosin (H&E) staining provides protein-targeted staining but is restricted by tissue availability and antibody specificity.<n>Virtual staining, i.e., translating the H&E image to its IHC counterpart while preserving tissue structure, is promising for efficient IHC generation.<n>This study proposes a mutual-information (MI)-guided score-based diffusion model for unpaired virtual staining.
arXiv Detail & Related papers (2025-06-29T11:02:45Z) - SCFANet: Style Distribution Constraint Feature Alignment Network For Pathological Staining Translation [0.11999555634662631]
Style Distribution Constraint Feature Alignment Network (SCFANet)<n>SCFANet incorporates two innovative modules: the Style Distribution Constrainer (SDC) and Feature Alignment Learning (FAL)<n>Our SCFANet model outperforms existing methods, achieving precise transformation of H&E-stained images into their IHC-stained counterparts.
arXiv Detail & Related papers (2025-04-01T07:29:53Z) - "Principal Components" Enable A New Language of Images [79.45806370905775]
We introduce a novel visual tokenization framework that embeds a provable PCA-like structure into the latent token space.<n>Our approach achieves state-of-the-art reconstruction performance and enables better interpretability to align with the human vision system.
arXiv Detail & Related papers (2025-03-11T17:59:41Z) - Distance Weighted Trans Network for Image Completion [52.318730994423106]
We propose a new architecture that relies on Distance-based Weighted Transformer (DWT) to better understand the relationships between an image's components.
CNNs are used to augment the local texture information of coarse priors.
DWT blocks are used to recover certain coarse textures and coherent visual structures.
arXiv Detail & Related papers (2023-10-11T12:46:11Z) - ESSAformer: Efficient Transformer for Hyperspectral Image
Super-resolution [76.7408734079706]
Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation.
We propose ESSAformer, an ESSA attention-embedded Transformer network for single-HSI-SR with an iterative refining structure.
arXiv Detail & Related papers (2023-07-26T07:45:14Z) - Bridging Component Learning with Degradation Modelling for Blind Image
Super-Resolution [69.11604249813304]
We propose a components decomposition and co-optimization network (CDCN) for blind SR.
CDCN decomposes the input LR image into structure and detail components in feature space.
We present a degradation-driven learning strategy to jointly supervise the HR image detail and structure restoration process.
arXiv Detail & Related papers (2022-12-03T14:53:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.