Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon

• URL: http://arxiv.org/abs/2308.13182v1
• Date: Fri, 25 Aug 2023 05:24:23 GMT
• Title: Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon
• Authors: Shikha Dubey, Tushar Kataria, Beatrice Knudsen, and Shireen Y. Elhabian
• Abstract summary: Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading. Pathologists do need differentchemical (IHC) stains to analyze specific structures or cells. Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading.
• Score: 1.741980945827445
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: With the advent of digital scanners and deep learning, diagnostic operations may move from a microscope to a desktop. Hematoxylin and Eosin (H&E) staining is one of the most frequently used stains for disease analysis, diagnosis, and grading, but pathologists do need different immunohistochemical (IHC) stains to analyze specific structures or cells. Obtaining all of these stains (H&E and different IHCs) on a single specimen is a tedious and time-consuming task. Consequently, virtual staining has emerged as an essential research direction. Here, we propose a novel generative model, Structural Cycle-GAN (SC-GAN), for synthesizing IHC stains from H&E images, and vice versa. Our method expressly incorporates structural information in the form of edges (in addition to color data) and employs attention modules exclusively in the decoder of the proposed generator model. This integration enhances feature localization and preserves contextual information during the generation process. In addition, a structural loss is incorporated to ensure accurate structure alignment between the generated and input markers. To demonstrate the efficacy of the proposed model, experiments are conducted with two IHC markers emphasizing distinct structures of glands in the colon: the nucleus of epithelial cells (CDX2) and the cytoplasm (CK818). Quantitative metrics such as FID and SSIM are frequently used for the analysis of generative models, but they do not correlate explicitly with higher-quality virtual staining results. Therefore, we propose two new quantitative metrics that correlate directly with the virtual staining specificity of IHC markers.

Related papers

• A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
  We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
  arXiv  Detail & Related papers  (2025-12-15T10:22:43Z)
• Deep learning-enabled virtual multiplexed immunostaining of label-free tissue for vascular invasion assessment [5.3528119597796655]
  We present a deep learning-based virtual multiplexed immunostaining framework to simultaneously generate ERG and PanCK.<n>This technique is based on autofluorescence microscopy images label-free tissue sections.<n>Its output images closely match the histochemical staining counterparts (ERG, PanCK and H&E) of the same tissue sections.
  arXiv  Detail & Related papers  (2025-08-22T08:31:03Z)
• From Pixels to Pathology: Restoration Diffusion for Diagnostic-Consistent Virtual IHC [37.284994932355865]
  We introduce Star-Diff, a structure-aware staining restoration diffusion model that reformulates virtual staining as an image restoration task.<n>By combining residual and noise-based generation pathways, Star-Diff maintains tissue structure while modeling realistic biomarker variability.<n> Experiments on the BCI dataset demonstrate that Star-Diff achieves state-of-the-art (SOTA) performance in both visual fidelity and diagnostic relevance.
  arXiv  Detail & Related papers  (2025-08-04T15:36:58Z)
• Score-based Diffusion Model for Unpaired Virtual Histology Staining [7.648204151998162]
  Hematoxylin and eosin (H&E) staining visualizes histology but lacks specificity for diagnostic markers.<n>Hematoxylin and eosin (H&E) staining provides protein-targeted staining but is restricted by tissue availability and antibody specificity.<n>Virtual staining, i.e., translating the H&E image to its IHC counterpart while preserving tissue structure, is promising for efficient IHC generation.<n>This study proposes a mutual-information (MI)-guided score-based diffusion model for unpaired virtual staining.
  arXiv  Detail & Related papers  (2025-06-29T11:02:45Z)
• ImplicitStainer: Data-Efficient Medical Image Translation for Virtual Antibody-based Tissue Staining Using Local Implicit Functions [1.9029890402585894]
  Hematoxylin and eosin (H&E) staining is a gold standard for microscopic diagnosis in pathology.<n>Hematoxylin and eosin (H&E) staining is a gold standard for microscopic diagnosis in pathology.<n>Hematoxylin and eosin (H&E) staining does not capture all the diagnostic information that may be needed.
  arXiv  Detail & Related papers  (2025-05-14T22:22:52Z)
• Zero-shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials [41.856704526703595]
  characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training.<n>This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training datasets.<n>We present ATOMIC, an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials.
  arXiv  Detail & Related papers  (2025-04-14T14:49:45Z)
• GS-TransUNet: Integrated 2D Gaussian Splatting and Transformer UNet for Accurate Skin Lesion Analysis [44.99833362998488]
  We present a novel approach that combines 2D Gaussian splatting with the Transformer UNet architecture for automated skin cancer diagnosis.<n>Our findings illustrate significant advancements in the precision of segmentation and classification.<n>This integration sets new benchmarks in the field and highlights the potential for further research into multi-task medical image analysis methodologies.
  arXiv  Detail & Related papers  (2025-02-23T23:28:47Z)
• Generating Seamless Virtual Immunohistochemical Whole Slide Images with Content and Color Consistency [2.063403009505468]
  Immunohistochemical (IHC) stains play a vital role in a pathologist's analysis of medical images, providing crucial diagnostic information for various diseases. Virtual staining from hematoxylin and eosin (H&E)-stained whole slide images (WSIs) allows the automatic production of other useful IHC stains without the expensive physical staining process. Current virtual WSI generation methods based on tile-wise processing often suffer from inconsistencies in content, texture, and color at tile boundaries. We propose a novel consistent WSI synthesis network, CC-WSI-Net, that extends GAN models to
  arXiv  Detail & Related papers  (2024-10-01T21:02:16Z)
• Histology Virtual Staining with Mask-Guided Adversarial Transfer Learning for Tertiary Lymphoid Structure Detection [9.68135211016703]
  Histological Tertiary Lymphoid Structures (TLSs) are increasingly recognized for their correlation with the efficacy of immunotherapy in various solid tumors. Traditionally, the identification and characterization of TLSs rely onchemistry (IHC) staining techniques, utilizing markers such as CD20 for B cells. We introduce a novel Mask-Guided Adversarial Transfer Learning method designed for virtual pathological staining. This method adeptly captures the nuanced color variations across diverse tissue types under various staining conditions, without explicit label information. We propose the Virtual IHC Pathology Analysis Network (VIPA-Net), an integrated framework encompassing a Mask-Guided
  arXiv  Detail & Related papers  (2024-08-26T01:54:37Z)
• VIMs: Virtual Immunohistochemistry Multiplex staining via Text-to-Stain Diffusion Trained on Uniplex Stains [0.9920087186610302]
  IHC stains are crucial in pathology practice for resolving complex diagnostic questions and guiding patient treatment decisions. Small biopsies often lack sufficient tissue for multiple stains while preserving material for subsequent molecular testing. VIMs is the first model to address this need, leveraging a large vision-language single-step diffusion model for virtual IHC multiplexing.
  arXiv  Detail & Related papers  (2024-07-26T22:23:45Z)
• Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models [71.39421638547164]
  We propose to detect OOD molecules by adopting an auxiliary diffusion model-based framework, which compares similarities between input molecules and reconstructed graphs. Due to the generative bias towards reconstructing ID training samples, the similarity scores of OOD molecules will be much lower to facilitate detection. Our research pioneers an approach of Prototypical Graph Reconstruction for Molecular OOD Detection, dubbed as PGR-MOOD and hinges on three innovations.
  arXiv  Detail & Related papers  (2024-04-24T03:25:53Z)
• StainDiffuser: MultiTask Dual Diffusion Model for Virtual Staining [1.9029890402585894]
  Hematoxylin and Eosin (H&E) staining is the most commonly used for disease diagnosis and tumor recurrence tracking. Deep learning models have made Image-to-Image (I2I) translation a key research area, reducing the need for expensive physical staining processes. We propose StainDiffuser, a novel dual diffusion architecture for virtual staining that converges under a limited training budget.
  arXiv  Detail & Related papers  (2024-03-17T20:47:52Z)
• Automated segmentation of rheumatoid arthritis immunohistochemistry stained synovial tissue [0.0]
  Rheumatoid Arthritis (RA) is a chronic, autoimmune disease which primarily affects the joint's synovial tissue. It is a highly heterogeneous disease, with wide cellular and molecular variability observed in synovial tissues. We train a UNET on a hand-curated, real-world multi-centre clinical dataset R4RA, which contains multiple types of IHC staining. The model obtains a DICE score of 0.865 and successfully segments different types of IHC staining, as well as dealing with variance in colours, intensity and common WSIs artefacts from the different clinical centres.
  arXiv  Detail & Related papers  (2023-09-13T18:43:14Z)
• K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality Assessment [71.27193056354741]
  The problem of how to assess cross-modality medical image synthesis has been largely unexplored. We propose a new metric K-CROSS to spur progress on this challenging problem. K-CROSS uses a pre-trained multi-modality segmentation network to predict the lesion location.
  arXiv  Detail & Related papers  (2023-07-10T01:26:48Z)
• RandStainNA: Learning Stain-Agnostic Features from Histology Slides by Bridging Stain Augmentation and Normalization [45.81689497433507]
  Two proposals, namely stain normalization (SN) and stain augmentation (SA), have been spotlighted to reduce the generalization error. To address the problems, we unify SN and SA with a novel RandStainNA scheme. The RandStainNA constrains variable stain styles in a practicable range to train a stain agnostic deep learning model.
  arXiv  Detail & Related papers  (2022-06-25T16:43:59Z)
• Lymphocyte Classification in Hyperspectral Images of Ovarian Cancer Tissue Biopsy Samples [94.37521840642141]
  We present a machine learning pipeline to segment white blood cell pixels in hyperspectral images of biopsy cores. These cells are clinically important for diagnosis, but some prior work has struggled to incorporate them due to difficulty obtaining precise pixel labels.
  arXiv  Detail & Related papers  (2022-03-23T00:58:27Z)
• Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation [70.7778938191405]
  We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation. The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
  arXiv  Detail & Related papers  (2022-03-12T15:24:03Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Learning Generative Models of Tissue Organization with Supervised GANs [46.569795520982325]
  A key step in understanding the spatial organization of cells and tissues is the ability to construct generative models that accurately reflect that organization. In this paper, we focus on building generative models of electron microscope (EM) images in which the positions of cell membranes and mitochondria have been densely annotated. We propose a two-stage procedure that produces realistic images using Generative Adversarial Networks (or GANs) in a supervised way.
  arXiv  Detail & Related papers  (2020-03-31T22:22:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.