Virtual stain transfer in histology via cascaded deep neural networks

• URL: http://arxiv.org/abs/2207.06578v1
• Date: Thu, 14 Jul 2022 00:43:18 GMT
• Title: Virtual stain transfer in histology via cascaded deep neural networks
• Authors: Xilin Yang, Bijie Bai, Yijie Zhang, Yuzhu Li, Kevin de Haan, Tairan Liu, Aydogan Ozcan
• Abstract summary: We demonstrate a virtual stain transfer framework via a cascaded deep neural network (C-DNN) Unlike a single neural network structure which only takes one stain type as input to digitally output images of another stain type, C-DNN first uses virtual staining to transform autofluorescence microscopy images into H&E. We successfully transferred the H&E-stained tissue images into virtual PAS (periodic acid-Schiff) stain.
• Score: 2.309018557701645
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pathological diagnosis relies on the visual inspection of histologically stained thin tissue specimens, where different types of stains are applied to bring contrast to and highlight various desired histological features. However, the destructive histochemical staining procedures are usually irreversible, making it very difficult to obtain multiple stains on the same tissue section. Here, we demonstrate a virtual stain transfer framework via a cascaded deep neural network (C-DNN) to digitally transform hematoxylin and eosin (H&E) stained tissue images into other types of histological stains. Unlike a single neural network structure which only takes one stain type as input to digitally output images of another stain type, C-DNN first uses virtual staining to transform autofluorescence microscopy images into H&E and then performs stain transfer from H&E to the domain of the other stain in a cascaded manner. This cascaded structure in the training phase allows the model to directly exploit histochemically stained image data on both H&E and the target special stain of interest. This advantage alleviates the challenge of paired data acquisition and improves the image quality and color accuracy of the virtual stain transfer from H&E to another stain. We validated the superior performance of this C-DNN approach using kidney needle core biopsy tissue sections and successfully transferred the H&E-stained tissue images into virtual PAS (periodic acid-Schiff) stain. This method provides high-quality virtual images of special stains using existing, histochemically stained slides and creates new opportunities in digital pathology by performing highly accurate stain-to-stain transformations.

Related papers

• Generating Seamless Virtual Immunohistochemical Whole Slide Images with Content and Color Consistency [2.063403009505468]
  Immunohistochemical (IHC) stains play a vital role in a pathologist's analysis of medical images, providing crucial diagnostic information for various diseases. Virtual staining from hematoxylin and eosin (H&E)-stained whole slide images (WSIs) allows the automatic production of other useful IHC stains without the expensive physical staining process. Current virtual WSI generation methods based on tile-wise processing often suffer from inconsistencies in content, texture, and color at tile boundaries. We propose a novel consistent WSI synthesis network, CC-WSI-Net, that extends GAN models to
  arXiv  Detail & Related papers  (2024-10-01T21:02:16Z)
• Single color virtual H&E staining with In-and-Out Net [0.8271394038014485]
  This paper introduces a novel network, In-and-Out Net, specifically designed for virtual staining tasks. Based on Generative Adversarial Networks (GAN), our model efficiently transforms Reflectance Confocal Microscopy (RCM) images into Hematoxylin and Eosin stained images.
  arXiv  Detail & Related papers  (2024-05-22T01:17:27Z)
• Autonomous Quality and Hallucination Assessment for Virtual Tissue Staining and Digital Pathology [0.11728348229595655]
  We present an autonomous quality and hallucination assessment method (termed AQuA) for virtual tissue staining. AQuA achieves 99.8% accuracy when detecting acceptable and unacceptable virtually stained tissue images.
  arXiv  Detail & Related papers  (2024-04-29T06:32:28Z)
• Virtual histological staining of unlabeled autopsy tissue [1.9351365037275405]
  We show that a trained neural network can transform autofluorescence images of label-free autopsy tissue sections into brightfield equivalent images that match hematoxylin and eosin stained versions of the same samples. Our virtual autopsy staining technique can also be extended to necrotic tissue, and can rapidly and cost-effectively generate artifact-free H&E stains despite severe autolysis and cell death.
  arXiv  Detail & Related papers  (2023-08-02T03:31:22Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• Digital staining in optical microscopy using deep learning -- a review [47.86254766044832]
  Digital staining has emerged as a promising concept to use modern deep learning for the translation from optical contrast to established biochemical contrast of actual stainings. We provide an in-depth analysis of the current state-of-the-art in this field, suggest methods of good practice, identify pitfalls and challenges and postulate promising advances towards potential future implementations and applications.
  arXiv  Detail & Related papers  (2023-03-14T15:23:48Z)
• Unsupervised Deep Digital Staining For Microscopic Cell Images Via Knowledge Distillation [46.006296303296544]
  It is difficult to obtain large-scale stained/unstained cell image pairs in practice. We propose a novel unsupervised deep learning framework for the digital staining of cell images. We show that the proposed unsupervised deep staining method can generate stained images with more accurate positions and shapes of the cell targets.
  arXiv  Detail & Related papers  (2023-03-03T16:26:38Z)
• Lymphocyte Classification in Hyperspectral Images of Ovarian Cancer Tissue Biopsy Samples [94.37521840642141]
  We present a machine learning pipeline to segment white blood cell pixels in hyperspectral images of biopsy cores. These cells are clinically important for diagnosis, but some prior work has struggled to incorporate them due to difficulty obtaining precise pixel labels.
  arXiv  Detail & Related papers  (2022-03-23T00:58:27Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and Convolutional Neural Networks [68.96150598294072]
  Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights. It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness. In recent years, there has been a significant effort to automate the diagnosis using deep learning. This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN) Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
  arXiv  Detail & Related papers  (2020-04-03T14:07:41Z)
• Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue [2.446672595462589]
  We present a new deep learning-based framework which generates virtually-stained images using label-free tissue. We trained and blindly tested this virtual-staining network using unlabeled kidney tissue sections.
  arXiv  Detail & Related papers  (2020-01-20T22:14:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.