Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue

• URL: http://arxiv.org/abs/2001.07267v1
• Date: Mon, 20 Jan 2020 22:14:06 GMT
• Title: Digital synthesis of histological stains using micro-structured and multiplexed virtual staining of label-free tissue
• Authors: Yijie Zhang, Kevin de Haan, Yair Rivenson, Jingxi Li, Apostolos Delis, Aydogan Ozcan
• Abstract summary: We present a new deep learning-based framework which generates virtually-stained images using label-free tissue. We trained and blindly tested this virtual-staining network using unlabeled kidney tissue sections.
• Score: 2.446672595462589
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Histological staining is a vital step used to diagnose various diseases and has been used for more than a century to provide contrast to tissue sections, rendering the tissue constituents visible for microscopic analysis by medical experts. However, this process is time-consuming, labor-intensive, expensive and destructive to the specimen. Recently, the ability to virtually-stain unlabeled tissue sections, entirely avoiding the histochemical staining step, has been demonstrated using tissue-stain specific deep neural networks. Here, we present a new deep learning-based framework which generates virtually-stained images using label-free tissue, where different stains are merged following a micro-structure map defined by the user. This approach uses a single deep neural network that receives two different sources of information at its input: (1) autofluorescence images of the label-free tissue sample, and (2) a digital staining matrix which represents the desired microscopic map of different stains to be virtually generated at the same tissue section. This digital staining matrix is also used to virtually blend existing stains, digitally synthesizing new histological stains. We trained and blindly tested this virtual-staining network using unlabeled kidney tissue sections to generate micro-structured combinations of Hematoxylin and Eosin (H&E), Jones silver stain, and Masson's Trichrome stain. Using a single network, this approach multiplexes virtual staining of label-free tissue with multiple types of stains and paves the way for synthesizing new digital histological stains that can be created on the same tissue cross-section, which is currently not feasible with standard histochemical staining methods.

Related papers

• DiffKillR: Killing and Recreating Diffeomorphisms for Cell Annotation in Dense Microscopy Images [105.46086313858062]
  We introduce DiffKillR, a novel framework that reframes cell annotation as the combination of archetype matching and image registration tasks. We will discuss the theoretical properties of DiffKillR and validate it on three microscopy tasks, demonstrating its advantages over existing supervised, semi-supervised, and unsupervised methods.
  arXiv  Detail & Related papers  (2024-10-04T00:38:29Z)
• Virtual birefringence imaging and histological staining of amyloid deposits in label-free tissue using autofluorescence microscopy and deep learning [4.074521061733491]
  Congo red stain is the gold standard chemical stain for the visualization of amyloid deposits in tissue sections. A single trained neural network can transform autofluorescence images of label-free tissue sections into brightfield and polarized light microscopy equivalent images.
  arXiv  Detail & Related papers  (2024-03-14T04:48:06Z)
• Automated Whole Slide Imaging for Label-Free Histology using Photon Absorption Remote Sensing Microscopy [0.0]
  Current staining and advanced labeling methods are often destructive and mutually incompatible. We present an alternative label-free histology platform using the first transmission-mode Photon Remote Sensing microscope.
  arXiv  Detail & Related papers  (2023-04-26T12:36:19Z)
• Cross-modulated Few-shot Image Generation for Colorectal Tissue Classification [58.147396879490124]
  Our few-shot generation method, named XM-GAN, takes one base and a pair of reference tissue images as input and generates high-quality yet diverse images. To the best of our knowledge, we are the first to investigate few-shot generation in colorectal tissue images.
  arXiv  Detail & Related papers  (2023-04-04T17:50:30Z)
• Digital staining in optical microscopy using deep learning -- a review [47.86254766044832]
  Digital staining has emerged as a promising concept to use modern deep learning for the translation from optical contrast to established biochemical contrast of actual stainings. We provide an in-depth analysis of the current state-of-the-art in this field, suggest methods of good practice, identify pitfalls and challenges and postulate promising advances towards potential future implementations and applications.
  arXiv  Detail & Related papers  (2023-03-14T15:23:48Z)
• Deep Learning-enabled Virtual Histological Staining of Biological Samples [2.446672595462589]
  Histological staining is the gold standard for tissue examination in clinical pathology and life-science research. The current histological staining workflow requires tedious sample preparation steps, specialized laboratory infrastructure, and trained histotechnologists. Deep learning techniques created new opportunities to revolutionize staining methods by digitally generating histological stains.
  arXiv  Detail & Related papers  (2022-11-13T05:31:47Z)
• Virtual stain transfer in histology via cascaded deep neural networks [2.309018557701645]
  We demonstrate a virtual stain transfer framework via a cascaded deep neural network (C-DNN) Unlike a single neural network structure which only takes one stain type as input to digitally output images of another stain type, C-DNN first uses virtual staining to transform autofluorescence microscopy images into H&E. We successfully transferred the H&E-stained tissue images into virtual PAS (periodic acid-Schiff) stain.
  arXiv  Detail & Related papers  (2022-07-14T00:43:18Z)
• Lymphocyte Classification in Hyperspectral Images of Ovarian Cancer Tissue Biopsy Samples [94.37521840642141]
  We present a machine learning pipeline to segment white blood cell pixels in hyperspectral images of biopsy cores. These cells are clinically important for diagnosis, but some prior work has struggled to incorporate them due to difficulty obtaining precise pixel labels.
  arXiv  Detail & Related papers  (2022-03-23T00:58:27Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Spectrum Translation for Cross-Spectral Ocular Matching [59.17685450892182]
  Cross-spectral verification remains a big issue in biometrics, especially for the ocular area. We investigate the use of Conditional Adversarial Networks for spectrum translation between near infra-red and visual light images for ocular biometrics.
  arXiv  Detail & Related papers  (2020-02-14T19:30:31Z)
• Pix2Pix-based Stain-to-Stain Translation: A Solution for Robust Stain Normalization in Histopathology Images Analysis [5.33024001730262]
  Stain-to-Stain Translation (STST) is used to stain normalization for Hematoxylin and Eosin stained histopathology images. We perform the process of translation based on the pix2pix framework, which uses the conditional generator adversarial networks (cGANs)
  arXiv  Detail & Related papers  (2020-02-03T11:19:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.