Unsupervised Deep Digital Staining For Microscopic Cell Images Via
Knowledge Distillation
- URL: http://arxiv.org/abs/2303.02057v1
- Date: Fri, 3 Mar 2023 16:26:38 GMT
- Title: Unsupervised Deep Digital Staining For Microscopic Cell Images Via
Knowledge Distillation
- Authors: Ziwang Xu, Lanqing Guo, Shuyan Zhang, Alex C. Kot and Bihan Wen
- Abstract summary: It is difficult to obtain large-scale stained/unstained cell image pairs in practice.
We propose a novel unsupervised deep learning framework for the digital staining of cell images.
We show that the proposed unsupervised deep staining method can generate stained images with more accurate positions and shapes of the cell targets.
- Score: 46.006296303296544
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Staining is critical to cell imaging and medical diagnosis, which is
expensive, time-consuming, labor-intensive, and causes irreversible changes to
cell tissues. Recent advances in deep learning enabled digital staining via
supervised model training. However, it is difficult to obtain large-scale
stained/unstained cell image pairs in practice, which need to be perfectly
aligned with the supervision. In this work, we propose a novel unsupervised
deep learning framework for the digital staining of cell images using knowledge
distillation and generative adversarial networks (GANs). A teacher model is
first trained mainly for the colorization of bright-field images. After that,a
student GAN for staining is obtained by knowledge distillation with hybrid
non-reference losses. We show that the proposed unsupervised deep staining
method can generate stained images with more accurate positions and shapes of
the cell targets. Compared with other unsupervised deep generative models for
staining, our method achieves much more promising results both qualitatively
and quantitatively.
Related papers
- Single color virtual H&E staining with In-and-Out Net [0.8271394038014485]
This paper introduces a novel network, In-and-Out Net, specifically designed for virtual staining tasks.
Based on Generative Adversarial Networks (GAN), our model efficiently transforms Reflectance Confocal Microscopy (RCM) images into Hematoxylin and Eosin stained images.
arXiv Detail & Related papers (2024-05-22T01:17:27Z) - StainDiffuser: MultiTask Dual Diffusion Model for Virtual Staining [1.9029890402585894]
Hematoxylin and Eosin (H&E) staining is the most commonly used for disease diagnosis and tumor recurrence tracking.
Deep learning models have made Image-to-Image (I2I) translation a key research area, reducing the need for expensive physical staining processes.
We propose StainDiffuser, a novel dual diffusion architecture for virtual staining that converges under a limited training budget.
arXiv Detail & Related papers (2024-03-17T20:47:52Z) - Digital staining in optical microscopy using deep learning -- a review [47.86254766044832]
Digital staining has emerged as a promising concept to use modern deep learning for the translation from optical contrast to established biochemical contrast of actual stainings.
We provide an in-depth analysis of the current state-of-the-art in this field, suggest methods of good practice, identify pitfalls and challenges and postulate promising advances towards potential future implementations and applications.
arXiv Detail & Related papers (2023-03-14T15:23:48Z) - Self-supervised pseudo-colorizing of masked cells [18.843372840624077]
We introduce a novel self-supervision objective for the analysis of cells in biomedical microscopy images.
We propose training deep learning models to pseudo-colorize masked cells.
Our experiments reveal that approximating semantic segmentation by pseudo-colorization is beneficial for subsequent fine-tuning on cell detection.
arXiv Detail & Related papers (2023-02-12T18:16:51Z) - Stain-invariant self supervised learning for histopathology image
analysis [74.98663573628743]
We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer.
Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
arXiv Detail & Related papers (2022-11-14T18:16:36Z) - Seamless Iterative Semi-Supervised Correction of Imperfect Labels in
Microscopy Images [57.42492501915773]
In-vitro tests are an alternative to animal testing for the toxicity of medical devices.
Human fatigue plays a role in error making, making the use of deep learning appealing.
We propose Seamless Iterative Semi-Supervised correction of Imperfect labels (SISSI)
Our method successfully provides an adaptive early learning correction technique for object detection.
arXiv Detail & Related papers (2022-08-05T18:52:20Z) - RestainNet: a self-supervised digital re-stainer for stain normalization [8.740191087897987]
We formulated stain normalization as a digital re-staining process and proposed a self-supervised learning model, which is called RestainNet.
Our network is regarded as a digital restainer which learns how to re-stain an unstained (grayscale) image.
arXiv Detail & Related papers (2022-02-28T14:05:42Z) - Weakly Supervised Learning for cell recognition in immunohistochemical
cytoplasm staining images [6.7466668253416024]
We present a novel cell recognition framework based on multi-task learning.
We have evaluated our framework onchemical cytoplasm staining images, and the results demonstrate that our method outperforms recent cell recognition approaches.
arXiv Detail & Related papers (2022-02-27T14:33:36Z) - Categorical Relation-Preserving Contrastive Knowledge Distillation for
Medical Image Classification [75.27973258196934]
We propose a novel Categorical Relation-preserving Contrastive Knowledge Distillation (CRCKD) algorithm, which takes the commonly used mean-teacher model as the supervisor.
With this regularization, the feature distribution of the student model shows higher intra-class similarity and inter-class variance.
With the contribution of the CCD and CRP, our CRCKD algorithm can distill the relational knowledge more comprehensively.
arXiv Detail & Related papers (2021-07-07T13:56:38Z) - Deep Low-Shot Learning for Biological Image Classification and
Visualization from Limited Training Samples [52.549928980694695]
In situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared.
labeling training data with precise stages is very time-consuming even for biologists.
We propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images.
arXiv Detail & Related papers (2020-10-20T06:06:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.