Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images

• URL: http://arxiv.org/abs/2406.15727v2
• Date: Thu, 27 Jun 2024 20:13:34 GMT
• Title: Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images
• Authors: Piumi Sandarenu, Julia Chen, Iveta Slapetova, Lois Browne, Peter H. Graham, Alexander Swarbrick, Ewan K. A. Millar, Yang Song, Erik Meijering,
• Abstract summary: We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients.
• Score: 40.234346302444536
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Advancements in digital imaging technologies have sparked increased interest in using multiplexed immunofluorescence (mIF) images to visualise and identify the interactions between specific immunophenotypes with the tumour microenvironment at the cellular level. Current state-of-the-art multiplexed immunofluorescence image analysis pipelines depend on cell feature representations characterised by morphological and stain intensity-based metrics generated using simple statistical and machine learning-based tools. However, these methods are not capable of generating complex representations of cells. We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision using a latent subspace to extract cell features in mIF images. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients, to demonstrate the success of our model against current and alternative methods.

Related papers

• Interpretable Embeddings for Segmentation-Free Single-Cell Analysis in Multiplex Imaging [1.8687965482996822]
  Multiplex Imaging (MI) enables the simultaneous visualization of multiple biological markers in separate imaging channels at subcellular resolution. We propose a segmentation-free deep learning approach that leverages grouped convolutions to learn interpretable embedded features from each imaging channel.
  arXiv  Detail & Related papers  (2024-11-02T11:21:33Z)
• Spatial super-resolution in nanosensing with blinking emitters [79.16635054977068]
  We propose a method of spatial resolution enhancement in metrology with blinking fluorescent nanosensors. We believe that blinking fluorescent sensing agents being complemented with the developed image analysis technique could be utilized routinely in the life science sector.
  arXiv  Detail & Related papers  (2024-02-27T10:38:05Z)
• Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
  We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions. We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training. Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T02:27:02Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• Fluorescence molecular optomic signatures improve identification of tumors in head and neck specimens [5.486402205751873]
  A radiomics approach was extended to optical fluorescence molecular imaging data for tissue classification, termed 'optomics' Optomics seek to improve tumor identification by probing textural pattern differences in EGFR expression conveyed by fluorescence. The improved performance demonstrates that extending the radiomics approach to fluorescence molecular imaging data offers a promising image analysis technique for cancer detection in fluorescence-guided surgery.
  arXiv  Detail & Related papers  (2022-08-29T00:06:25Z)
• Learning multi-scale functional representations of proteins from single-cell microscopy data [77.34726150561087]
  We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information. We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
  arXiv  Detail & Related papers  (2022-05-24T00:00:07Z)
• Machine learning based lens-free imaging technique for field-portable cytometry [0.0]
  The performance of our proposed method shows an increase in accuracy >98% along with the signal enhancement of >5 dB for most of the cell types. The model is adaptive to learn new type of samples within a few learning iterations and able to successfully classify the newly introduced sample.
  arXiv  Detail & Related papers  (2022-03-02T07:09:29Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Pixel precise unsupervised detection of viral particle proliferation in cellular imaging data [0.0]
  We use computer generated images from a study of experimentally obtained cell imaging data representing viral particle proliferation in host cell monolayers. In this study viral particle increase in time is simulated by a one-by-one increase, across images, in black or gray single pixels representing dead or partially infected cells, and hypothetical remission by a one-by-one increase in white pixels coding for living cells. Unsupervised classification by SOM-QE of 160 model images, each with more than three million pixels, is shown to provide a statistically reliable, pixel precise, and fast classification model.
  arXiv  Detail & Related papers  (2020-11-10T16:06:03Z)
• Automated Phenotyping via Cell Auto Training (CAT) on the Cell DIVE Platform [0.5599792629509229]
  We present a method for automatic cell classification in tissue samples using an automated training set from multiplexed immunofluorescence images. The method utilizes multiple markers stained in situ on a single tissue section on a robust hyperplex immunofluorescence platform.
  arXiv  Detail & Related papers  (2020-07-18T16:45:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.