Multi-omics Prediction from High-content Cellular Imaging with Deep Learning

• URL: http://arxiv.org/abs/2306.09391v3
• Date: Tue, 21 May 2024 10:43:07 GMT
• Title: Multi-omics Prediction from High-content Cellular Imaging with Deep Learning
• Authors: Rahil Mehrizi, Arash Mehrjou, Maryana Alegro, Yi Zhao, Benedetta Carbone, Carl Fishwick, Johanna Vappiani, Jing Bi, Siobhan Sanford, Hakan Keles, Marcus Bantscheff, Cuong Nguyen, Patrick Schwab,
• Abstract summary: Image2Omics is a deep learning approach that predicts multi-omics in a cell population directly from high-content images of cells stained with multiplexed fluorescent dyes. We show that Image2Omics achieves significantly better performance in predicting transcriptomics and measurements directly from cell images than predictions based on the mean observed training set abundance.
• Score: 16.334824637441677
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: High-content cellular imaging, transcriptomics, and proteomics data provide rich and complementary views on the molecular layers of biology that influence cellular states and function. However, the biological determinants through which changes in multi-omics measurements influence cellular morphology have not yet been systematically explored, and the degree to which cell imaging could potentially enable the prediction of multi-omics directly from cell imaging data is therefore currently unclear. Here, we address the question of whether it is possible to predict bulk multi-omics measurements directly from cell images using Image2Omics - a deep learning approach that predicts multi-omics in a cell population directly from high-content images of cells stained with multiplexed fluorescent dyes. We perform an experimental evaluation in gene-edited macrophages derived from human induced pluripotent stem cells (hiPSC) under multiple stimulation conditions and demonstrate that Image2Omics achieves significantly better performance in predicting transcriptomics and proteomics measurements directly from cell images than predictions based on the mean observed training set abundance. We observed significant predictability of abundances for 4927 (18.72%; 95% CI: 6.52%, 35.52%) and 3521 (13.38%; 95% CI: 4.10%, 32.21%) transcripts out of 26137 in M1 and M2-stimulated macrophages respectively and for 422 (8.46%; 95% CI: 0.58%, 25.83%) and 697 (13.98%; 95% CI: 2.41%, 32.83%) proteins out of 4986 in M1 and M2-stimulated macrophages respectively. Our results show that some transcript and protein abundances are predictable from cell imaging and that cell imaging may potentially, in some settings and depending on the mechanisms of interest and desired performance threshold, even be a scalable and resource-efficient substitute for multi-omics measurements.

Related papers

• CHAMMI-75: pre-training multi-channel models with heterogeneous microscopy images [17.19661386207827]
  We present CHAMMI-75, an open access dataset of heterogeneous, multi-channel microscopy images from 75 diverse biological studies.<n>Our experiments show that training with CHAMMI-75 can improve performance in multi-channel bioimaging tasks.
  arXiv  Detail & Related papers  (2025-12-23T23:15:10Z)
• Learning Cell-Aware Hierarchical Multi-Modal Representations for Robust Molecular Modeling [74.25438319700929]
  We propose CHMR (Cell-aware Hierarchical Multi-modal Representations), a robust framework that models local-global dependencies between molecules and cellular responses.<n> evaluated on nine public benchmarks spanning 728 tasks, CHMR outperforms state-of-the-art baselines.<n>Results demonstrate the advantage of hierarchy-aware, multimodal learning for reliable and biologically grounded molecular representations.
  arXiv  Detail & Related papers  (2025-11-26T07:15:00Z)
• First experimental measurements of biophotons from Astrocytes and Glioblastoma cell cultures [0.0]
  Biophotons are non-thermal and non-bioluminescent ultraweak photon emissions.<n>Recent interest focuses on the role of biophotons in cellular communication and disease monitoring.<n>This study presents the first campaign of biophoton emission measurements from cultured astrocytes and glioblastoma cells.
  arXiv  Detail & Related papers  (2025-10-07T11:10:42Z)
• Unlasting: Unpaired Single-Cell Multi-Perturbation Estimation by Dual Conditional Diffusion Implicit Bridges [68.98973318553983]
  We propose a framework based on Dual Diffusion Implicit Bridges (DDIB) to learn the mapping between different data distributions.<n>We integrate gene regulatory network (GRN) information to propagate perturbation signals in a biologically meaningful way.<n>We also incorporate a masking mechanism to predict silent genes, improving the quality of generated profiles.
  arXiv  Detail & Related papers  (2025-06-26T09:05:38Z)
• Detecting immune cells with label-free two-photon autofluorescence and deep learning [2.096497520824982]
  We trained a convolutional neural network (CNN) to classify cell types based on this label-free AF as input.<n>A low-complexity squeezeNet architecture was able to achieve reliable immune cell classification results.<n>In the future, such predictive DL models could directly detect specific immune cells in unstained images.
  arXiv  Detail & Related papers  (2025-06-17T12:14:02Z)
• MIPHEI-ViT: Multiplex Immunofluorescence Prediction from H&E Images using ViT Foundation Models [2.2802322828460864]
  We introduce MIPHEI, a U-Net-inspired architecture that integrates state-of-the-art ViT foundation models as encoders to predict mIF signals from H&E images.<n>We train our model using the publicly available ORION dataset of restained H&E and mIF images from colorectal cancer tissue.<n>MIPHEI achieves accurate cell-type classification from H&E alone, with F1 scores of 0.88 for Pan-CK, 0.57 for CD3e, 0.56 for SMA, 0.36 for CD68, and 0.30 for CD20.
  arXiv  Detail & Related papers  (2025-05-15T13:42:48Z)
• CellVerse: Do Large Language Models Really Understand Cell Biology? [74.34984441715517]
  We introduce CellVerse, a unified language-centric question-answering benchmark that integrates four types of single-cell multi-omics data.<n>We systematically evaluate the performance across 14 open-source and closed-source LLMs ranging from 160M to 671B on CellVerse.
  arXiv  Detail & Related papers  (2025-05-09T06:47:23Z)
• CellFlow: Simulating Cellular Morphology Changes via Flow Matching [44.8979602893102]
  We introduce CellFlow, an image-generative model that simulates cellular morphology changes induced by chemical and genetic perturbations. CellFlow generates biologically meaningful cell images that faithfully capture perturbation-specific morphological changes.
  arXiv  Detail & Related papers  (2025-02-13T21:10:00Z)
• Merging synthetic and real embryo data for advanced AI predictions [69.07284335967019]
  We train two generative models using two datasets-one we created and made publicly available, and one existing public dataset-to generate synthetic embryo images at various cell stages. These were combined with real images to train classification models for embryo cell stage prediction. Our results demonstrate that incorporating synthetic images alongside real data improved classification performance, with the model achieving 97% accuracy compared to 94.5% when trained solely on real data.
  arXiv  Detail & Related papers  (2024-12-02T08:24:49Z)
• IDCIA: Immunocytochemistry Dataset for Cellular Image Analysis [0.5057850174013127]
  We present a new annotated microscopic cellular image dataset to improve the effectiveness of machine learning methods for cellular image analysis. Our dataset includes microscopic images of cells, and for each image, the cell count and the location of individual cells.
  arXiv  Detail & Related papers  (2024-11-13T19:33:08Z)
• Semi-supervised variational autoencoder for cell feature extraction in multiplexed immunofluorescence images [40.234346302444536]
  We propose a deep learning-based cell feature extraction model using a variational autoencoder with supervision. We perform cell phenotype classification using a cohort of more than 44,000 multiplexed immunofluorescence cell image patches extracted across 1,093 tissue microarray cores of breast cancer patients.
  arXiv  Detail & Related papers  (2024-06-22T04:32:50Z)
• Practical Guidelines for Cell Segmentation Models Under Optical Aberrations in Microscopy [14.042884268397058]
  This study evaluates cell image segmentation models under optical aberrations from fluorescence and bright field microscopy. We train and test several segmentation models, including the Otsu threshold method and Mask R-CNN with different network heads. In contrast, Cellpose 2.0 proves effective for complex cell images under similar conditions.
  arXiv  Detail & Related papers  (2024-04-12T15:45:26Z)
• Nondestructive, quantitative viability analysis of 3D tissue cultures using machine learning image segmentation [0.0]
  We demonstrate an image processing algorithm for quantifying cellular viability in 3D cultures without the need for assay-based indicators. We show that our algorithm performs similarly to a pair of human experts in whole-well images over a range of days and culture matrix compositions.
  arXiv  Detail & Related papers  (2023-11-15T20:28:31Z)
• Tertiary Lymphoid Structures Generation through Graph-based Diffusion [54.37503714313661]
  In this work, we leverage state-of-the-art graph-based diffusion models to generate biologically meaningful cell-graphs. We show that the adopted graph diffusion model is able to accurately learn the distribution of cells in terms of their tertiary lymphoid structures (TLS) content.
  arXiv  Detail & Related papers  (2023-10-10T14:37:17Z)
• Automatically Predict Material Properties with Microscopic Image Example Polymer Compatibility [94.40113383292139]
  Computer image recognition with machine learning method can make up the defects of artificial judging. We achieve automatic miscibility recognition utilizing convolution neural network and transfer learning method. The proposed method can be widely applied to the quantitative characterization of the microstructure and properties of various materials.
  arXiv  Detail & Related papers  (2023-03-22T07:51:32Z)
• Corneal endothelium assessment in specular microscopy images with Fuchs' dystrophy via deep regression of signed distance maps [48.498376125522114]
  This paper proposes a UNet-based segmentation approach that requires minimal post-processing. It achieves reliable CE morphometric assessment and guttae identification across all degrees of Fuchs' dystrophy.
  arXiv  Detail & Related papers  (2022-10-13T15:34:20Z)
• Texture Characterization of Histopathologic Images Using Ecological Diversity Measures and Discrete Wavelet Transform [82.53597363161228]
  This paper proposes a method for characterizing texture across histopathologic images with a considerable success rate. It is possible to quantify the intrinsic properties of such images with promising accuracy on two HI datasets.
  arXiv  Detail & Related papers  (2022-02-27T02:19:09Z)
• Witnessing the survival of time-energy entanglement through biological tissue and scattering media [47.187609203210705]
  We demonstrate the preservation of time-energy entanglement of near-IR photons through thick biological media and tissue. Using a Franson-type interferometer, we demonstrate interferometric contrast of over 0.9 in skim milk, 2% milk, and chicken tissue.
  arXiv  Detail & Related papers  (2021-02-25T15:00:58Z)
• Cell abundance aware deep learning for cell detection on highly imbalanced pathological data [0.0]
  In digital pathology, less abundant cell types can be of biological significance. We proposed a deep learning pipeline that considers the abundance of cell types during model training. We found that scaling deep learning loss function by the abundance of cells improves cell detection performance.
  arXiv  Detail & Related papers  (2021-02-23T13:07:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.