Deep Learning for BioImaging: What Are We Learning?

• URL: http://arxiv.org/abs/2603.13377v1
• Date: Tue, 10 Mar 2026 16:49:09 GMT
• Title: Deep Learning for BioImaging: What Are We Learning?
• Abstract summary: In microscopy imaging, it remains unclear what current representation learning methods actually learn.<n>We introduce a set of simple yet revealing baselines on curated benchmarks, including untrained models and simple structural representations of cellular tissue.<n>We show that, in contrast to natural images, existing models fail to consistently acquire high-level, biologically meaningful features.
• Score: 2.1810338565266507
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Representation learning has driven major advances in natural image analysis by enabling models to acquire high-level semantic features. In microscopy imaging, however, it remains unclear what current representation learning methods actually learn. In this work, we conduct a systematic study of representation learning for the two most widely used and broadly available microscopy data types, representing critical scales in biology: cell culture and tissue imaging. To this end, we introduce a set of simple yet revealing baselines on curated benchmarks, including untrained models and simple structural representations of cellular tissue. Our results show that, surprisingly, state-of-the-art methods perform comparably to these baselines. We further show that, in contrast to natural images, existing models fail to consistently acquire high-level, biologically meaningful features. Moreover, we demonstrate that commonly used benchmark metrics are insufficient to assess representation quality and often mask this limitation. In addition, we investigate how detailed comparisons with these benchmarks provide ways to interpret the strengths and weaknesses of models for further improvements. Together, our results suggest that progress in microscopy image representation learning requires not only stronger models, but also more diagnostic benchmarks that measure what is actually learned.

Related papers

• MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models [83.50100003741628]
  Vision and language models (VLMs) hold immense promise to transform biomedical imaging.<n>We introduce the Massive Multimodal Biomedical Understanding (MMBU) benchmark.<n>It is the largest vision and language benchmark to date, covering 35 submodalities with rich structured metadata.
  arXiv  Detail & Related papers  (2026-06-04T20:24:47Z)
• LEMON: a foundation model for nuclear morphology in Computational Pathology [1.125921430041183]
  We introduce LEMON, a self-supervised foundation model for scalable single-cell image representation learning.<n> trained on millions of cell images from diverse tissues and cancer types, LEMON learns robust and versatile morphological representations.<n>We evaluate LEMON on five benchmark datasets across a range of prediction tasks and show that it provides strong performance.
  arXiv  Detail & Related papers  (2026-03-26T18:09:09Z)
• Disentangled representations of microscopy images [0.9849635250118911]
  This work proposes a Disentangled Representation Learning (DRL) methodology to enhance model interpretability for microscopy image classification.<n>We show how a DRL framework, based on transferring a representation learnt from synthetic data, can provide a good trade-off between accuracy and interpretability in this domain.
  arXiv  Detail & Related papers  (2025-06-25T17:44:37Z)
• CytoFM: The first cytology foundation model [3.591868126270513]
  We introduce CytoFM, the first self-supervised foundation model for digital Cytology.<n>We pretrain CytoFM on a diverse collection of datasets to learn robust, transferable representations.<n>Our results demonstrate that CytoFM performs better on two out of three downstream tasks than existing foundation models pretrained on histopathology.
  arXiv  Detail & Related papers  (2025-04-18T01:37:50Z)
• Reinforcing Pre-trained Models Using Counterfactual Images [54.26310919385808]
  This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. We identify model weaknesses by testing the model using the counterfactual image dataset. We employ the counterfactual images as an augmented dataset to fine-tune and reinforce the classification model.
  arXiv  Detail & Related papers  (2024-06-19T08:07:14Z)
• Discovering interpretable models of scientific image data with deep learning [0.0]
  We implement representation learning, sparse deep neural network training and symbolic regression. We demonstrate their relevance to the field of bioimaging using a well-studied test problem of classifying cell states in microscopy data. We explore the utility of such interpretable models in producing scientific explanations of the underlying biological phenomenon.
  arXiv  Detail & Related papers  (2024-02-05T15:45:55Z)
• Optimizations of Autoencoders for Analysis and Classification of Microscopic In Situ Hybridization Images [68.8204255655161]
  We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression. The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
  arXiv  Detail & Related papers  (2023-04-19T13:45:28Z)
• Perceptual Grouping in Contrastive Vision-Language Models [59.1542019031645]
  We show how vision-language models are able to understand where objects reside within an image and group together visually related parts of the imagery. We propose a minimal set of modifications that results in models that uniquely learn both semantic and spatial information.
  arXiv  Detail & Related papers  (2022-10-18T17:01:35Z)
• Learning multi-scale functional representations of proteins from single-cell microscopy data [77.34726150561087]
  We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information. We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
  arXiv  Detail & Related papers  (2022-05-24T00:00:07Z)
• Towards better understanding and better generalization of few-shot classification in histology images with contrastive learning [7.620702640026243]
  Few-shot learning is an established topic in natural images for years, but few work is attended to histology images. We propose to incorporate contrastive learning (CL) with latent augmentation (LA) to build a few-shot system. In experiments, we find i) models learned by CL generalize better than supervised learning for histology images in unseen classes, and ii) LA brings consistent gains over baselines.
  arXiv  Detail & Related papers  (2022-02-18T07:48:34Z)
• Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples [52.549928980694695]
  In situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. labeling training data with precise stages is very time-consuming even for biologists. We propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images.
  arXiv  Detail & Related papers  (2020-10-20T06:06:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.