CytoBERT: A Foundation Model for Cytometry Data

• URL: http://arxiv.org/abs/2608.14414v1
• Date: Fri, 14 Aug 2026 15:57:35 GMT
• Title: CytoBERT: A Foundation Model for Cytometry Data
• Abstract summary: CytoBERT is a publicly available, open-source, open-weight foundation model for single-cell data with variable marker panels.<n>It is pretrained in a self-supervised manner on a large-scale corpus (15 human datasets with heterogeneous marker panels and more than 50 million cells)<n>It curated through marker standardization, enabling it to learn transferable inter-marker relationships within cells.
• Score: 0.7209218072712748
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cytometry measures the complex characteristics of single cells (e.g., counts and protein expression of immune cells) and is widely used across immunological research and clinical settings. However, cytometry data is highly heterogeneous and unstandardized due to experimental protocols and the choice of measured features. While machine learning methods hold the potential to gain deeper insights into cell biology, these challenges make them difficult to apply and transfer across studies. Recent advances in foundation models can alleviate these issues, but corresponding approaches are still scarce in this field. To address this, we provide CytoBERT, a publicly available, open-source, open-weight foundation model for single-cell cytometry data with variable marker panels. CytoBERT is pretrained in a self-supervised manner on a large-scale cytometry corpus (15 human datasets with heterogeneous marker panels and more than 50 million cells) curated through marker standardization, enabling it to learn transferable inter-marker relationships within cells. Fine-tuning CytoBERT for sample-level classification demonstrates that transfer learning across heterogeneous cytometry datasets is feasible, providing a starting point for scalable, generalizable cytometry analysis. Code is available at GitHub.

Related papers

• CellVerse: Do Large Language Models Really Understand Cell Biology? [74.34984441715517]
  We introduce CellVerse, a unified language-centric question-answering benchmark that integrates four types of single-cell multi-omics data.<n>We systematically evaluate the performance across 14 open-source and closed-source LLMs ranging from 160M to 671B on CellVerse.
  arXiv  Detail & Related papers  (2025-05-09T06:47:23Z)
• MMIL: A novel algorithm for disease associated cell type discovery [58.044870442206914]
  Single-cell datasets often lack individual cell labels, making it challenging to identify cells associated with disease. We introduce Mixture Modeling for Multiple Learning Instance (MMIL), an expectation method that enables the training and calibration of cell-level classifiers.
  arXiv  Detail & Related papers  (2024-06-12T15:22:56Z)
• FlowCyt: A Comparative Study of Deep Learning Approaches for Multi-Class Classification in Flow Cytometry Benchmarking [1.6712896227173808]
  FlowCyt is the first comprehensive benchmark for multi-class single-cell classification in flowencoded data. The dataset comprises bone marrow samples from 30 patients, with each cell characterized by twelve markers.
  arXiv  Detail & Related papers  (2024-02-28T15:01:59Z)
• UniCell: Universal Cell Nucleus Classification via Prompt Learning [76.11864242047074]
  We propose a universal cell nucleus classification framework (UniCell) It employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains. In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets.
  arXiv  Detail & Related papers  (2024-02-20T11:50:27Z)
• Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
  We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells. During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation. This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
  arXiv  Detail & Related papers  (2023-11-28T09:14:55Z)
• Mixed Models with Multiple Instance Learning [51.440557223100164]
  We introduce MixMIL, a framework integrating Generalized Linear Mixed Models (GLMM) and Multiple Instance Learning (MIL) Our empirical results reveal that MixMIL outperforms existing MIL models in single-cell datasets.
  arXiv  Detail & Related papers  (2023-11-04T16:42:42Z)
• Machine Learning for Flow Cytometry Data Analysis [0.0]
  Flow cytometers can rapidly analyse tens of thousands of cells at the same time while also measuring multiple parameters from a single cell. Researchers need to be able to distinguish interesting-looking cell populations manually in multi-dimensional data collected from millions of cells. Three representative automated clustering algorithms are selected to be applied, compared and evaluated by completely and partially automated gating.
  arXiv  Detail & Related papers  (2023-03-16T00:43:46Z)
• A biology-driven deep generative model for cell-type annotation in cytometry [0.0]
  We introduce Scyan, a Single-cell Cytometry Network that automatically annotates cell types using only prior expert knowledge. Scyan significantly outperforms the related state-of-the-art models on multiple public datasets while being faster and interpretable. In addition, Scyan overcomes several complementary tasks such as batch-effect removal, debarcoding, and population discovery.
  arXiv  Detail & Related papers  (2022-08-11T10:50:44Z)
• Distribution-based Sketching of Single-Cell Samples [6.904244323294012]
  We propose a novel sketching approach based on Kernel Herding that selects a limited subsample of all cells while preserving the underlying frequencies of immune cell-types. We tested our approach on three flow and mass datasets and on one single-cell RNA sequencing dataset.
  arXiv  Detail & Related papers  (2022-06-30T19:43:06Z)
• Interpretable Single-Cell Set Classification with Kernel Mean Embeddings [14.686560033030101]
  Kernel Mean Embedding encodes the cellular landscape of each profiled biological sample. We train a simple linear classifier and achieve state-of-the-art classification accuracy on 3 flow and mass datasets.
  arXiv  Detail & Related papers  (2022-01-18T21:40:36Z)
• Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation [63.94623495501023]
  We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
  arXiv  Detail & Related papers  (2020-10-20T08:36:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.