subCellSAM: Zero-Shot (Sub-)Cellular Segmentation for Hit Validation in Drug Discovery

• URL: http://arxiv.org/abs/2508.13701v1
• Date: Tue, 19 Aug 2025 10:07:27 GMT
• Title: subCellSAM: Zero-Shot (Sub-)Cellular Segmentation for Hit Validation in Drug Discovery
• Authors: Jacob Hanimann, Daniel Siegismund, Mario Wieser, Stephan Steigele,
• Abstract summary: We present a novel method that applies a segmentation foundation model in a zero-shot setting, guided by an in-context learning strategy.<n>Our approach employs a three-step process for nuclei, cell, and subcellular segmentation, introducing a self-prompting mechanism.<n>We validate our method on both standard cell segmentation benchmarks and industry-relevant hit validation assays.
• Score: 1.1866227238721938
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: High-throughput screening using automated microscopes is a key driver in biopharma drug discovery, enabling the parallel evaluation of thousands of drug candidates for diseases such as cancer. Traditional image analysis and deep learning approaches have been employed to analyze these complex, large-scale datasets, with cell segmentation serving as a critical step for extracting relevant structures. However, both strategies typically require extensive manual parameter tuning or domain-specific model fine-tuning. We present a novel method that applies a segmentation foundation model in a zero-shot setting (i.e., without fine-tuning), guided by an in-context learning strategy. Our approach employs a three-step process for nuclei, cell, and subcellular segmentation, introducing a self-prompting mechanism that encodes morphological and topological priors using growing masks and strategically placed foreground/background points. We validate our method on both standard cell segmentation benchmarks and industry-relevant hit validation assays, demonstrating that it accurately segments biologically relevant structures without the need for dataset-specific tuning.

Related papers

• CellPainTR: Generalizable Representation Learning for Cross-Dataset Cell Painting Analysis [51.56484100374058]
  We introduce CellPainTR, a Transformer-based architecture designed to learn foundational representations of cellular morphology.<n>Our work represents a significant step towards creating truly foundational models for image-based profiling, enabling more reliable and scalable cross-study biological analysis.
  arXiv  Detail & Related papers  (2025-09-02T03:30:07Z)
• PathSegDiff: Pathology Segmentation using Diffusion model representations [63.20694440934692]
  We propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors.<n>Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H&E stained histopathology images.<n>Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets.
  arXiv  Detail & Related papers  (2025-04-09T14:58:21Z)
• CellPilot [3.2096430458509317]
  This work introduces CellPilot, a framework that bridges the gap between automatic and interactive segmentation. Our model was trained on over 675,000 masks of nine diverse cell and gland segmentation datasets, spanning 16 organs. We make the model and a graphical user interface designed to assist practitioners in creating large-scale annotated datasets available as open-source.
  arXiv  Detail & Related papers  (2024-11-23T10:31:10Z)
• Revisiting Adaptive Cellular Recognition Under Domain Shifts: A Contextual Correspondence View [49.03501451546763]
  We identify the importance of implicit correspondences across biological contexts for exploiting domain-invariant pathological composition. We propose self-adaptive dynamic distillation to secure instance-aware trade-offs across different model constituents.
  arXiv  Detail & Related papers  (2024-07-14T04:41:16Z)
• Virtually Objective Quantification of in vitro Wound Healing Scratch Assays with the Segment Anything Model [0.19999259391104385]
  In vitro scratch assay is widely used in cell biology to assess the rate of wound closure. In this paper, we make use of the segment anything model, a deep foundation model based on interactive point-prompts. Results attested very low intra- and interobserver variability, even compared to manual segmentation of domain experts.
  arXiv  Detail & Related papers  (2024-07-02T11:45:56Z)
• UniCell: Universal Cell Nucleus Classification via Prompt Learning [76.11864242047074]
  We propose a universal cell nucleus classification framework (UniCell) It employs a novel prompt learning mechanism to uniformly predict the corresponding categories of pathological images from different dataset domains. In particular, our framework adopts an end-to-end architecture for nuclei detection and classification, and utilizes flexible prediction heads for adapting various datasets.
  arXiv  Detail & Related papers  (2024-02-20T11:50:27Z)
• Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types [50.55583697209676]
  We develop an attention-enhanced graph autoencoder, which is designed to efficiently capture the topological features between cells. During the clustering process, we integrated both sets of information and reconstructed the features of both cells and genes to generate a discriminative representation. This research offers enhanced insights into the characteristics and distribution of cells, thereby laying the groundwork for early diagnosis and treatment of diseases.
  arXiv  Detail & Related papers  (2023-11-28T09:14:55Z)
• Lizard: A Large-Scale Dataset for Colonic Nuclear Instance Segmentation and Classification [4.642724910208435]
  We propose a multi-stage annotation pipeline to enable the collection of large-scale datasets for histology image analysis. We generate the largest known nuclear instance segmentation and classification dataset, containing nearly half a million labelled nuclei.
  arXiv  Detail & Related papers  (2021-08-25T11:58:52Z)
• Attention-Based Transformers for Instance Segmentation of Cells in Microstructures [22.215852332444904]
  We present a novel attention-based cell detection transformer (Cell-DETR) for direct end-to-end instance segmentation. While the segmentation performance is on par with a state-of-the-art instance segmentation method, Cell-DETR is simpler and faster. For the specific use case, the proposed method surpasses the state-of-the-art tools for semantic segmentation and additionally predicts the individual object instances.
  arXiv  Detail & Related papers  (2020-11-19T10:49:56Z)
• Multiclass Yeast Segmentation in Microstructured Environments with Deep Learning [20.456742449675904]
  We present convolutional neural networks trained for multiclass segmenting of individual yeast cells. We showcase the method's contribution to segmenting yeast in microstructured environments with a typical synthetic biology application.
  arXiv  Detail & Related papers  (2020-11-16T16:16:13Z)
• Towards an Automatic Analysis of CHO-K1 Suspension Growth in Microfluidic Single-cell Cultivation [63.94623495501023]
  We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data. Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
  arXiv  Detail & Related papers  (2020-10-20T08:36:51Z)
• Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images [51.893494939675314]
  We propose a novel weakly supervised segmentation framework based on partial points annotation. We show that our method can achieve competitive performance compared to the fully supervised counterpart and the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-07-10T15:41:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.