Unsupervised Learning of Cell Instances with Generative Routing Pyramids

• URL: http://arxiv.org/abs/2608.16810v1
• Date: Mon, 17 Aug 2026 17:03:32 GMT
• Title: Unsupervised Learning of Cell Instances with Generative Routing Pyramids
• Abstract summary: We describe a new unsupervised method for cell instance segmentation and phenotypic classification from unlabeled microscopy images.<n>Our method is based on reconstructing each image using a coarse-to-fine routing pyramid that associates pixels with spatially sparse latent sources.<n>We demonstrate competitive performance in instance segmentation across diverse cell morphologies and imaging modalities.
• Score: 3.910659311729392
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Identifying and representing object instances such as cells or nuclei is a common task in microscopy image analysis. Established machine learning workflows typically use supervised detection or segmentation followed by feature extraction or classification, which requires manual annotations and treats instance segmentation and cell representation as separate stages. We describe a new unsupervised method for cell instance segmentation and phenotypic classification from unlabeled microscopy images. Our method is based on reconstructing each image using a coarse-to-fine routing pyramid that associates pixels with spatially sparse latent sources. The resulting pixel-to-latent associations yield instance masks, while the source latents encode cell morphology. We demonstrate competitive performance in instance segmentation across diverse cell morphologies and imaging modalities, as well as generative modeling of cellular phenotypes under perturbations. Source code and checkpoints are available at https://github.com/weigertlab/routing-pyramids.

Related papers

• End-to-End Cell Detection via Instance-aware Graph Modeling [31.98156719497261]
  We propose an end-to-end framework for cell detection and classification.<n>It incorporates a dynamic graph construction module and an instance-aware graph network.<n>Our method significantly outperforms existing approaches in both detection and classification performance.
  arXiv  Detail & Related papers  (2026-09-14T10:37:19Z)
• Self-supervised Representation Learning with Local Aggregation for Image-based Profiling [84.52554180480037]
  Image-based cell profiling aims to create informative representations of cell images.<n>Recent developments in non-contrastive Self-Supervised Learning have inspired this paper.<n>We introduce specialized data augmentation and representation post-processing methods tailored to cell images.
  arXiv  Detail & Related papers  (2025-06-17T07:25:57Z)
• Unsupervised cell segmentation by fast Gaussian Processes [6.709057867802485]
  We develop a novel unsupervised cell segmentation algorithm based on fast Gaussian processes for noisy microscopy images.<n>We derived robust thresholding criteria adaptive for heterogeneous images containing distinct brightness at different parts to separate objects from the background.
  arXiv  Detail & Related papers  (2025-05-24T23:28:14Z)
• PathSegDiff: Pathology Segmentation using Diffusion model representations [63.20694440934692]
  We propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors.<n>Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H&E stained histopathology images.<n>Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets.
  arXiv  Detail & Related papers  (2025-04-09T14:58:21Z)
• CellMixer: Annotation-free Semantic Cell Segmentation of Heterogeneous Cell Populations [9.335273591976648]
  We present CellMixer, an innovative annotation-free approach for the semantic segmentation of heterogeneous cell populations. Our results show that CellMixer can achieve competitive segmentation performance across multiple cell types and imaging modalities.
  arXiv  Detail & Related papers  (2023-12-01T15:50:20Z)
• Multi-stream Cell Segmentation with Low-level Cues for Multi-modality Images [66.79688768141814]
  We develop an automatic cell classification pipeline to label microscopy images. We then train a classification model based on the category labels. We deploy two types of segmentation models to segment cells with roundish and irregular shapes.
  arXiv  Detail & Related papers  (2023-10-22T08:11:08Z)
• Affine-Consistent Transformer for Multi-Class Cell Nuclei Detection [76.11864242047074]
  We propose a novel Affine-Consistent Transformer (AC-Former), which directly yields a sequence of nucleus positions. We introduce an Adaptive Affine Transformer (AAT) module, which can automatically learn the key spatial transformations to warp original images for local network training. Experimental results demonstrate that the proposed method significantly outperforms existing state-of-the-art algorithms on various benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T02:27:02Z)
• A Generalist Framework for Panoptic Segmentation of Images and Videos [61.61453194912186]
  We formulate panoptic segmentation as a discrete data generation problem, without relying on inductive bias of the task. A diffusion model is proposed to model panoptic masks, with a simple architecture and generic loss function. Our method is capable of modeling video (in a streaming setting) and thereby learns to track object instances automatically.
  arXiv  Detail & Related papers  (2022-10-12T16:18:25Z)
• Learning multi-scale functional representations of proteins from single-cell microscopy data [77.34726150561087]
  We show that simple convolutional networks trained on localization classification can learn protein representations that encapsulate diverse functional information. We also propose a robust evaluation strategy to assess quality of protein representations across different scales of biological function.
  arXiv  Detail & Related papers  (2022-05-24T00:00:07Z)
• Search for temporal cell segmentation robustness in phase-contrast microscopy videos [31.92922565397439]
  In this work, we present a deep learning-based workflow to segment cancer cells embedded in 3D collagen matrices. We also propose a geometrical-characterization approach to studying cancer cell morphology. We introduce a new annotated dataset for 2D cell segmentation and tracking, and an open-source implementation to replicate the experiments or adapt them to new image processing problems.
  arXiv  Detail & Related papers  (2021-12-16T12:03:28Z)
• Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images [1.408123603417833]
  We propose a novel cell instance segmentation approach based on the well-known U-Net architecture. To enforce the learning of morphological information per pixel, a deep distance transformer (DDT) acts as a back-bone model. The obtained results suggest a performance boost over traditional U-Net architectures.
  arXiv  Detail & Related papers  (2021-06-10T15:54:38Z)
• Few-Shot Microscopy Image Cell Segmentation [15.510258960276083]
  Automatic cell segmentation in microscopy images works well with the support of deep neural networks trained with full supervision. We propose the combination of three objective functions to segment the cells, move the segmentation results away from the classification boundary. Our experiments on five public databases show promising results from 1- to 10-shot meta-learning.
  arXiv  Detail & Related papers  (2020-06-29T12:12:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.