ε-Seg: Sparsely Supervised Semantic Segmentation of Microscopy Data

• URL: http://arxiv.org/abs/2510.18637v2
• Date: Thu, 30 Oct 2025 18:38:06 GMT
• Title: ε-Seg: Sparsely Supervised Semantic Segmentation of Microscopy Data
• Authors: Sheida Rahnamai Kordasiabi, Damian Dalle Nogare, Florian Jug,
• Abstract summary: epsilon-Seg is a method based on hierarchical variational autoencoders (HVAEs)<n>We introduce epsilon-Seg, employing center-region masking, label contrastive learning (CL), a Gaussian mixture model (GMM) prior, and clustering-free label prediction.<n>Our results show that epsilon-Seg is capable of achieving competitive sparsely-supervised segmentation results on complex biological image data.
• Score: 6.617593699054488
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semantic segmentation of electron microscopy (EM) images of biological samples remains a challenge in the life sciences. EM data captures details of biological structures, sometimes with such complexity that even human observers can find it overwhelming. We introduce {\epsilon}-Seg, a method based on hierarchical variational autoencoders (HVAEs), employing center-region masking, sparse label contrastive learning (CL), a Gaussian mixture model (GMM) prior, and clustering-free label prediction. Center-region masking and the inpainting loss encourage the model to learn robust and representative embeddings to distinguish the desired classes, even if training labels are sparse (0.05% of the total image data or less). For optimal performance, we employ CL and a GMM prior to shape the latent space of the HVAE such that encoded input patches tend to cluster wrt. the semantic classes we wish to distinguish. Finally, instead of clustering latent embeddings for semantic segmentation, we propose a MLP semantic segmentation head to directly predict class labels from latent embeddings. We show empirical results of {\epsilon}-Seg and baseline methods on 2 dense EM datasets of biological tissues and demonstrate the applicability of our method also on fluorescence microscopy data. Our results show that {\epsilon}-Seg is capable of achieving competitive sparsely-supervised segmentation results on complex biological image data, even if only limited amounts of training labels are available.

Related papers

• LPD: Learnable Prototypes with Diversity Regularization for Weakly Supervised Histopathology Segmentation [17.25487101903999]
  Weakly supervised semantic segmentation (WSSS) in histopathology is hindered by inter-class homogeneity, intra-class heterogeneity, and CAM-induced region shrinkage.<n>We propose a cluster-free, one-stage learnable-prototype framework with diversity regularization to enhance morphological intra-class heterogeneity coverage.<n>Our approach achieves state-of-the-art (SOTA) performance on BCSS-WSSS, outperforming prior methods in mIoU and mDice.
  arXiv  Detail & Related papers  (2025-12-05T17:59:16Z)
• ConformalSAM: Unlocking the Potential of Foundational Segmentation Models in Semi-Supervised Semantic Segmentation with Conformal Prediction [57.930531826380836]
  This work explores whether a foundational segmentation model can address label scarcity in the pixel-level vision task as an annotator for unlabeled images.<n>We propose ConformalSAM, a novel SSSS framework which first calibrates the foundation model using the target domain's labeled data and then filters out unreliable pixel labels of unlabeled data.
  arXiv  Detail & Related papers  (2025-07-21T17:02:57Z)
• PathSegDiff: Pathology Segmentation using Diffusion model representations [63.20694440934692]
  We propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors.<n>Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H&E stained histopathology images.<n>Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets.
  arXiv  Detail & Related papers  (2025-04-09T14:58:21Z)
• Neighbor Does Matter: Density-Aware Contrastive Learning for Medical Semi-supervised Segmentation [17.69408044083565]
  We argue that supervisory information can be directly extracted from the geometry of the feature space.<n>Inspired by the density-based clustering hypothesis, we propose using feature density to locate sparse regions within feature clusters.<n>Our method constructs density-aware neighbor graphs using labeled and unlabeled data samples to estimate feature density and locate sparse regions.
  arXiv  Detail & Related papers  (2024-12-27T13:57:57Z)
• CLASS-M: Adaptive stain separation-based contrastive learning with pseudo-labeling for histopathological image classification [1.9574002186090493]
  We propose a semi-supervised patch-level histological image classification model, named CLASS-M, that does not require extensively labeled datasets. We compare our model with other state-of-the-art models on two clear cell renal cell carcinoma datasets.
  arXiv  Detail & Related papers  (2023-12-12T04:38:30Z)
• Optimizations of Autoencoders for Analysis and Classification of Microscopic In Situ Hybridization Images [68.8204255655161]
  We propose a deep-learning framework to detect and classify areas of microscopic images with similar levels of gene expression. The data we analyze requires an unsupervised learning model for which we employ a type of Artificial Neural Network - Deep Learning Autoencoders.
  arXiv  Detail & Related papers  (2023-04-19T13:45:28Z)
• Linking data separation, visual separation, and classifier performance using pseudo-labeling by contrastive learning [125.99533416395765]
  We argue that the performance of the final classifier depends on the data separation present in the latent space and visual separation present in the projection. We demonstrate our results by the classification of five real-world challenging image datasets of human intestinal parasites with only 1% supervised samples.
  arXiv  Detail & Related papers  (2023-02-06T10:01:38Z)
• Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey [6.144134660210243]
  deep learning algorithms achieved impressive results in both pixel-level labeling and the labeling of separate instances of the same class. In this review, we examine how these algorithms were adapted to the task of segmenting cellular and sub-cellular structures in EM images.
  arXiv  Detail & Related papers  (2022-06-14T20:57:49Z)
• Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimation [94.16816278191477]
  We present a framework for semi-adaptive and domain-supervised semantic segmentation. It is enhanced by self-supervised monocular depth estimation trained only on unlabeled image sequences. We validate the proposed model on the Cityscapes dataset.
  arXiv  Detail & Related papers  (2021-08-28T01:33:38Z)
• Towards Robust Partially Supervised Multi-Structure Medical Image Segmentation on Small-Scale Data [123.03252888189546]
  We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity. Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels. Our research suggests a new research direction in label-efficient deep learning with partial supervision.
  arXiv  Detail & Related papers  (2020-11-28T16:31:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.