Co-Seg: Mutual Prompt-Guided Collaborative Learning for Tissue and Nuclei Segmentation

• URL: http://arxiv.org/abs/2509.06740v1
• Date: Mon, 08 Sep 2025 14:34:54 GMT
• Title: Co-Seg: Mutual Prompt-Guided Collaborative Learning for Tissue and Nuclei Segmentation
• Authors: Qing Xu, Wenting Duan, Zhen Chen,
• Abstract summary: Histopathology image analysis is critical yet challenged by the demand of segmenting tissue regions and nuclei instances.<n>Existing studies focused on tissue semantic segmentation or nuclei instance segmentation separately, but ignored the inherent relationship between these two tasks.<n>We propose a Co-Seg framework for collaborative tissue and nuclei segmentation.
• Score: 4.781574299202757
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Histopathology image analysis is critical yet challenged by the demand of segmenting tissue regions and nuclei instances for tumor microenvironment and cellular morphology analysis. Existing studies focused on tissue semantic segmentation or nuclei instance segmentation separately, but ignored the inherent relationship between these two tasks, resulting in insufficient histopathology understanding. To address this issue, we propose a Co-Seg framework for collaborative tissue and nuclei segmentation. Specifically, we introduce a novel co-segmentation paradigm, allowing tissue and nuclei segmentation tasks to mutually enhance each other. To this end, we first devise a region-aware prompt encoder (RP-Encoder) to provide high-quality semantic and instance region prompts as prior constraints. Moreover, we design a mutual prompt mask decoder (MP-Decoder) that leverages cross-guidance to strengthen the contextual consistency of both tasks, collaboratively computing semantic and instance segmentation masks. Extensive experiments on the PUMA dataset demonstrate that the proposed Co-Seg surpasses state-of-the-arts in the semantic, instance and panoptic segmentation of tumor tissues and nuclei instances. The source code is available at https://github.com/xq141839/Co-Seg.

Related papers

• TGC-Net: A Structure-Aware and Semantically-Aligned Framework for Text-Guided Medical Image Segmentation [56.09179939570486]
  We propose TGC-Net, a CLIP-based framework focusing on parameter-efficient, task-specific adaptations.<n>TGC-Net achieves state-of-the-art performance with substantially fewer trainable parameters, including notable Dice gains on challenging benchmarks.
  arXiv  Detail & Related papers  (2025-12-24T12:06:26Z)
• Co-Seg++: Mutual Prompt-Guided Collaborative Learning for Versatile Medical Segmentation [4.584473085778697]
  Medical image analysis is critical yet challenged by the need of jointly segmenting organs or tissues.<n>Existing studies typically formulated different segmentation tasks in isolation.<n>We propose a Co-Seg++ framework for versatile medical segmentation.
  arXiv  Detail & Related papers  (2025-06-20T17:05:09Z)
• Image Segmentation in Foundation Model Era: A Survey [95.60054312319939]
  Current research in image segmentation lacks a detailed analysis of distinct characteristics, challenges, and solutions.<n>This survey seeks to fill this gap by providing a thorough review of cutting-edge research centered around FM-driven image segmentation.<n>An exhaustive overview of over 300 segmentation approaches is provided to encapsulate the breadth of current research efforts.
  arXiv  Detail & Related papers  (2024-08-23T10:07:59Z)
• SEINE: Structure Encoding and Interaction Network for Nuclei Instance Segmentation [15.769396833096149]
  Similar visual presentation of intranuclear and extranuclear regions of chromophobe nuclei often causes under-segmentation. Current methods lack the exploration of nuclei structure, resulting in fragmented instance predictions. This paper proposes a structure encoding and interaction network, SEINE, which develops the structure modeling scheme of nuclei.
  arXiv  Detail & Related papers  (2024-01-18T07:44:04Z)
• DoNet: Deep De-overlapping Network for Cytology Instance Segmentation [7.321293750325454]
  We propose a De-overlapping Network (DoNet) in a decompose-and-recombined strategy. A Dual-path Region Module (DRM) explicitly decomposes the cell clusters into intersection and complement regions. A Mask-guided Region Proposal Strategy (MRP) integrates the cell attention maps for inner-cell instance prediction.
  arXiv  Detail & Related papers  (2023-03-25T06:26:50Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• BCS-Net: Boundary, Context and Semantic for Automatic COVID-19 Lung Infection Segmentation from CT Images [83.82141604007899]
  BCS-Net is a novel network for automatic COVID-19 lung infection segmentation from CT images. BCS-Net follows an encoder-decoder architecture, and more designs focus on the decoder stage. In each BCSR block, the attention-guided global context (AGGC) module is designed to learn the most valuable encoder features for decoder.
  arXiv  Detail & Related papers  (2022-07-17T08:54:07Z)
• Nuclei panoptic segmentation and composition regression with multi-task deep neural networks [0.12183405753834559]
  This report describes our proposed method submitted to the Colon Nuclei Identification and Counting (CoNIC) challenge. Our method employs a multi-task learning framework, which performs a panoptic segmentation task and a regression task. For the panoptic segmentation task, we use encoder-decoder type deep neural networks predicting a direction map in addition to a segmentation map in order to separate neighboring nuclei into different instances.
  arXiv  Detail & Related papers  (2022-02-23T22:09:37Z)
• Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation [55.1248480381153]
  We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
  arXiv  Detail & Related papers  (2021-03-30T13:41:12Z)
• Few-shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding [60.89561661441736]
  We propose a novel method for few-shot medical image segmentation. We construct our few-shot image segmentor using a deep convolutional network trained episodically. We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
  arXiv  Detail & Related papers  (2020-12-10T04:01:07Z)
• Multi-Modality Pathology Segmentation Framework: Application to Cardiac Magnetic Resonance Images [3.5354617056939874]
  This work presents an automatic cascade pathology segmentation framework based on multi-modality CMR images. It mainly consists of two neural networks: an anatomical structure segmentation network (ASSN) and a pathological region segmentation network (PRSN)
  arXiv  Detail & Related papers  (2020-08-13T09:57:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.