S&D Messenger: Exchanging Semantic and Domain Knowledge for Generic Semi-Supervised Medical Image Segmentation

• URL: http://arxiv.org/abs/2407.07763v1
• Date: Wed, 10 Jul 2024 15:39:47 GMT
• Title: S&D Messenger: Exchanging Semantic and Domain Knowledge for Generic Semi-Supervised Medical Image Segmentation
• Authors: Qixiang Zhang, Haonan Wang, Xiaomeng Li,
• Abstract summary: Semi-supervised medical image segmentation (SSMIS) has emerged as a promising solution to tackle the challenges of time-consuming manual labeling in the medical field. In this paper, we aim to develop a generic framework that masters all three tasks.
• Score: 14.628436886574882
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Semi-supervised medical image segmentation (SSMIS) has emerged as a promising solution to tackle the challenges of time-consuming manual labeling in the medical field. However, in practical scenarios, there are often domain variations within the datasets, leading to derivative scenarios like semi-supervised medical domain generalization (Semi-MDG) and unsupervised medical domain adaptation (UMDA). In this paper, we aim to develop a generic framework that masters all three tasks. We notice a critical shared challenge across three scenarios: the explicit semantic knowledge for segmentation performance and rich domain knowledge for generalizability exclusively exist in the labeled set and unlabeled set respectively. Such discrepancy hinders existing methods from effectively comprehending both types of knowledge under semi-supervised settings. To tackle this challenge, we develop a Semantic & Domain Knowledge Messenger (S&D Messenger) which facilitates direct knowledge delivery between the labeled and unlabeled set, and thus allowing the model to comprehend both of them in each individual learning flow. Equipped with our S&D Messenger, a naive pseudo-labeling method can achieve huge improvement on six benchmark datasets for SSMIS (+7.5%), UMDA (+5.6%), and Semi-MDG tasks (+1.14%), compared with state-of-the-art methods designed for specific tasks.

Related papers

• MedSeqFT: Sequential Fine-tuning Foundation Models for 3D Medical Image Segmentation [55.37355146924576]
  MedSeqFT is a sequential fine-tuning framework for medical image analysis.<n>It adapts pre-trained models to new tasks while refining their representational capacity.<n>It consistently outperforms state-of-the-art fine-tuning strategies.
  arXiv  Detail & Related papers  (2025-09-07T15:22:53Z)
• Diverse Teaching and Label Propagation for Generic Semi-Supervised Medical Image Segmentation [16.657966370261494]
  We develop a generic framework that masters all three tasks.<n>Key to solving the problem lies in how to generate reliable pseudo labels for the unlabeled data.<n>We evaluate our proposed framework on five benchmark datasets.
  arXiv  Detail & Related papers  (2025-08-12T01:33:30Z)
• CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentation [32.48945636401865]
  We introduce a novel model named CRISP-SAM2 with CRoss-modal Interaction and Semantic Prompting based on SAM2.<n>This model represents a promising approach to multi-organ medical segmentation guided by textual descriptions of organs.<n>Our method begins by converting visual and textual inputs into cross-modal contextualized semantics.
  arXiv  Detail & Related papers  (2025-06-29T07:05:27Z)
• Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning [57.873833577058]
  We build a multimodal dataset enriched with extensive medical knowledge.<n>We then introduce our medical-specialized MLLM: Lingshu.<n>Lingshu undergoes multi-stage training to embed medical expertise and enhance its task-solving capabilities.
  arXiv  Detail & Related papers  (2025-06-08T08:47:30Z)
• DuSSS: Dual Semantic Similarity-Supervised Vision-Language Model for Semi-Supervised Medical Image Segmentation [4.523111195300109]
  Semi-supervised medical image segmentation (SSMIS) uses consistency learning to regularize model training. SSMIS often suffers from error supervision from low-quality pseudo labels. We propose a Dual Semantic Similarity-Supervised VLM (DuSSS) for SSMIS.
  arXiv  Detail & Related papers  (2024-12-17T02:47:00Z)
• LIMIS: Towards Language-based Interactive Medical Image Segmentation [58.553786162527686]
  LIMIS is the first purely language-based interactive medical image segmentation model. We adapt Grounded SAM to the medical domain and design a language-based model interaction strategy. We evaluate LIMIS on three publicly available medical datasets in terms of performance and usability.
  arXiv  Detail & Related papers  (2024-10-22T12:13:47Z)
• Manifold-Aware Local Feature Modeling for Semi-Supervised Medical Image Segmentation [20.69908466577971]
  We introduce the Manifold-Aware Local Feature Modeling Network (MANet), which enhances the U-Net architecture by incorporating manifold supervision signals. Our experiments on datasets such as ACDC, LA, and Pancreas-NIH demonstrate that MANet consistently surpasses state-of-the-art methods in performance metrics.
  arXiv  Detail & Related papers  (2024-10-14T08:40:35Z)
• The Devil is in the Statistics: Mitigating and Exploiting Statistics Difference for Generalizable Semi-supervised Medical Image Segmentation [36.45117307751509]
  Semi-supervised domain generalization has been proposed to combat this challenge. We observe that domain shifts between medical institutions cause disparate feature statistics. This phenomenon could be exploited to facilitate unseen domain generalization.
  arXiv  Detail & Related papers  (2024-07-16T03:41:48Z)
• Multi-Level Global Context Cross Consistency Model for Semi-Supervised Ultrasound Image Segmentation with Diffusion Model [0.0]
  We propose a framework that uses images generated by a Latent Diffusion Model (LDM) as unlabeled images for semi-supervised learning. Our approach enables the effective transfer of probability distribution knowledge to the segmentation network, resulting in improved segmentation accuracy.
  arXiv  Detail & Related papers  (2023-05-16T14:08:24Z)
• MultiMatch: Multi-task Learning for Semi-supervised Domain Generalization [55.06956781674986]
  We resort to solving the semi-supervised domain generalization task, where there are a few label information in each source domain. We propose MultiMatch, extending FixMatch to the multi-task learning framework, producing the high-quality pseudo-label for SSDG. A series of experiments validate the effectiveness of the proposed method, and it outperforms the existing semi-supervised methods and the SSDG method on several benchmark DG datasets.
  arXiv  Detail & Related papers  (2022-08-11T14:44:33Z)
• One-Shot Medical Landmark Localization by Edge-Guided Transform and Noisy Landmark Refinement [59.14062241534754]
  We propose a two-stage framework for one-shot medical landmark localization. In stage I, we learn an end-to-end cascade of global alignment and local deformations, under the guidance of novel loss functions. In stage II, we explore self-consistency for selecting reliable pseudo labels and cross-consistency for semi-supervised learning.
  arXiv  Detail & Related papers  (2022-07-31T15:42:28Z)
• ACT: Semi-supervised Domain-adaptive Medical Image Segmentation with Asymmetric Co-training [34.017031149886556]
  Unsupervised domain adaptation (UDA) has been vastly explored to alleviate domain shifts between source and target domains. We propose to exploit both labeled source and target domain data, in addition to unlabeled target data in a unified manner. We present a novel asymmetric co-training (ACT) framework to integrate these subsets and avoid the domination of the source domain data.
  arXiv  Detail & Related papers  (2022-06-05T23:48:00Z)
• Cross-Modality Brain Tumor Segmentation via Bidirectional Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
  In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme. Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor. The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
  arXiv  Detail & Related papers  (2021-05-17T10:11:45Z)
• mDALU: Multi-Source Domain Adaptation and Label Unification with Partial Datasets [102.62639692656458]
  This paper treats this task as a multi-source domain adaptation and label unification problem. Our method consists of a partially-supervised adaptation stage and a fully-supervised adaptation stage. We verify the method on three different tasks, image classification, 2D semantic image segmentation, and joint 2D-3D semantic segmentation.
  arXiv  Detail & Related papers  (2020-12-15T15:58:03Z)
• Collaborative Unsupervised Domain Adaptation for Medical Image Diagnosis [102.40869566439514]
  We seek to exploit rich labeled data from relevant domains to help the learning in the target task via Unsupervised Domain Adaptation (UDA) Unlike most UDA methods that rely on clean labeled data or assume samples are equally transferable, we innovatively propose a Collaborative Unsupervised Domain Adaptation algorithm. We theoretically analyze the generalization performance of the proposed method, and also empirically evaluate it on both medical and general images.
  arXiv  Detail & Related papers  (2020-07-05T11:49:17Z)
• Uncertainty-aware multi-view co-training for semi-supervised medical image segmentation and domain adaptation [35.33425093398756]
  Unlabeled data is much easier to acquire than well-annotated data. We propose uncertainty-aware multi-view co-training for medical image segmentation. Our framework is capable of efficiently utilizing unlabeled data for better performance.
  arXiv  Detail & Related papers  (2020-06-28T22:04:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.