DiffRect: Latent Diffusion Label Rectification for Semi-supervised Medical Image Segmentation

• URL: http://arxiv.org/abs/2407.09918v1
• Date: Sat, 13 Jul 2024 15:27:31 GMT
• Title: DiffRect: Latent Diffusion Label Rectification for Semi-supervised Medical Image Segmentation
• Authors: Xinyu Liu, Wuyang Li, Yixuan Yuan,
• Abstract summary: We propose a Latent Label Rectification Model (DiffRect) for semi-supervised medical image segmentation. We evaluate DiffRect on three public datasets: ACDC, MS-CMRSEG 2019, and Decathlon Prostate.
• Score: 47.71546146966071
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Semi-supervised medical image segmentation aims to leverage limited annotated data and rich unlabeled data to perform accurate segmentation. However, existing semi-supervised methods are highly dependent on the quality of self-generated pseudo labels, which are prone to incorrect supervision and confirmation bias. Meanwhile, they are insufficient in capturing the label distributions in latent space and suffer from limited generalization to unlabeled data. To address these issues, we propose a Latent Diffusion Label Rectification Model (DiffRect) for semi-supervised medical image segmentation. DiffRect first utilizes a Label Context Calibration Module (LCC) to calibrate the biased relationship between classes by learning the category-wise correlation in pseudo labels, then apply Latent Feature Rectification Module (LFR) on the latent space to formulate and align the pseudo label distributions of different levels via latent diffusion. It utilizes a denoising network to learn the coarse to fine and fine to precise consecutive distribution transportations. We evaluate DiffRect on three public datasets: ACDC, MS-CMRSEG 2019, and Decathlon Prostate. Experimental results demonstrate the effectiveness of DiffRect, e.g. it achieves 82.40\% Dice score on ACDC with only 1\% labeled scan available, outperforms the previous state-of-the-art by 4.60\% in Dice, and even rivals fully supervised performance. Code is released at \url{https://github.com/CUHK-AIM-Group/DiffRect}.

Related papers

• Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition [50.61991746981703]
  Current state-of-the-art LTSSL approaches rely on high-quality pseudo-labels for large-scale unlabeled data. This paper introduces a novel probabilistic framework that unifies various recent proposals in long-tail learning. We introduce a continuous contrastive learning method, CCL, extending our framework to unlabeled data using reliable and smoothed pseudo-labels.
  arXiv  Detail & Related papers  (2024-10-08T15:06:10Z)
• Labeled-to-Unlabeled Distribution Alignment for Partially-Supervised Multi-Organ Medical Image Segmentation [30.953837550398884]
  Partially-supervised multi-organ medical image segmentation aims to develop a unified semantic segmentation model. We propose a labeled-to-unlabeled distribution alignment framework that aligns feature distributions and enhances discriminative capability. Our method outperforms the state-of-the-art partially-supervised methods by a considerable margin.
  arXiv  Detail & Related papers  (2024-09-05T03:55:37Z)
• Towards Modality-agnostic Label-efficient Segmentation with Entropy-Regularized Distribution Alignment [62.73503467108322]
  This topic is widely studied in 3D point cloud segmentation due to the difficulty of annotating point clouds densely. Until recently, pseudo-labels have been widely employed to facilitate training with limited ground-truth labels. Existing pseudo-labeling approaches could suffer heavily from the noises and variations in unlabelled data. We propose a novel learning strategy to regularize the pseudo-labels generated for training, thus effectively narrowing the gaps between pseudo-labels and model predictions.
  arXiv  Detail & Related papers  (2024-08-29T13:31:15Z)
• AdLER: Adversarial Training with Label Error Rectification for One-Shot Medical Image Segmentation [24.902447478719303]
  We propose a novel one-shot medical image segmentation method with adversarial training and label error rectification (AdLER) Specifically, we implement a novel dual consistency constraint to ensure anatomy-aligned registration that lessens registration errors. We also develop an adversarial training strategy to augment the atlas image, which ensures both generation diversity and segmentation robustness.
  arXiv  Detail & Related papers  (2023-09-02T16:06:50Z)
• Semi-Supervised Medical Image Segmentation with Co-Distribution Alignment [16.038016822861092]
  This paper proposes Co-Distribution Alignment (Co-DA) for semi-supervised medical image segmentation. Co-DA aligns marginal predictions on unlabeled data to marginal predictions on labeled data in a class-wise manner. We show that the proposed approach outperforms existing state-of-the-art semi-supervised medical image segmentation methods.
  arXiv  Detail & Related papers  (2023-07-24T09:08:30Z)
• All Points Matter: Entropy-Regularized Distribution Alignment for Weakly-supervised 3D Segmentation [67.30502812804271]
  Pseudo-labels are widely employed in weakly supervised 3D segmentation tasks where only sparse ground-truth labels are available for learning. We propose a novel learning strategy to regularize the generated pseudo-labels and effectively narrow the gaps between pseudo-labels and model predictions.
  arXiv  Detail & Related papers  (2023-05-25T08:19:31Z)
• Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation [15.815414883505722]
  In semi-supervised medical image segmentation, there exist empirical mismatch problems between labeled and unlabeled data distribution. We propose a straightforward method for alleviating the problem - copy-pasting labeled and unlabeled data bidirectionally. We show that the experiments show solid gains (e.g., over 21% Dice improvement on ACDC dataset with 5% labeled data) compared with other state-of-the-arts on various semi-supervised medical image segmentation datasets.
  arXiv  Detail & Related papers  (2023-05-01T06:06:51Z)
• Dist-PU: Positive-Unlabeled Learning from a Label Distribution Perspective [89.5370481649529]
  We propose a label distribution perspective for PU learning in this paper. Motivated by this, we propose to pursue the label distribution consistency between predicted and ground-truth label distributions. Experiments on three benchmark datasets validate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-12-06T07:38:29Z)
• Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigation [30.688753736660725]
  We present a simple and yet effective Distribution Alignment and Random Sampling (DARS) method to produce unbiased pseudo labels. Our method performs favorably in comparison with state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-07-23T14:45:14Z)
• ATSO: Asynchronous Teacher-Student Optimization for Semi-Supervised Medical Image Segmentation [99.90263375737362]
  We propose ATSO, an asynchronous version of teacher-student optimization. ATSO partitions the unlabeled data into two subsets and alternately uses one subset to fine-tune the model and updates the label on the other subset. We evaluate ATSO on two popular medical image segmentation datasets and show its superior performance in various semi-supervised settings.
  arXiv  Detail & Related papers  (2020-06-24T04:05:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.