Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation
- URL: http://arxiv.org/abs/2305.00673v1
- Date: Mon, 1 May 2023 06:06:51 GMT
- Title: Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation
- Authors: Yunhao Bai, Duowen Chen, Qingli Li, Wei Shen and Yan Wang
- Abstract summary: In semi-supervised medical image segmentation, there exist empirical mismatch problems between labeled and unlabeled data distribution.
We propose a straightforward method for alleviating the problem - copy-pasting labeled and unlabeled data bidirectionally.
We show that the experiments show solid gains (e.g., over 21% Dice improvement on ACDC dataset with 5% labeled data) compared with other state-of-the-arts on various semi-supervised medical image segmentation datasets.
- Score: 15.815414883505722
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In semi-supervised medical image segmentation, there exist empirical mismatch
problems between labeled and unlabeled data distribution. The knowledge learned
from the labeled data may be largely discarded if treating labeled and
unlabeled data separately or in an inconsistent manner. We propose a
straightforward method for alleviating the problem - copy-pasting labeled and
unlabeled data bidirectionally, in a simple Mean Teacher architecture. The
method encourages unlabeled data to learn comprehensive common semantics from
the labeled data in both inward and outward directions. More importantly, the
consistent learning procedure for labeled and unlabeled data can largely reduce
the empirical distribution gap. In detail, we copy-paste a random crop from a
labeled image (foreground) onto an unlabeled image (background) and an
unlabeled image (foreground) onto a labeled image (background), respectively.
The two mixed images are fed into a Student network and supervised by the mixed
supervisory signals of pseudo-labels and ground-truth. We reveal that the
simple mechanism of copy-pasting bidirectionally between labeled and unlabeled
data is good enough and the experiments show solid gains (e.g., over 21% Dice
improvement on ACDC dataset with 5% labeled data) compared with other
state-of-the-arts on various semi-supervised medical image segmentation
datasets. Code is available at https://github.com/DeepMed-Lab-ECNU/BCP}.
Related papers
- GuidedNet: Semi-Supervised Multi-Organ Segmentation via Labeled Data Guide Unlabeled Data [4.775846640214768]
Semi-supervised multi-organ medical image segmentation aids physicians in improving disease diagnosis and treatment planning.
A key concept is that voxel features from labeled and unlabeled data close each other in the feature space more likely to belong to the same class.
We introduce a Knowledge Transfer Cross Pseudo-label Supervision (KT-CPS) strategy, which leverages the prior knowledge obtained from the labeled data to guide the training of the unlabeled data.
arXiv Detail & Related papers (2024-08-09T07:46:01Z) - DiffRect: Latent Diffusion Label Rectification for Semi-supervised Medical Image Segmentation [47.71546146966071]
We propose a Latent Label Rectification Model (DiffRect) for semi-supervised medical image segmentation.
We evaluate DiffRect on three public datasets: ACDC, MS-CMRSEG 2019, and Decathlon Prostate.
arXiv Detail & Related papers (2024-07-13T15:27:31Z) - You can't handle the (dirty) truth: Data-centric insights improve pseudo-labeling [60.27812493442062]
We show the importance of investigating labeled data quality to improve any pseudo-labeling method.
Specifically, we introduce a novel data characterization and selection framework called DIPS to extend pseudo-labeling.
We demonstrate the applicability and impact of DIPS for various pseudo-labeling methods across an extensive range of real-world datasets.
arXiv Detail & Related papers (2024-06-19T17:58:40Z) - Leveraging Fixed and Dynamic Pseudo-labels for Semi-supervised Medical Image Segmentation [7.9449756510822915]
Semi-supervised medical image segmentation has gained growing interest due to its ability to utilize unannotated data.
The current state-of-the-art methods mostly rely on pseudo-labeling within a co-training framework.
We propose a novel approach where multiple pseudo-labels for the same unannotated image are used to learn from the unlabeled data.
arXiv Detail & Related papers (2024-05-12T11:30:01Z) - Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for
Semi-Supervised Medical Image Segmentation [13.707121013895929]
We present a novel semi-supervised learning method, Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation.
We use distinct decoders for student and teacher networks while maintain the same encoder.
To learn from unlabeled data, we create pseudo-labels generated by the teacher networks and augment the training data with the pseudo-labels.
arXiv Detail & Related papers (2023-08-31T09:13:34Z) - Improving Semi-supervised Deep Learning by using Automatic Thresholding
to Deal with Out of Distribution Data for COVID-19 Detection using Chest
X-ray Images [0.0]
We propose an automatic thresholding method to filter out-of-distribution data in the unlabeled dataset.
We test two simple automatic thresholding methods in the context of training a COVID-19 detector using chest X-ray images.
arXiv Detail & Related papers (2022-11-03T20:56:45Z) - Mutual- and Self- Prototype Alignment for Semi-supervised Medical Image
Segmentation [5.426994893258762]
We propose a mutual- and self- prototype alignment (MSPA) framework to better utilize the unlabeled data.
In specific, mutual-prototype alignment enhances the information interaction between labeled and unlabeled data.
Our method also outperforms seven state-of-the-art semi-supervised segmentation methods on all three datasets.
arXiv Detail & Related papers (2022-06-03T02:59:22Z) - GuidedMix-Net: Semi-supervised Semantic Segmentation by Using Labeled
Images as Reference [90.5402652758316]
We propose a novel method for semi-supervised semantic segmentation named GuidedMix-Net.
It uses labeled information to guide the learning of unlabeled instances.
It achieves competitive segmentation accuracy and significantly improves the mIoU by +7$%$ compared to previous approaches.
arXiv Detail & Related papers (2021-12-28T06:48:03Z) - OpenCoS: Contrastive Semi-supervised Learning for Handling Open-set
Unlabeled Data [65.19205979542305]
Unlabeled data may include out-of-class samples in practice.
OpenCoS is a method for handling this realistic semi-supervised learning scenario.
arXiv Detail & Related papers (2021-06-29T06:10:05Z) - GuidedMix-Net: Learning to Improve Pseudo Masks Using Labeled Images as
Reference [153.354332374204]
We propose a novel method for semi-supervised semantic segmentation named GuidedMix-Net.
We first introduce a feature alignment objective between labeled and unlabeled data to capture potentially similar image pairs.
MITrans is shown to be a powerful knowledge module for further progressive refining features of unlabeled data.
Along with supervised learning for labeled data, the prediction of unlabeled data is jointly learned with the generated pseudo masks.
arXiv Detail & Related papers (2021-06-29T02:48:45Z) - ATSO: Asynchronous Teacher-Student Optimization for Semi-Supervised
Medical Image Segmentation [99.90263375737362]
We propose ATSO, an asynchronous version of teacher-student optimization.
ATSO partitions the unlabeled data into two subsets and alternately uses one subset to fine-tune the model and updates the label on the other subset.
We evaluate ATSO on two popular medical image segmentation datasets and show its superior performance in various semi-supervised settings.
arXiv Detail & Related papers (2020-06-24T04:05:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.