Competitive Ensembling Teacher-Student Framework for Semi-Supervised
Left Atrium MRI Segmentation
- URL: http://arxiv.org/abs/2310.13955v1
- Date: Sat, 21 Oct 2023 09:23:34 GMT
- Title: Competitive Ensembling Teacher-Student Framework for Semi-Supervised
Left Atrium MRI Segmentation
- Authors: Yuyan Shi, Yichi Zhang, Shasha Wang
- Abstract summary: Semi-supervised learning has greatly advanced medical image segmentation since it effectively alleviates the need of acquiring abundant annotations from experts.
In this paper, we present a simple yet efficient competitive ensembling teacher student framework for semi-supervised for left atrium segmentation from 3D MR images.
- Score: 8.338801567668233
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Semi-supervised learning has greatly advanced medical image segmentation
since it effectively alleviates the need of acquiring abundant annotations from
experts and utilizes unlabeled data which is much easier to acquire. Among
existing perturbed consistency learning methods, mean-teacher model serves as a
standard baseline for semi-supervised medical image segmentation. In this
paper, we present a simple yet efficient competitive ensembling teacher student
framework for semi-supervised for left atrium segmentation from 3D MR images,
in which two student models with different task-level disturbances are
introduced to learn mutually, while a competitive ensembling strategy is
performed to ensemble more reliable information to teacher model. Different
from the one-way transfer between teacher and student models, our framework
facilitates the collaborative learning procedure of different student models
with the guidance of teacher model and motivates different training networks
for a competitive learning and ensembling procedure to achieve better
performance. We evaluate our proposed method on the public Left Atrium (LA)
dataset and it obtains impressive performance gains by exploiting the unlabeled
data effectively and outperforms several existing semi-supervised methods.
Related papers
- Alternate Diverse Teaching for Semi-supervised Medical Image Segmentation [62.021828104757745]
We propose AD-MT, an alternate diverse teaching approach in a teacher-student framework.
It involves a single student model and two non-trainable teacher models that are momentum-updated periodically and randomly in an alternate fashion.
arXiv Detail & Related papers (2023-11-29T02:44:54Z) - Multi-Scale Cross Contrastive Learning for Semi-Supervised Medical Image
Segmentation [14.536384387956527]
We develop a novel Multi-Scale Cross Supervised Contrastive Learning framework to segment structures in medical images.
Our approach contrasts multi-scale features based on ground-truth and cross-predicted labels, in order to extract robust feature representations.
It outperforms state-of-the-art semi-supervised methods by more than 3.0% in Dice.
arXiv Detail & Related papers (2023-06-25T16:55:32Z) - Enhanced Multimodal Representation Learning with Cross-modal KD [14.14709952127258]
This paper explores leveraging auxiliary modalities which are only available at training to enhance multimodal representation learning through cross-modal Knowledge Distillation (KD)
The widely adopted mutual information-based objective leads to a short-cut solution of the weak teacher, i.e., achieving the maximum mutual information by simply making the teacher model as weak as the student model.
To prevent such a weak solution, we introduce an additional objective term, i.e., the mutual information between the teacher and the auxiliary modality model.
arXiv Detail & Related papers (2023-06-13T09:35:37Z) - Distantly-Supervised Named Entity Recognition with Adaptive Teacher
Learning and Fine-grained Student Ensemble [56.705249154629264]
Self-training teacher-student frameworks are proposed to improve the robustness of NER models.
In this paper, we propose an adaptive teacher learning comprised of two teacher-student networks.
Fine-grained student ensemble updates each fragment of the teacher model with a temporal moving average of the corresponding fragment of the student, which enhances consistent predictions on each model fragment against noise.
arXiv Detail & Related papers (2022-12-13T12:14:09Z) - Adversarial Dual-Student with Differentiable Spatial Warping for
Semi-Supervised Semantic Segmentation [70.2166826794421]
We propose a differentiable geometric warping to conduct unsupervised data augmentation.
We also propose a novel adversarial dual-student framework to improve the Mean-Teacher.
Our solution significantly improves the performance and state-of-the-art results are achieved on both datasets.
arXiv Detail & Related papers (2022-03-05T17:36:17Z) - Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation [12.940103904327655]
We propose a novel dual-task mutual learning framework for semi-supervised medical image segmentation.
Our framework can be formulated as an integration of two individual segmentation networks based on two tasks.
By jointly learning the segmentation probability maps and signed distance maps of targets, our framework can enforce the geometric shape constraint and learn more reliable information.
arXiv Detail & Related papers (2021-03-08T12:38:23Z) - Semi-supervised Left Atrium Segmentation with Mutual Consistency
Training [60.59108570938163]
We propose a novel Mutual Consistency Network (MC-Net) for semi-supervised left atrium segmentation from 3D MR images.
Our MC-Net consists of one encoder and two slightly different decoders, and the prediction discrepancies of two decoders are transformed as an unsupervised loss.
We evaluate our MC-Net on the public Left Atrium (LA) database and it obtains impressive performance gains by exploiting the unlabeled data effectively.
arXiv Detail & Related papers (2021-03-04T09:34:32Z) - Dual-Teacher: Integrating Intra-domain and Inter-domain Teachers for
Annotation-efficient Cardiac Segmentation [65.81546955181781]
We propose a novel semi-supervised domain adaptation approach, namely Dual-Teacher.
The student model learns the knowledge of unlabeled target data and labeled source data by two teacher models.
We demonstrate that our approach is able to concurrently utilize unlabeled data and cross-modality data with superior performance.
arXiv Detail & Related papers (2020-07-13T10:00:44Z) - Unpaired Multi-modal Segmentation via Knowledge Distillation [77.39798870702174]
We propose a novel learning scheme for unpaired cross-modality image segmentation.
In our method, we heavily reuse network parameters, by sharing all convolutional kernels across CT and MRI.
We have extensively validated our approach on two multi-class segmentation problems.
arXiv Detail & Related papers (2020-01-06T20:03:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.