MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets
- URL: http://arxiv.org/abs/2108.02559v1
- Date: Thu, 5 Aug 2021 12:29:26 GMT
- Title: MS-KD: Multi-Organ Segmentation with Multiple Binary-Labeled Datasets
- Authors: Shixiang Feng, Yuhang Zhou, Xiaoman Zhang, Ya Zhang, and Yanfeng Wang
- Abstract summary: This paper investigates how to learn a multi-organ segmentation model leveraging a set of binary-labeled datasets.
A novel Multi-teacher Single-student Knowledge Distillation (MS-KD) framework is proposed.
- Score: 20.60290563940572
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Annotating multiple organs in 3D medical images is time-consuming and costly.
Meanwhile, there exist many single-organ datasets with one specific organ
annotated. This paper investigates how to learn a multi-organ segmentation
model leveraging a set of binary-labeled datasets. A novel Multi-teacher
Single-student Knowledge Distillation (MS-KD) framework is proposed, where the
teacher models are pre-trained single-organ segmentation networks, and the
student model is a multi-organ segmentation network. Considering that each
teacher focuses on different organs, a region-based supervision method,
consisting of logits-wise supervision and feature-wise supervision, is
proposed. Each teacher supervises the student in two regions, the organ region
where the teacher is considered as an expert and the background region where
all teachers agree. Extensive experiments on three public single-organ datasets
and a multi-organ dataset have demonstrated the effectiveness of the proposed
MS-KD framework.
Related papers
- Dual-Teacher Ensemble Models with Double-Copy-Paste for 3D Semi-Supervised Medical Image Segmentation [31.460549289419923]
Semi-supervised learning (SSL) techniques address the high labeling costs in 3D medical image segmentation.
We introduce the Staged Selective Ensemble (SSE) module, which selects different ensemble methods based on the characteristics of the samples.
Experimental results demonstrate the effectiveness of our proposed method in 3D medical image segmentation tasks.
arXiv Detail & Related papers (2024-10-15T11:23:15Z) - Alternate Diverse Teaching for Semi-supervised Medical Image Segmentation [62.021828104757745]
We propose AD-MT, an alternate diverse teaching approach in a teacher-student framework.
It involves a single student model and two non-trainable teacher models that are momentum-updated periodically and randomly in an alternate fashion.
arXiv Detail & Related papers (2023-11-29T02:44:54Z) - Scribble-based 3D Multiple Abdominal Organ Segmentation via
Triple-branch Multi-dilated Network with Pixel- and Class-wise Consistency [20.371144313009122]
We propose a novel 3D framework with two consistency constraints for scribble-supervised multiple abdominal organ segmentation from CT.
For more stable unsupervised learning, we use voxel-wise uncertainty to rectify the soft pseudo labels and then supervise the outputs of each decoder.
Experiments on the public WORD dataset show that our method outperforms five existing scribble-supervised methods.
arXiv Detail & Related papers (2023-09-18T12:50:58Z) - Knowledge distillation from multi-modal to mono-modal segmentation
networks [13.213798509506272]
We propose KD-Net, a framework to transfer knowledge from a trained multi-modal network (teacher) to a mono-modal one (student)
We show that the student network effectively learns from the teacher and always outperforms the baseline mono-modal network in terms of segmentation accuracy.
arXiv Detail & Related papers (2021-06-17T14:46:57Z) - Generalized Organ Segmentation by Imitating One-shot Reasoning using
Anatomical Correlation [55.1248480381153]
We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes.
We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
arXiv Detail & Related papers (2021-03-30T13:41:12Z) - DoDNet: Learning to segment multi-organ and tumors from multiple
partially labeled datasets [102.55303521877933]
We propose a dynamic on-demand network (DoDNet) that learns to segment multiple organs and tumors on partially labelled datasets.
DoDNet consists of a shared encoder-decoder architecture, a task encoding module, a controller for generating dynamic convolution filters, and a single but dynamic segmentation head.
arXiv Detail & Related papers (2020-11-20T04:56:39Z) - A Teacher-Student Framework for Semi-supervised Medical Image
Segmentation From Mixed Supervision [62.4773770041279]
We develop a semi-supervised learning framework based on a teacher-student fashion for organ and lesion segmentation.
We show our model is robust to the quality of bounding box and achieves comparable performance compared with full-supervised learning methods.
arXiv Detail & Related papers (2020-10-23T07:58:20Z) - 3D Segmentation Networks for Excessive Numbers of Classes: Distinct Bone
Segmentation in Upper Bodies [1.2023648183416153]
This paper discusses the intricacies of training a 3D segmentation network in a many-label setting.
We show necessary modifications in network architecture, loss function, and data augmentation.
As a result, we demonstrate the robustness of our method by automatically segmenting over one hundred distinct bones simultaneously in an end-to-end learnt fashion from a CT-scan.
arXiv Detail & Related papers (2020-10-14T12:54:15Z) - Multi-organ Segmentation via Co-training Weight-averaged Models from
Few-organ Datasets [45.14004510709325]
We propose to co-train weight-averaged models for learning a unified multi-organ segmentation network from few-organ datasets.
To alleviate the noisy teaching supervisions between the networks, the weighted-averaged models are adopted to produce more reliable soft labels.
arXiv Detail & Related papers (2020-08-17T08:39:16Z) - Unpaired Multi-modal Segmentation via Knowledge Distillation [77.39798870702174]
We propose a novel learning scheme for unpaired cross-modality image segmentation.
In our method, we heavily reuse network parameters, by sharing all convolutional kernels across CT and MRI.
We have extensively validated our approach on two multi-class segmentation problems.
arXiv Detail & Related papers (2020-01-06T20:03:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.