Tailored Multi-Organ Segmentation with Model Adaptation and Ensemble
- URL: http://arxiv.org/abs/2304.07123v1
- Date: Fri, 14 Apr 2023 13:39:39 GMT
- Title: Tailored Multi-Organ Segmentation with Model Adaptation and Ensemble
- Authors: Jiahua Dong, Guohua Cheng, Yue Zhang, Chengtao Peng, Yu Song, Ruofeng
Tong, Lanfen Lin, Yen-Wei Chen
- Abstract summary: Multi-organ segmentation is a fundamental task in medical image analysis.
Due to expensive labor costs and expertise, the availability of multi-organ annotations is usually limited.
We propose a novel dual-stage method that consists of a Model Adaptation stage and a Model Ensemble stage.
- Score: 22.82094545786408
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: Multi-organ segmentation, which identifies and separates different organs in
medical images, is a fundamental task in medical image analysis. Recently, the
immense success of deep learning motivated its wide adoption in multi-organ
segmentation tasks. However, due to expensive labor costs and expertise, the
availability of multi-organ annotations is usually limited and hence poses a
challenge in obtaining sufficient training data for deep learning-based
methods. In this paper, we aim to address this issue by combining off-the-shelf
single-organ segmentation models to develop a multi-organ segmentation model on
the target dataset, which helps get rid of the dependence on annotated data for
multi-organ segmentation. To this end, we propose a novel dual-stage method
that consists of a Model Adaptation stage and a Model Ensemble stage. The first
stage enhances the generalization of each off-the-shelf segmentation model on
the target domain, while the second stage distills and integrates knowledge
from multiple adapted single-organ segmentation models. Extensive experiments
on four abdomen datasets demonstrate that our proposed method can effectively
leverage off-the-shelf single-organ segmentation models to obtain a tailored
model for multi-organ segmentation with high accuracy.
Related papers
- Learnable Weight Initialization for Volumetric Medical Image Segmentation [66.3030435676252]
We propose a learnable weight-based hybrid medical image segmentation approach.
Our approach is easy to integrate into any hybrid model and requires no external training data.
Experiments on multi-organ and lung cancer segmentation tasks demonstrate the effectiveness of our approach.
arXiv Detail & Related papers (2023-06-15T17:55:05Z) - AIMS: All-Inclusive Multi-Level Segmentation [93.5041381700744]
We propose a new task, All-Inclusive Multi-Level (AIMS), which segments visual regions into three levels: part, entity, and relation.
We also build a unified AIMS model through multi-dataset multi-task training to address the two major challenges of annotation inconsistency and task correlation.
arXiv Detail & Related papers (2023-05-28T16:28:49Z) - Ambiguous Medical Image Segmentation using Diffusion Models [60.378180265885945]
We introduce a single diffusion model-based approach that produces multiple plausible outputs by learning a distribution over group insights.
Our proposed model generates a distribution of segmentation masks by leveraging the inherent sampling process of diffusion.
Comprehensive results show that our proposed approach outperforms existing state-of-the-art ambiguous segmentation networks.
arXiv Detail & Related papers (2023-04-10T17:58:22Z) - Ensemble Methods for Multi-Organ Segmentation in CT Series [0.0]
We present three types of ensembles of single-organ models able to produce multi-organ masks exploiting the different specialisations of their components.
The results are promising and prove that this is a possible solution to finding efficient multi-organ segmentation methods.
arXiv Detail & Related papers (2023-03-31T10:37:19Z) - MultiTalent: A Multi-Dataset Approach to Medical Image Segmentation [1.146419670457951]
Current practices limit model training and supervised pre-training to one or a few similar datasets.
We propose MultiTalent, a method that leverages multiple CT datasets with diverse and conflicting class definitions.
arXiv Detail & Related papers (2023-03-25T11:37:16Z) - Multi-site Organ Segmentation with Federated Partial Supervision and
Site Adaptation [14.039141830423182]
The paper aims to tackle these challenges via a two-phase aggregation-then-adaptation approach.
The first phase of aggregation learns a single multi-organ segmentation model by leveraging the strength of 'bigger data'
The second phase of site adaptation is to transfer the federated multi-organ segmentation model to site-specific organ segmentation models, one model per site, in order to further improve the performance of each site's organ segmentation task.
arXiv Detail & Related papers (2023-02-08T07:07:43Z) - Multi-organ segmentation: a progressive exploration of learning
paradigms under scarce annotation [16.29982573567722]
Deep learning-based approaches have evolved rapidly and witnessed remarkable progress in multi-organ segmentation.
However, obtaining an appropriately sized and fine-grained annotated dataset of multiple organs is extremely hard and expensive.
arXiv Detail & Related papers (2023-02-07T07:09:19Z) - Learning from partially labeled data for multi-organ and tumor
segmentation [102.55303521877933]
We propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple datasets.
A dynamic head enables the network to accomplish multiple segmentation tasks flexibly.
We create a large-scale partially labeled Multi-Organ and Tumor benchmark, termed MOTS, and demonstrate the superior performance of our TransDoDNet over other competitors.
arXiv Detail & Related papers (2022-11-13T13:03:09Z) - Generalized Organ Segmentation by Imitating One-shot Reasoning using
Anatomical Correlation [55.1248480381153]
We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes.
We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
arXiv Detail & Related papers (2021-03-30T13:41:12Z) - Towards Robust Partially Supervised Multi-Structure Medical Image
Segmentation on Small-Scale Data [123.03252888189546]
We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity.
Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels.
Our research suggests a new research direction in label-efficient deep learning with partial supervision.
arXiv Detail & Related papers (2020-11-28T16:31:00Z) - Multi-organ Segmentation via Co-training Weight-averaged Models from
Few-organ Datasets [45.14004510709325]
We propose to co-train weight-averaged models for learning a unified multi-organ segmentation network from few-organ datasets.
To alleviate the noisy teaching supervisions between the networks, the weighted-averaged models are adopted to produce more reliable soft labels.
arXiv Detail & Related papers (2020-08-17T08:39:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.