Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation

• URL: http://arxiv.org/abs/2103.16344v1
• Date: Tue, 30 Mar 2021 13:41:12 GMT
• Title: Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation
• Authors: Hong-Yu Zhou, Hualuo Liu, Shilei Cao, Dong Wei, Chixiang Lu, Yizhou Yu, Kai Ma, Yefeng Zheng
• Abstract summary: We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
• Score: 55.1248480381153
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Learning by imitation is one of the most significant abilities of human beings and plays a vital role in human's computational neural system. In medical image analysis, given several exemplars (anchors), experienced radiologist has the ability to delineate unfamiliar organs by imitating the reasoning process learned from existing types of organs. Inspired by this observation, we propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. In this paper, we show that such process can be integrated into the one-shot segmentation task which is a very challenging but meaningful topic. We propose pyramid reasoning modules (PRMs) to model the anatomical correlation between anchor and target volumes. In practice, the proposed module first computes a correlation matrix between target and anchor computerized tomography (CT) volumes. Then, this matrix is used to transform the feature representations of both anchor volume and its segmentation mask. Finally, OrganNet learns to fuse the representations from various inputs and predicts segmentation results for target volume. Extensive experiments show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task. Moreover, even when compared with fully-supervised segmentation models, OrganNet is still able to produce satisfying segmentation results.

Related papers

• Teaching AI the Anatomy Behind the Scan: Addressing Anatomical Flaws in Medical Image Segmentation with Learnable Prior [34.54360931760496]
  Key anatomical features, such as the number of organs, their shapes and relative positions, are crucial for building a robust multi-organ segmentation model. We introduce a novel architecture called the Anatomy-Informed Network (AIC-Net) AIC-Net incorporates a learnable input termed "Anatomical Prior", which can be adapted to patient-specific anatomy.
  arXiv  Detail & Related papers  (2024-03-27T10:46:24Z)
• AnatoMix: Anatomy-aware Data Augmentation for Multi-organ Segmentation [6.471203541258319]
  We propose a novel data augmentation strategy for increasing the generalizibility of multi-organ segmentation datasets. By object-level matching and manipulation, our method is able to generate new images with correct anatomy. Our augmentation method can lead to mean dice of 76.1, compared with 74.8 of the baseline method.
  arXiv  Detail & Related papers  (2024-03-05T21:07:50Z)
• HALOS: Hallucination-free Organ Segmentation after Organ Resection Surgery [3.079885946230076]
  State-of-the-art segmentation models often lead to organ hallucinations, i.e., false-positive predictions of organs. We propose HALOS for abdominal organ segmentation in MR images that handles cases after organ resection surgery.
  arXiv  Detail & Related papers  (2023-03-14T09:05:19Z)
• Learning from partially labeled data for multi-organ and tumor segmentation [102.55303521877933]
  We propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple datasets. A dynamic head enables the network to accomplish multiple segmentation tasks flexibly. We create a large-scale partially labeled Multi-Organ and Tumor benchmark, termed MOTS, and demonstrate the superior performance of our TransDoDNet over other competitors.
  arXiv  Detail & Related papers  (2022-11-13T13:03:09Z)
• MetaMedSeg: Volumetric Meta-learning for Few-Shot Organ Segmentation [47.428577772279176]
  We present MetaMedSeg, a gradient-based meta-learning algorithm that redefines the meta-learning task for the volumetric medical data. In the experiments, we present an evaluation of the medical decathlon dataset by extracting 2D slices from CT and MRI volumes of different organs. Our proposed volumetric task definition leads to up to 30% improvement in terms of IoU compared to related baselines.
  arXiv  Detail & Related papers  (2021-09-18T11:13:45Z)
• Medulloblastoma Tumor Classification using Deep Transfer Learning with Multi-Scale EfficientNets [63.62764375279861]
  We propose an end-to-end MB tumor classification and explore transfer learning with various input sizes and matching network dimensions. Using a data set with 161 cases, we demonstrate that pre-trained EfficientNets with larger input resolutions lead to significant performance improvements.
  arXiv  Detail & Related papers  (2021-09-10T13:07:11Z)
• Few-shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding [60.89561661441736]
  We propose a novel method for few-shot medical image segmentation. We construct our few-shot image segmentor using a deep convolutional network trained episodically. We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
  arXiv  Detail & Related papers  (2020-12-10T04:01:07Z)
• DoDNet: Learning to segment multi-organ and tumors from multiple partially labeled datasets [102.55303521877933]
  We propose a dynamic on-demand network (DoDNet) that learns to segment multiple organs and tumors on partially labelled datasets. DoDNet consists of a shared encoder-decoder architecture, a task encoding module, a controller for generating dynamic convolution filters, and a single but dynamic segmentation head.
  arXiv  Detail & Related papers  (2020-11-20T04:56:39Z)
• Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets [45.14004510709325]
  We propose to co-train weight-averaged models for learning a unified multi-organ segmentation network from few-organ datasets. To alleviate the noisy teaching supervisions between the networks, the weighted-averaged models are adopted to produce more reliable soft labels.
  arXiv  Detail & Related papers  (2020-08-17T08:39:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.