Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images

• URL: http://arxiv.org/abs/2008.00710v1
• Date: Mon, 3 Aug 2020 08:25:59 GMT
• Title: Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images
• Authors: Yuting He, Tiantian Li, Guanyu Yang, Youyong Kong, Yang Chen, Huazhong Shu, Jean-Louis Coatrieux, Jean-Louis Dillenseger, Shuo Li
• Abstract summary: We propose a novel Deep Complementary Joint Model (DeepRS) for complex scene registration and few-shot segmentation. We embed a perturbation factor in the registration to increase the activity of deformation thus maintaining the augmentation data diversity. The outputs from segmentation model are utilized to implement deep-based region constraints thus relieving the label requirements and bringing fine registration.
• Score: 15.958078577731815
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep learning-based medical image registration and segmentation joint models utilize the complementarity (augmentation data or weakly supervised data from registration, region constraints from segmentation) to bring mutual improvement in complex scene and few-shot situation. However, further adoption of the joint models are hindered: 1) the diversity of augmentation data is reduced limiting the further enhancement of segmentation, 2) misaligned regions in weakly supervised data disturb the training process, 3) lack of label-based region constraints in few-shot situation limits the registration performance. We propose a novel Deep Complementary Joint Model (DeepRS) for complex scene registration and few-shot segmentation. We embed a perturbation factor in the registration to increase the activity of deformation thus maintaining the augmentation data diversity. We take a pixel-wise discriminator to extract alignment confidence maps which highlight aligned regions in weakly supervised data so the misaligned regions' disturbance will be suppressed via weighting. The outputs from segmentation model are utilized to implement deep-based region constraints thus relieving the label requirements and bringing fine registration. Extensive experiments on the CT dataset of MM-WHS 2017 Challenge show great advantages of our DeepRS that outperforms the existing state-of-the-art models.

Related papers

• SegHeD+: Segmentation of Heterogeneous Data for Multiple Sclerosis Lesions with Anatomical Constraints and Lesion-aware Augmentation [1.6365496769445946]
  We introduce SegHeD+, a novel segmentation model that can handle multiple datasets and tasks. We integrate domain knowledge about MS lesions by incorporating longitudinal, anatomical, and volumetric constraints into the segmentation model. SegHeD+ is evaluated on five MS datasets and demonstrates superior performance in segmenting all, new, and vanishing lesions.
  arXiv  Detail & Related papers  (2024-12-14T19:44:25Z)
• Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraint [12.757563335570865]
  Dist Loss is a loss function designed to minimize the distribution distance between the model's predictions and the target labels. We have conducted experiments across three datasets spanning computer vision and healthcare.
  arXiv  Detail & Related papers  (2024-11-20T16:17:40Z)
• Adaptively Augmented Consistency Learning: A Semi-supervised Segmentation Framework for Remote Sensing [9.867670296534103]
  AACL is a semi-supervised segmentation framework designed to enhance RS segmentation accuracy under limited labeled data. AACL achieves competitive performance in semi-supervised segmentation, showing up to a 20% improvement in specific categories and 2% increase in overall performance compared to state-of-the-art frameworks.
  arXiv  Detail & Related papers  (2024-11-14T10:47:01Z)
• SegHeD: Segmentation of Heterogeneous Data for Multiple Sclerosis Lesions with Anatomical Constraints [1.498084483844508]
  Machine learning models have demonstrated a great potential for automated MS lesion segmentation. SegHeD is a novel multi-dataset multi-task segmentation model that can incorporate heterogeneous data as input. SegHeD is assessed on five MS datasets and achieves a high performance in all, new, and vanishing-lesion segmentation.
  arXiv  Detail & Related papers  (2024-10-02T17:21:43Z)
• Dual-scale Enhanced and Cross-generative Consistency Learning for Semi-supervised Medical Image Segmentation [49.57907601086494]
  Medical image segmentation plays a crucial role in computer-aided diagnosis. We propose a novel Dual-scale Enhanced and Cross-generative consistency learning framework for semi-supervised medical image (DEC-Seg)
  arXiv  Detail & Related papers  (2023-12-26T12:56:31Z)
• Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentation [63.15257949821558]
  Referring Remote Sensing Image (RRSIS) is a new challenge that combines computer vision and natural language processing. Traditional Referring Image (RIS) approaches have been impeded by the complex spatial scales and orientations found in aerial imagery. We introduce the Rotated Multi-Scale Interaction Network (RMSIN), an innovative approach designed for the unique demands of RRSIS.
  arXiv  Detail & Related papers  (2023-12-19T08:14:14Z)
• AdLER: Adversarial Training with Label Error Rectification for One-Shot Medical Image Segmentation [24.902447478719303]
  We propose a novel one-shot medical image segmentation method with adversarial training and label error rectification (AdLER) Specifically, we implement a novel dual consistency constraint to ensure anatomy-aligned registration that lessens registration errors. We also develop an adversarial training strategy to augment the atlas image, which ensures both generation diversity and segmentation robustness.
  arXiv  Detail & Related papers  (2023-09-02T16:06:50Z)
• Enforcing Mutual Consistency of Hard Regions for Semi-supervised Medical Image Segmentation [68.9233942579956]
  We propose a novel mutual consistency network (MC-Net+) to exploit the unlabeled hard regions for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with limited annotations are prone to output highly uncertain and easily mis-classified predictions. We compare the segmentation results of the MC-Net+ with five state-of-the-art semi-supervised approaches on three public medical datasets.
  arXiv  Detail & Related papers  (2021-09-21T04:47:42Z)
• Semi-supervised Left Atrium Segmentation with Mutual Consistency Training [60.59108570938163]
  We propose a novel Mutual Consistency Network (MC-Net) for semi-supervised left atrium segmentation from 3D MR images. Our MC-Net consists of one encoder and two slightly different decoders, and the prediction discrepancies of two decoders are transformed as an unsupervised loss. We evaluate our MC-Net on the public Left Atrium (LA) database and it obtains impressive performance gains by exploiting the unlabeled data effectively.
  arXiv  Detail & Related papers  (2021-03-04T09:34:32Z)
• Towards Robust Partially Supervised Multi-Structure Medical Image Segmentation on Small-Scale Data [123.03252888189546]
  We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity. Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels. Our research suggests a new research direction in label-efficient deep learning with partial supervision.
  arXiv  Detail & Related papers  (2020-11-28T16:31:00Z)
• Transferring and Regularizing Prediction for Semantic Segmentation [115.88957139226966]
  In this paper, we exploit the intrinsic properties of semantic segmentation to alleviate such problem for model transfer. We present a Regularizer of Prediction Transfer (RPT) that imposes the intrinsic properties as constraints to regularize model transfer in an unsupervised fashion. Extensive experiments are conducted to verify the proposal of RPT on the transfer of models trained on GTA5 and SYNTHIA (synthetic data) to Cityscapes dataset (urban street scenes)
  arXiv  Detail & Related papers  (2020-06-11T16:19:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.