Multi-center anatomical segmentation with heterogeneous labels via landmark-based models

• URL: http://arxiv.org/abs/2211.07395v1
• Date: Mon, 14 Nov 2022 14:25:52 GMT
• Title: Multi-center anatomical segmentation with heterogeneous labels via landmark-based models
• Authors: Nicol\'as Gaggion, Maria Vakalopoulou, Diego H. Milone, Enzo Ferrante
• Abstract summary: We show how state-of-the-art pixel-level segmentation models fail in naively learning this task due to domain issues and conflicting labels. We then propose to adopt HybridGNet, a landmark-based segmentation model which learns the available anatomical structures using graph-based representations.
• Score: 5.1618890441642
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Learning anatomical segmentation from heterogeneous labels in multi-center datasets is a common situation encountered in clinical scenarios, where certain anatomical structures are only annotated in images coming from particular medical centers, but not in the full database. Here we first show how state-of-the-art pixel-level segmentation models fail in naively learning this task due to domain memorization issues and conflicting labels. We then propose to adopt HybridGNet, a landmark-based segmentation model which learns the available anatomical structures using graph-based representations. By analyzing the latent space learned by both models, we show that HybridGNet naturally learns more domain-invariant feature representations, and provide empirical evidence in the context of chest X-ray multiclass segmentation. We hope these insights will shed light on the training of deep learning models with heterogeneous labels from public and multi-center datasets.

Related papers

• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels [54.58539616385138]
  We introduce a novel semi-supervised 2D medical image segmentation framework termed Mine yOur owN Anatomy (MONA) First, prior work argues that every pixel equally matters to the model training; we observe empirically that this alone is unlikely to define meaningful anatomical features. Second, we construct a set of objectives that encourage the model to be capable of decomposing medical images into a collection of anatomical features.
  arXiv  Detail & Related papers  (2022-09-27T15:50:31Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation [4.898744396854313]
  We propose a method to synthesize for PCa histopathology images by learning the geometrical relationship between different disease labels. We use a weakly supervised segmentation approach that uses Gleason score to segment the diseased regions. The resulting segmentation map is used to train a Shape Restoration Network (ShaRe-Net) to predict missing mask segments.
  arXiv  Detail & Related papers  (2021-10-01T13:47:07Z)
• Learning from Partially Overlapping Labels: Image Segmentation under Annotation Shift [68.6874404805223]
  We propose several strategies for learning from partially overlapping labels in the context of abdominal organ segmentation. We find that combining a semi-supervised approach with an adaptive cross entropy loss can successfully exploit heterogeneously annotated data.
  arXiv  Detail & Related papers  (2021-07-13T09:22:24Z)
• Hybrid graph convolutional neural networks for landmark-based anatomical segmentation [3.2513239513964978]
  HybridGNet is an encoder-decoder neural architecture which combines standard convolutions for image feature encoding. We show that it can be used to construct landmark-based segmentations from pixel level annotations.
  arXiv  Detail & Related papers  (2021-06-17T22:04:44Z)
• CT Image Synthesis Using Weakly Supervised Segmentation and Geometric Inter-Label Relations For COVID Image Analysis [4.898744396854313]
  We propose improvements over previous GAN-based medical image synthesis methods by learning the relationship between different anatomical labels. We use the synthetic images from our method to train networks for segmenting COVID-19 infected areas from lung CT images.
  arXiv  Detail & Related papers  (2021-06-15T07:21:24Z)
• Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalization [112.68171734288237]
  We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels. We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images. We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
  arXiv  Detail & Related papers  (2021-04-12T21:41:25Z)
• G-MIND: An End-to-End Multimodal Imaging-Genetics Framework for Biomarker Identification and Disease Classification [49.53651166356737]
  We propose a novel deep neural network architecture to integrate imaging and genetics data, as guided by diagnosis, that provides interpretable biomarkers. We have evaluated our model on a population study of schizophrenia that includes two functional MRI (fMRI) paradigms and Single Nucleotide Polymorphism (SNP) data.
  arXiv  Detail & Related papers  (2021-01-27T19:28:04Z)
• Weakly-Supervised Segmentation for Disease Localization in Chest X-Ray Images [0.0]
  We propose a novel approach to the semantic segmentation of medical chest X-ray images with only image-level class labels as supervision. We show that this approach is applicable to chest X-rays for detecting an anomalous volume of air between the lung and the chest wall.
  arXiv  Detail & Related papers  (2020-07-01T20:48:35Z)
• Cross-stained Segmentation from Renal Biopsy Images Using Multi-level Adversarial Learning [13.30545860115548]
  We design a robust and flexible model for cross-stained segmentation. It is able to improve segmentation performance on target type of stained images and use unlabeled data to achieve similar accuracy to labeled data.
  arXiv  Detail & Related papers  (2020-02-20T06:49:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.