Deep Semantic Segmentation of Natural and Medical Images: A Review

• URL: http://arxiv.org/abs/1910.07655v4
• Date: Sun, 31 Mar 2024 02:57:09 GMT
• Title: Deep Semantic Segmentation of Natural and Medical Images: A Review
• Authors: Saeid Asgari Taghanaki, Kumar Abhishek, Joseph Paul Cohen, Julien Cohen-Adad, Ghassan Hamarneh,
• Abstract summary: The semantic image segmentation task consists of classifying each pixel of an image into an instance, where each instance corresponds to a class. In the medical image analysis domain, image segmentation can be used for image-guided interventions, radiotherapy, or improved radiological diagnostics. In this review, we categorize the leading deep learning-based medical and non-medical image segmentation solutions into six main groups of deep architectural, data synthesis-based, loss function-based, sequenced models, weakly supervised, and multi-task methods.
• Score: 17.620924936500725
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The semantic image segmentation task consists of classifying each pixel of an image into an instance, where each instance corresponds to a class. This task is a part of the concept of scene understanding or better explaining the global context of an image. In the medical image analysis domain, image segmentation can be used for image-guided interventions, radiotherapy, or improved radiological diagnostics. In this review, we categorize the leading deep learning-based medical and non-medical image segmentation solutions into six main groups of deep architectural, data synthesis-based, loss function-based, sequenced models, weakly supervised, and multi-task methods and provide a comprehensive review of the contributions in each of these groups. Further, for each group, we analyze each variant of these groups and discuss the limitations of the current approaches and present potential future research directions for semantic image segmentation.

Related papers

• Image Segmentation in Foundation Model Era: A Survey [99.19456390358211]
  Current research in image segmentation lacks a detailed analysis of distinct characteristics, challenges, and solutions associated with these advancements. This survey seeks to fill this gap by providing a thorough review of cutting-edge research centered around FM-driven image segmentation. An exhaustive overview of over 300 segmentation approaches is provided to encapsulate the breadth of current research efforts.
  arXiv  Detail & Related papers  (2024-08-23T10:07:59Z)
• BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once [58.41069132627823]
  holistic image analysis comprises subtasks such as segmentation, detection, and recognition of relevant objects. Here, we propose BiomedParse, a biomedical foundation model for imaging parsing that can jointly conduct segmentation, detection, and recognition for 82 object types across 9 imaging modalities. Through joint learning, we can improve accuracy for individual tasks and enable novel applications such as segmenting all relevant objects in a noisy image through a text prompt.
  arXiv  Detail & Related papers  (2024-05-21T17:54:06Z)
• Semi-Supervised Semantic Segmentation Based on Pseudo-Labels: A Survey [49.47197748663787]
  This review aims to provide a first comprehensive and organized overview of the state-of-the-art research results on pseudo-label methods in the field of semi-supervised semantic segmentation. In addition, we explore the application of pseudo-label technology in medical and remote-sensing image segmentation.
  arXiv  Detail & Related papers  (2024-03-04T10:18:38Z)
• Self-Supervised Correction Learning for Semi-Supervised Biomedical Image Segmentation [84.58210297703714]
  We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting. Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
  arXiv  Detail & Related papers  (2023-01-12T08:19:46Z)
• A Spatial Guided Self-supervised Clustering Network for Medical Image Segmentation [16.448375091671004]
  We propose a new spatial guided self-supervised clustering network (SGSCN) for medical image segmentation. It iteratively learns feature representations and clustering assignment of each pixel in an end-to-end fashion from a single image. We evaluated our method on 2 public medical image datasets and compared it to existing conventional and self-supervised clustering methods.
  arXiv  Detail & Related papers  (2021-07-11T00:40:40Z)
• Hierarchical Semantic Segmentation using Psychometric Learning [17.417302703539367]
  We develop a novel approach to collect segmentation annotations from experts based on psychometric testing. Our method consists of the psychometric testing procedure, active query selection, query enhancement, and a deep metric learning model. We show the merits of our method with evaluation on the synthetically generated image, aerial image and histology image.
  arXiv  Detail & Related papers  (2021-07-07T13:38:33Z)
• Contrastive Semi-Supervised Learning for 2D Medical Image Segmentation [16.517086214275654]
  We present a novel semi-supervised 2D medical segmentation solution that applies Contrastive Learning (CL) on image patches, instead of full images. These patches are meaningfully constructed using the semantic information of different classes obtained via pseudo labeling. We also propose a novel consistency regularization scheme, which works in synergy with contrastive learning.
  arXiv  Detail & Related papers  (2021-06-12T15:43:24Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Unsupervised Learning of Local Discriminative Representation for Medical Images [32.155071351332964]
  Local discriminative representation is needed in many medical image analysis tasks. In this work, we introduce local discrimination into unsupervised representation learning. The effectiveness and usefulness of the proposed method are demonstrated.
  arXiv  Detail & Related papers  (2020-12-17T00:20:23Z)
• Few-shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding [60.89561661441736]
  We propose a novel method for few-shot medical image segmentation. We construct our few-shot image segmentor using a deep convolutional network trained episodically. We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
  arXiv  Detail & Related papers  (2020-12-10T04:01:07Z)
• Deep Learning in Medical Ultrasound Image Segmentation: a Review [9.992387025633805]
  It can be a key step to provide a reliable basis for clinical diagnosis, such as 3D reconstruction of human tissues. Deep learning-based methods for ultrasound image segmentation are categorized into six main groups according to their architectures and training. In the end, the challenges and potential research directions for medical ultrasound image segmentation are discussed.
  arXiv  Detail & Related papers  (2020-02-18T16:33:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.