A survey on shape-constraint deep learning for medical image
segmentation
- URL: http://arxiv.org/abs/2101.07721v1
- Date: Tue, 19 Jan 2021 16:52:10 GMT
- Title: A survey on shape-constraint deep learning for medical image
segmentation
- Authors: Simon Bohlender, Ilkay Oksuz, Anirban Mukhopadhyay
- Abstract summary: convolutional deep neural networks and its many variants have completely changed the modern landscape of deep learning based medical image segmentation.
The over dependence of these methods on pixel level classification and regression has been identified early on as a problem.
To ensure the segmentation result is anatomically consistent, approaches based on Markov/ Conditional Random Fields, Statistical Shape Models are becoming increasingly popular.
- Score: 0.46023882211671957
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Since the advent of U-Net, fully convolutional deep neural networks and its
many variants have completely changed the modern landscape of deep learning
based medical image segmentation. However, the over dependence of these methods
on pixel level classification and regression has been identified early on as a
problem. Especially when trained on medical databases with sparse available
annotation, these methods are prone to generate segmentation artifacts such as
fragmented structures, topological inconsistencies and islands of pixel. These
artefacts are especially problematic in medical imaging since segmentation is
almost always a pre-processing step for some downstream evaluation. The range
of possible downstream evaluations is rather big, for example surgical
planning, visualization, shape analysis, prognosis, treatment planning etc.
However, one common thread across all these downstream tasks is the demand of
anatomical consistency. To ensure the segmentation result is anatomically
consistent, approaches based on Markov/ Conditional Random Fields, Statistical
Shape Models are becoming increasingly popular over the past 5 years. In this
review paper, a broad overview of recent literature on bringing anatomical
constraints for medical image segmentation is given, the shortcomings and
opportunities of the proposed methods are thoroughly discussed and potential
future work is elaborated. We review the most relevant papers published until
the submission date. For quick access, important details such as the underlying
method, datasets and performance are tabulated.
Related papers
- Anatomy-guided Pathology Segmentation [56.883822515800205]
We develop a generalist segmentation model that combines anatomical and pathological information, aiming to enhance the segmentation accuracy of pathological features.
Our Anatomy-Pathology Exchange (APEx) training utilizes a query-based segmentation transformer which decodes a joint feature space into query-representations for human anatomy.
In doing so, we are able to report the best results across the board on FDG-PET-CT and Chest X-Ray pathology segmentation tasks with a margin of up to 3.3% as compared to strong baseline methods.
arXiv Detail & Related papers (2024-07-08T11:44:15Z) - A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis [48.84443450990355]
Deep networks have achieved broad success in analyzing natural images, when applied to medical scans, they often fail in unexcepted situations.
We investigate this challenge and focus on model sensitivity to domain shifts, such as data sampled from different hospitals or data confounded by demographic variables such as sex, race, etc, in the context of chest X-rays and skin lesion images.
Taking inspiration from medical training, we propose giving deep networks a prior grounded in explicit medical knowledge communicated in natural language.
arXiv Detail & Related papers (2024-05-23T17:55:02Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - From CNN to Transformer: A Review of Medical Image Segmentation Models [7.3150850275578145]
Deep learning for medical image segmentation has become a prevalent trend.
In this paper, we conduct a survey of the most representative four medical image segmentation models in recent years.
We theoretically analyze the characteristics of these models and quantitatively evaluate their performance on two benchmark datasets.
arXiv Detail & Related papers (2023-08-10T02:48:57Z) - Trustworthy Deep Learning for Medical Image Segmentation [1.0152838128195467]
Major limitation of deep learning-based segmentation methods is their lack of robustness to variability in the image acquisition protocol.
In most cases, the manual segmentation of medical images requires highly skilled raters and is time-consuming.
This thesis introduces new mathematical and optimization methods to mitigate those limitations.
arXiv Detail & Related papers (2023-05-27T12:12:53Z) - Unsupervised Domain Adaptation through Shape Modeling for Medical Image
Segmentation [23.045760366698634]
We aim at modeling shape explicitly and using it to help medical image segmentation.
Previous methods proposed Variational Autoencoder (VAE) based models to learn the distribution of shape for a particular organ.
We propose a new unsupervised domain adaptation pipeline based on a pseudo loss and a VAE reconstruction loss under a teacher-student learning paradigm.
arXiv Detail & Related papers (2022-07-06T09:16:42Z) - Catalyzing Clinical Diagnostic Pipelines Through Volumetric Medical
Image Segmentation Using Deep Neural Networks: Past, Present, & Future [0.0]
This paper will briefly overview some of the state-of-the-art (SoTA) neural network-based segmentation algorithms.
It will also demonstrate important clinical implications of effective deep learning-based solutions.
arXiv Detail & Related papers (2021-03-27T19:05:11Z) - Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
We propose a deep co-attention network for multi-view subspace learning.
It aims to extract both the common information and the complementary information in an adversarial setting.
In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
arXiv Detail & Related papers (2021-02-15T18:46:44Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - Progressive Adversarial Semantic Segmentation [11.323677925193438]
Deep convolutional neural networks can perform exceedingly well given full supervision.
The success of such fully-supervised models for various image analysis tasks is limited to the availability of massive amounts of labeled data.
We propose a novel end-to-end medical image segmentation model, namely Progressive Adrial Semantic (PASS)
arXiv Detail & Related papers (2020-05-08T22:48:00Z) - Weakly supervised multiple instance learning histopathological tumor
segmentation [51.085268272912415]
We propose a weakly supervised framework for whole slide imaging segmentation.
We exploit a multiple instance learning scheme for training models.
The proposed framework has been evaluated on multi-locations and multi-centric public data from The Cancer Genome Atlas and the PatchCamelyon dataset.
arXiv Detail & Related papers (2020-04-10T13:12:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.