Semantic Segmentation of highly class imbalanced fully labelled 3D
volumetric biomedical images and unsupervised Domain Adaptation of the
pre-trained Segmentation Network to segment another fully unlabelled
Biomedical 3D Image stack
- URL: http://arxiv.org/abs/2004.02748v1
- Date: Fri, 13 Mar 2020 06:01:18 GMT
- Title: Semantic Segmentation of highly class imbalanced fully labelled 3D
volumetric biomedical images and unsupervised Domain Adaptation of the
pre-trained Segmentation Network to segment another fully unlabelled
Biomedical 3D Image stack
- Authors: Shreya Roy and Anirban Chakraborty
- Abstract summary: We consider two cases where one dataset is fully labeled and the other dataset is assumed to be fully unlabelled.
We first perform semantic on the fully labeled isotropic biomedical source data (FIBSEM) and try to incorporate the trained model for segmenting the target unlabelled dataset(SNEMI3D)
- Score: 16.698880511349493
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The goal of our work is to perform pixel label semantic segmentation on 3D
biomedical volumetric data. Manual annotation is always difficult for a large
bio-medical dataset. So, we consider two cases where one dataset is fully
labeled and the other dataset is assumed to be fully unlabelled. We first
perform Semantic Segmentation on the fully labeled isotropic biomedical source
data (FIBSEM) and try to incorporate the the trained model for segmenting the
target unlabelled dataset(SNEMI3D)which shares some similarities with the
source dataset in the context of different types of cellular bodies and other
cellular components. Although, the cellular components vary in size and shape.
So in this paper, we have proposed a novel approach in the context of
unsupervised domain adaptation while classifying each pixel of the target
volumetric data into cell boundary and cell body. Also, we have proposed a
novel approach to giving non-uniform weights to different pixels in the
training images while performing the pixel-level semantic segmentation in the
presence of the corresponding pixel-wise label map along with the training
original images in the source domain. We have used the Entropy Map or a
Distance Transform matrix retrieved from the given ground truth label map which
has helped to overcome the class imbalance problem in the medical image data
where the cell boundaries are extremely thin and hence, extremely prone to be
misclassified as non-boundary.
Related papers
- Promise:Prompt-driven 3D Medical Image Segmentation Using Pretrained
Image Foundation Models [13.08275555017179]
We propose ProMISe, a prompt-driven 3D medical image segmentation model using only a single point prompt.
We evaluate our model on two public datasets for colon and pancreas tumor segmentations.
arXiv Detail & Related papers (2023-10-30T16:49:03Z) - Unsupervised Domain Adaptation for Medical Image Segmentation via
Feature-space Density Matching [0.0]
This paper presents an unsupervised domain adaptation approach for semantic segmentation.
We match the target data distribution to the source in the feature space, particularly when the number of target samples is limited.
We demonstrate the efficacy of our proposed approach on 2 datasets, multisite prostate MRI and histopathology images.
arXiv Detail & Related papers (2023-05-09T22:24:46Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - Semi-Supervised Domain Generalization for Cardiac Magnetic Resonance
Image Segmentation with High Quality Pseudo Labels [8.283424744148258]
We present a domain generalization method for semi-supervised medical segmentation.
Our main goal is to improve the quality of pseudo labels under extreme MRI Analysis with various domains.
Our approach consistently generates accurate segmentation results of cardiac magnetic resonance images with different respiratory motions.
arXiv Detail & Related papers (2022-09-30T12:57:41Z) - Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels [54.58539616385138]
We introduce a novel semi-supervised 2D medical image segmentation framework termed Mine yOur owN Anatomy (MONA)
First, prior work argues that every pixel equally matters to the model training; we observe empirically that this alone is unlikely to define meaningful anatomical features.
Second, we construct a set of objectives that encourage the model to be capable of decomposing medical images into a collection of anatomical features.
arXiv Detail & Related papers (2022-09-27T15:50:31Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Unsupervised Domain Adaptation with Contrastive Learning for OCT
Segmentation [49.59567529191423]
We propose a novel semi-supervised learning framework for segmentation of volumetric images from new unlabeled domains.
We jointly use supervised and contrastive learning, also introducing a contrastive pairing scheme that leverages similarity between nearby slices in 3D.
arXiv Detail & Related papers (2022-03-07T19:02:26Z) - Reference-guided Pseudo-Label Generation for Medical Semantic
Segmentation [25.76014072179711]
We propose a novel approach to generate supervision for semi-supervised semantic segmentation.
We use a small number of labeled images as reference material and match pixels in an unlabeled image to the semantics of the best fitting pixel in a reference set.
We achieve the same performance as a standard fully supervised model on X-ray anatomy segmentation, albeit 95% fewer labeled images.
arXiv Detail & Related papers (2021-12-01T12:21:24Z) - Semantic Segmentation with Generative Models: Semi-Supervised Learning
and Strong Out-of-Domain Generalization [112.68171734288237]
We propose a novel framework for discriminative pixel-level tasks using a generative model of both images and labels.
We learn a generative adversarial network that captures the joint image-label distribution and is trained efficiently using a large set of unlabeled images.
We demonstrate strong in-domain performance compared to several baselines, and are the first to showcase extreme out-of-domain generalization.
arXiv Detail & Related papers (2021-04-12T21:41:25Z) - Edge Guided GANs with Contrastive Learning for Semantic Image Synthesis [194.1452124186117]
We propose a novel ECGAN for the challenging semantic image synthesis task.
Our ECGAN achieves significantly better results than state-of-the-art methods.
arXiv Detail & Related papers (2020-03-31T01:23:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.