PSIGAN: Joint probabilistic segmentation and image distribution matching
for unpaired cross-modality adaptation based MRI segmentation
- URL: http://arxiv.org/abs/2007.09465v2
- Date: Sun, 18 Jul 2021 16:01:15 GMT
- Title: PSIGAN: Joint probabilistic segmentation and image distribution matching
for unpaired cross-modality adaptation based MRI segmentation
- Authors: Jue Jiang, Yu Chi Hu, Neelam Tyagi, Andreas Rimner, Nancy Lee, Joseph
O. Deasy, Sean Berry, Harini Veeraraghavan
- Abstract summary: We develop a new joint probabilistic segmentation and image distribution matching generative adversarial network (PSIGAN)
Our UDA approach models the co-dependency between images and their segmentation as a joint probability distribution.
Our method achieved an overall average DSC of 0.87 on T1w and 0.90 on T2w for the abdominal organs.
- Score: 4.573421102994323
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We developed a new joint probabilistic segmentation and image distribution
matching generative adversarial network (PSIGAN) for unsupervised domain
adaptation (UDA) and multi-organ segmentation from magnetic resonance (MRI)
images. Our UDA approach models the co-dependency between images and their
segmentation as a joint probability distribution using a new structure
discriminator. The structure discriminator computes structure of interest
focused adversarial loss by combining the generated pseudo MRI with
probabilistic segmentations produced by a simultaneously trained segmentation
sub-network. The segmentation sub-network is trained using the pseudo MRI
produced by the generator sub-network. This leads to a cyclical optimization of
both the generator and segmentation sub-networks that are jointly trained as
part of an end-to-end network. Extensive experiments and comparisons against
multiple state-of-the-art methods were done on four different MRI sequences
totalling 257 scans for generating multi-organ and tumor segmentation. The
experiments included, (a) 20 T1-weighted (T1w) in-phase mdixon and (b) 20
T2-weighted (T2w) abdominal MRI for segmenting liver, spleen, left and right
kidneys, (c) 162 T2-weighted fat suppressed head and neck MRI (T2wFS) for
parotid gland segmentation, and (d) 75 T2w MRI for lung tumor segmentation. Our
method achieved an overall average DSC of 0.87 on T1w and 0.90 on T2w for the
abdominal organs, 0.82 on T2wFS for the parotid glands, and 0.77 on T2w MRI for
lung tumors.
Related papers
- UMambaAdj: Advancing GTV Segmentation for Head and Neck Cancer in MRI-Guided RT with UMamba and nnU-Net ResEnc Planner [0.04924932828166548]
Magnetic Resonance Imaging (MRI) plays a crucial role in adaptive radiotherapy for head and neck cancer (HNC) due to its superior soft-tissue contrast.
accurately segmenting the gross tumor volume (GTV), which includes both the primary tumor (GTVp) and lymph nodes (GTVn) remains challenging.
Recently, two deep learning segmentation innovations have shown great promise: UMamba, which effectively captures long-range dependencies, and the nnU-Net Residual (ResEnc) which enhances feature extraction through multistage residual blocks.
arXiv Detail & Related papers (2024-10-16T18:26:27Z) - Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI [58.809276442508256]
We propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers.
The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network superior performance than the state-of-the-art methods.
arXiv Detail & Related papers (2024-08-11T15:46:00Z) - Evaluating the Impact of Sequence Combinations on Breast Tumor Segmentation in Multiparametric MRI [0.0]
The effect of sequence combinations in mpMRI remains under-investigated.
The nnU-Net model using DCE sequences achieved a Dice similarity coefficient (DSC) of 0.69 $pm$ 0.18 for functional tumor volume (FTV) segmentation.
arXiv Detail & Related papers (2024-06-12T02:09:05Z) - TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images [62.53931644063323]
In this study we extended the capabilities of TotalSegmentator to MR images.
We trained an nnU-Net segmentation algorithm on this dataset and calculated similarity coefficients (Dice) to evaluate the model's performance.
The model significantly outperformed two other publicly available segmentation models (Dice score 0.824 versus 0.762; p0.001 and 0.762 versus 0.542; p)
arXiv Detail & Related papers (2024-05-29T20:15:54Z) - Minimally Interactive Segmentation of Soft-Tissue Tumors on CT and MRI
using Deep Learning [0.0]
We develop a minimally interactive deep learning-based segmentation method for soft-tissue tumors (STTs) on CT and MRI.
The method requires the user to click six points near the tumor's extreme boundaries to serve as input for a Convolutional Neural Network.
arXiv Detail & Related papers (2024-02-12T16:15:28Z) - Learned Local Attention Maps for Synthesising Vessel Segmentations [43.314353195417326]
We present an encoder-decoder model for synthesising segmentations of the main cerebral arteries in the circle of Willis (CoW) from only T2 MRI.
It uses learned local attention maps generated by dilating the segmentation labels, which forces the network to only extract information from the T2 MRI relevant to synthesising the CoW.
arXiv Detail & Related papers (2023-08-24T15:32:27Z) - Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network.
We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module.
Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
arXiv Detail & Related papers (2022-12-01T07:32:56Z) - Modality Completion via Gaussian Process Prior Variational Autoencoders
for Multi-Modal Glioma Segmentation [75.58395328700821]
We propose a novel model, Multi-modal Gaussian Process Prior Variational Autoencoder (MGP-VAE), to impute one or more missing sub-modalities for a patient scan.
MGP-VAE can leverage the Gaussian Process (GP) prior on the Variational Autoencoder (VAE) to utilize the subjects/patients and sub-modalities correlations.
We show the applicability of MGP-VAE on brain tumor segmentation where either, two, or three of four sub-modalities may be missing.
arXiv Detail & Related papers (2021-07-07T19:06:34Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - Unified cross-modality feature disentangler for unsupervised
multi-domain MRI abdomen organs segmentation [3.3504365823045044]
Our contribution is a unified cross-modality feature disentagling approach for multi-domain image translation and multiple organ segmentation.
Using CT as the labeled source domain, our approach learns to segment multi-modal (T1-weighted and T2-weighted) MRI having no labeled data.
Our approach produced an average Dice similarity coefficient (DSC) of 0.85 for T1w and 0.90 for T2w MRI for multi-organ segmentation.
arXiv Detail & Related papers (2020-07-19T13:33:41Z) - Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on
2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI.
A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing.
The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
arXiv Detail & Related papers (2020-05-27T20:44:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.