Unsupervised Domain Adaptation via CycleGAN for White Matter
Hyperintensity Segmentation in Multicenter MR Images
- URL: http://arxiv.org/abs/2009.04985v1
- Date: Thu, 10 Sep 2020 16:48:19 GMT
- Title: Unsupervised Domain Adaptation via CycleGAN for White Matter
Hyperintensity Segmentation in Multicenter MR Images
- Authors: Julian Alberto Palladino, Diego Fernandez Slezak and Enzo Ferrante
- Abstract summary: Quantification of white matter hyperintensities in magnetic resonance images serves as a predictor for risk of stroke, dementia and mortality.
During the last years, convolutional neural networks (CNN) specifically tailored for biomedical image segmentation have outperformed all previous techniques in this task.
In this work, we explore the use of cycle-consistent adversarial networks (CycleGAN) to perform unsupervised domain adaptation on multicenter MR images with brain lesions.
- Score: 2.627822659948232
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic segmentation of white matter hyperintensities in magnetic resonance
images is of paramount clinical and research importance. Quantification of
these lesions serve as a predictor for risk of stroke, dementia and mortality.
During the last years, convolutional neural networks (CNN) specifically
tailored for biomedical image segmentation have outperformed all previous
techniques in this task. However, they are extremely data-dependent, and
maintain a good performance only when data distribution between training and
test datasets remains unchanged. When such distribution changes but we still
aim at performing the same task, we incur in a domain adaptation problem (e.g.
using a different MR machine or different acquisition parameters for training
and test data). In this work, we explore the use of cycle-consistent
adversarial networks (CycleGAN) to perform unsupervised domain adaptation on
multicenter MR images with brain lesions. We aim at learning a mapping function
to transform volumetric MR images between domains, which are characterized by
different medical centers and MR machines with varying brand, model and
configuration parameters. Our experiments show that CycleGAN allows us to
reduce the Jensen-Shannon divergence between MR domains, enabling automatic
segmentation with CNN models on domains where no labeled data was available.
Related papers
- Unsupervised Federated Domain Adaptation for Segmentation of MRI Images [20.206972068340843]
We develop a method for unsupervised federated domain adaptation using multiple annotated source domains.
Our approach enables the transfer of knowledge from several annotated source domains to adapt a model for effective use in an unannotated target domain.
arXiv Detail & Related papers (2024-01-02T00:31:41Z) - Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image
Segmentation [21.6412682130116]
We propose a novel group equivariant segmentation framework by encoding those inherent symmetries for learning more precise representations.
Based on our novel framework, extensive experiments conducted on real-world clinical data demonstrate that a Group Equivariant Res-UNet (named GER-UNet) outperforms its regular CNN-based counterpart.
The newly built GER-UNet also shows potential in reducing the sample complexity and the redundancy of filters.
arXiv Detail & Related papers (2022-07-29T04:28:20Z) - Scale-Equivariant Unrolled Neural Networks for Data-Efficient
Accelerated MRI Reconstruction [33.82162420709648]
We propose modeling the proximal operators of unrolled neural networks with scale-equivariant convolutional neural networks.
Our approach demonstrates strong improvements over the state-of-the-art unrolled neural networks under the same memory constraints.
arXiv Detail & Related papers (2022-04-21T23:29:52Z) - Variational Inference for Quantifying Inter-observer Variability in
Segmentation of Anatomical Structures [12.138198227748353]
Most segmentation methods simply model a mapping from an image to its single segmentation map and do not take the disagreement of annotators into consideration.
We propose a novel variational inference framework to model the distribution of plausible segmentation maps, given a specific MR image.
arXiv Detail & Related papers (2022-01-18T16:33:33Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - Fader Networks for domain adaptation on fMRI: ABIDE-II study [68.5481471934606]
We use 3D convolutional autoencoders to build the domain irrelevant latent space image representation and demonstrate this method to outperform existing approaches on ABIDE data.
arXiv Detail & Related papers (2020-10-14T16:50:50Z) - Domain-Adversarial Learning for Multi-Centre, Multi-Vendor, and
Multi-Disease Cardiac MR Image Segmentation [3.4551186283197883]
Domain-adversarial learning is used to train a domain-invariant 2D U-Net using labelled and unlabelled data.
This approach is evaluated on both seen and unseen domains from the M&Ms challenge dataset.
arXiv Detail & Related papers (2020-08-26T19:40:55Z) - Improved Slice-wise Tumour Detection in Brain MRIs by Computing
Dissimilarities between Latent Representations [68.8204255655161]
Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods.
We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder.
We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
arXiv Detail & Related papers (2020-07-24T14:02:09Z) - Unsupervised Instance Segmentation in Microscopy Images via Panoptic
Domain Adaptation and Task Re-weighting [86.33696045574692]
We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images.
We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images.
Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
arXiv Detail & Related papers (2020-05-05T11:08:26Z) - MS-Net: Multi-Site Network for Improving Prostate Segmentation with
Heterogeneous MRI Data [75.73881040581767]
We propose a novel multi-site network (MS-Net) for improving prostate segmentation by learning robust representations.
Our MS-Net improves the performance across all datasets consistently, and outperforms state-of-the-art methods for multi-site learning.
arXiv Detail & Related papers (2020-02-09T14:11:50Z) - Unsupervised Bidirectional Cross-Modality Adaptation via Deeply
Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA)
Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives.
Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
arXiv Detail & Related papers (2020-02-06T13:49:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.