ASC: Appearance and Structure Consistency for Unsupervised Domain
Adaptation in Fetal Brain MRI Segmentation
- URL: http://arxiv.org/abs/2310.14172v1
- Date: Sun, 22 Oct 2023 04:12:06 GMT
- Title: ASC: Appearance and Structure Consistency for Unsupervised Domain
Adaptation in Fetal Brain MRI Segmentation
- Authors: Zihang Xu and Haifan Gong and Xiang Wan and Haofeng Li
- Abstract summary: We propose a practical unsupervised domain adaptation (UDA) setting that adapts the segmentation labels of high-quality fetal brain atlases to unlabeled fetal brain MRI data.
We adapt the segmentation model to the appearances of different domains by constraining the consistency before and after a frequency-based image transformation.
Experiments on FeTA 2021 benchmark demonstrate the effectiveness of our ASC in comparison to registration-based, semi-supervised learning-based, and existing UDA-based methods.
- Score: 28.40275722324598
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic tissue segmentation of fetal brain images is essential for the
quantitative analysis of prenatal neurodevelopment. However, producing
voxel-level annotations of fetal brain imaging is time-consuming and expensive.
To reduce labeling costs, we propose a practical unsupervised domain adaptation
(UDA) setting that adapts the segmentation labels of high-quality fetal brain
atlases to unlabeled fetal brain MRI data from another domain. To address the
task, we propose a new UDA framework based on Appearance and Structure
Consistency, named ASC. We adapt the segmentation model to the appearances of
different domains by constraining the consistency before and after a
frequency-based image transformation, which is to swap the appearance between
brain MRI data and atlases. Consider that even in the same domain, the fetal
brain images of different gestational ages could have significant variations in
the anatomical structures. To make the model adapt to the structural variations
in the target domain, we further encourage prediction consistency under
different structural perturbations. Extensive experiments on FeTA 2021
benchmark demonstrate the effectiveness of our ASC in comparison to
registration-based, semi-supervised learning-based, and existing UDA-based
methods.
Related papers
- Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI.
Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels.
The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
arXiv Detail & Related papers (2024-07-31T04:32:43Z) - SMC-UDA: Structure-Modal Constraint for Unsupervised Cross-Domain Renal
Segmentation [100.86339246424541]
We propose a novel Structure-Modal Constrained (SMC) UDA framework based on a discriminative paradigm and introduce edge structure as a bridge between domains.
With the structure-constrained self-learning and progressive ROI, our methods segment the kidney by locating the 3D spatial structure of the edge.
experiments show that our proposed SMC-UDA has a strong generalization and outperforms generative UDA methods.
arXiv Detail & Related papers (2023-06-14T02:57:23Z) - Contrastive Semi-supervised Learning for Domain Adaptive Segmentation
Across Similar Anatomical Structures [21.54339967787734]
We propose Contrastive Semi-supervised learning for Cross Anatomy Domain Adaptation.
It adapts a model to segment similar structures in a target domain.
It requires only limited annotations in the target domain.
arXiv Detail & Related papers (2022-08-18T02:54:04Z) - CAS-Net: Conditional Atlas Generation and Brain Segmentation for Fetal
MRI [10.127399319119911]
We propose a novel network structure that can simultaneously generate conditional atlases and predict brain tissue segmentation.
The proposed method is trained and evaluated on 253 subjects from the developing Human Connectome Project.
arXiv Detail & Related papers (2022-05-17T11:23:02Z) - Towards A Device-Independent Deep Learning Approach for the Automated
Segmentation of Sonographic Fetal Brain Structures: A Multi-Center and
Multi-Device Validation [0.0]
We propose a DL based segmentation framework for the automated segmentation of 10 key fetal brain structures from 2 axial planes from fetal brain USG images (2D)
The proposed DL system offered a promising and generalizable performance (multi-centers, multi-device) and also presents evidence in support of device-induced variation in image quality.
arXiv Detail & Related papers (2022-02-28T05:42:03Z) - Deep Joint Learning of Pathological Region Localization and Alzheimer's
Disease Diagnosis [4.5484714814315685]
BrainBagNet is a framework for jointly learning pathological region localization and Alzheimer's disease diagnosis.
The proposed method represents the patch-level response from whole-brain MRI scans and discriminative brain-region from position information.
In five-fold cross-validation, the classification performance of the proposed method outperformed that of the state-of-the-art methods in both AD diagnosis and mild cognitive impairment prediction tasks.
arXiv Detail & Related papers (2021-08-10T10:06:54Z) - Self-Supervised Domain Adaptation for Diabetic Retinopathy Grading using
Vessel Image Reconstruction [61.58601145792065]
We learn invariant target-domain features by defining a novel self-supervised task based on retinal vessel image reconstructions.
It can be shown that our approach outperforms existing domain strategies.
arXiv Detail & Related papers (2021-07-20T09:44:07Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - Domain adaptation based self-correction model for COVID-19 infection
segmentation in CT images [23.496487874821756]
We propose a domain adaptation based self-correction model (DASC-Net) for COVID-19 infection segmentation on CT images.
DASC-Net consists of a novel attention and feature domain enhanced domain adaptation model (AFD-DA) to solve the domain shifts and a self-correction learning process to refine results.
Extensive experiments over three publicly available COVID-19 CT datasets demonstrate that DASC-Net consistently outperforms state-of-the-art segmentation, domain shift, and coronavirus infection segmentation methods.
arXiv Detail & Related papers (2021-04-20T00:45:01Z) - Unsupervised Instance Segmentation in Microscopy Images via Panoptic
Domain Adaptation and Task Re-weighting [86.33696045574692]
We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images.
We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images.
Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
arXiv Detail & Related papers (2020-05-05T11:08:26Z) - Unsupervised Bidirectional Cross-Modality Adaptation via Deeply
Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA)
Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives.
Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
arXiv Detail & Related papers (2020-02-06T13:49:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.