Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance
from High-Quality Isotropic Volumes
- URL: http://arxiv.org/abs/2308.06762v2
- Date: Mon, 4 Dec 2023 08:08:05 GMT
- Title: Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance
from High-Quality Isotropic Volumes
- Authors: Shijie Huang, Xukun Zhang, Zhiming Cui, He Zhang, Geng Chen, Dinggang
Shen
- Abstract summary: We propose a novel Cycle-Consistent Domain Adaptation Network (C2DA-Net) to efficiently transfer the knowledge learned from high-quality isotropic volumes for accurate tissue segmentation of thick-slice scans.
Our C2DA-Net can fully utilize a small set of annotated isotropic volumes to guide tissue segmentation on unannotated thick-slice scans.
- Score: 52.242103848335354
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate tissue segmentation of thick-slice fetal brain magnetic resonance
(MR) scans is crucial for both reconstruction of isotropic brain MR volumes and
the quantification of fetal brain development. However, this task is
challenging due to the use of thick-slice scans in clinically-acquired fetal
brain data. To address this issue, we propose to leverage high-quality
isotropic fetal brain MR volumes (and also their corresponding annotations) as
guidance for segmentation of thick-slice scans. Due to existence of significant
domain gap between high-quality isotropic volume (i.e., source data) and
thick-slice scans (i.e., target data), we employ a domain adaptation technique
to achieve the associated knowledge transfer (from high-quality <source>
volumes to thick-slice <target> scans). Specifically, we first register the
available high-quality isotropic fetal brain MR volumes across different
gestational weeks to construct longitudinally-complete source data. To capture
domain-invariant information, we then perform Fourier decomposition to extract
image content and style codes. Finally, we propose a novel Cycle-Consistent
Domain Adaptation Network (C2DA-Net) to efficiently transfer the knowledge
learned from high-quality isotropic volumes for accurate tissue segmentation of
thick-slice scans. Our C2DA-Net can fully utilize a small set of annotated
isotropic volumes to guide tissue segmentation on unannotated thick-slice
scans. Extensive experiments on a large-scale dataset of 372 clinically
acquired thick-slice MR scans demonstrate that our C2DA-Net achieves much
better performance than cutting-edge methods quantitatively and qualitatively.
Related papers
- Anatomically Constrained Tractography of the Fetal Brain [6.112565873653592]
We advocate for anatomically constrained tractography based on an accurate segmentation of the fetal brain tissue directly in the dMRI space.
Experiments on independent test data show that this method can accurately segment the fetal brain tissue and drastically improve tractography results.
arXiv Detail & Related papers (2024-03-04T19:56:19Z) - SDR-Former: A Siamese Dual-Resolution Transformer for Liver Lesion
Classification Using 3D Multi-Phase Imaging [59.78761085714715]
This study proposes a novel Siamese Dual-Resolution Transformer (SDR-Former) framework for liver lesion classification.
The proposed framework has been validated through comprehensive experiments on two clinical datasets.
To support the scientific community, we are releasing our extensive multi-phase MR dataset for liver lesion analysis to the public.
arXiv Detail & Related papers (2024-02-27T06:32:56Z) - An Unpaired Cross-modality Segmentation Framework Using Data
Augmentation and Hybrid Convolutional Networks for Segmenting Vestibular
Schwannoma and Cochlea [7.7150383247700605]
The crossMoDA challenge aims to automatically segment the vestibular schwannoma (VS) tumor and cochlea regions of unlabeled high-resolution T2 scans.
The 2022 edition extends the segmentation task by including multi-institutional scans.
We propose an unpaired cross-modality segmentation framework using data augmentation and hybrid convolutional networks.
arXiv Detail & Related papers (2022-11-28T01:15:33Z) - Vox2Cortex: Fast Explicit Reconstruction of Cortical Surfaces from 3D
MRI Scans with Geometric Deep Neural Networks [3.364554138758565]
We propose Vox2Cortex, a deep learning-based algorithm that directly yields topologically correct, three-dimensional meshes of the boundaries of the cortex.
We show in extensive experiments on three brain MRI datasets that our meshes are as accurate as the ones reconstructed by state-of-the-art methods in the field.
arXiv Detail & Related papers (2022-03-17T17:06:00Z) - Synthetic magnetic resonance images for domain adaptation: Application
to fetal brain tissue segmentation [0.0]
We use FaBiAN to simulate various realistic magnetic resonance images of the fetal brain along with its class labels.
We demonstrate that these multiple synthetic annotated data, generated at no cost and further reconstructed using the target super-resolution technique, can be successfully used for domain adaptation of a deep learning method.
Overall, the accuracy of the segmentation is significantly enhanced, especially in the cortical gray matter, the white matter, the cerebellum, the deep gray matter and the brain stem.
arXiv Detail & Related papers (2021-11-08T13:22:14Z) - Self-Supervised Multi-Modal Alignment for Whole Body Medical Imaging [70.52819168140113]
We use a dataset of over 20,000 subjects from the UK Biobank with both whole body Dixon technique magnetic resonance (MR) scans and also dual-energy x-ray absorptiometry (DXA) scans.
We introduce a multi-modal image-matching contrastive framework, that is able to learn to match different-modality scans of the same subject with high accuracy.
Without any adaption, we show that the correspondences learnt during this contrastive training step can be used to perform automatic cross-modal scan registration.
arXiv Detail & Related papers (2021-07-14T12:35:05Z) - Fader Networks for domain adaptation on fMRI: ABIDE-II study [68.5481471934606]
We use 3D convolutional autoencoders to build the domain irrelevant latent space image representation and demonstrate this method to outperform existing approaches on ABIDE data.
arXiv Detail & Related papers (2020-10-14T16:50:50Z) - Automated Segmentation of Brain Gray Matter Nuclei on Quantitative
Susceptibility Mapping Using Deep Convolutional Neural Network [16.733578721523898]
Abnormal iron accumulation in the brain subcortical nuclei has been reported to be correlated to various neurodegenerative diseases.
We propose a double-branch residual-structured U-Net (DB-ResUNet) based on 3D convolutional neural network (CNN) to automatically segment such brain gray matter nuclei.
arXiv Detail & Related papers (2020-08-03T14:32:30Z) - Hybrid Attention for Automatic Segmentation of Whole Fetal Head in
Prenatal Ultrasound Volumes [52.53375964591765]
We propose the first fully-automated solution to segment the whole fetal head in US volumes.
The segmentation task is firstly formulated as an end-to-end volumetric mapping under an encoder-decoder deep architecture.
We then combine the segmentor with a proposed hybrid attention scheme (HAS) to select discriminative features and suppress the non-informative volumetric features.
arXiv Detail & Related papers (2020-04-28T14:43:05Z) - Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion
Encoding (SIDE) [50.65891535040752]
We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion.
SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients.
We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
arXiv Detail & Related papers (2020-02-25T14:48:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.