Improving cross-domain brain tissue segmentation in fetal MRI with synthetic data

• URL: http://arxiv.org/abs/2403.15103v1
• Date: Fri, 22 Mar 2024 10:42:25 GMT
• Title: Improving cross-domain brain tissue segmentation in fetal MRI with synthetic data
• Authors: Vladyslav Zalevskyi, Thomas Sanchez, Margaux Roulet, Jordina Aviles Verddera, Jana Hutter, Hamza Kebiri, Meritxell Bach Cuadra,
• Abstract summary: We introduce Fetal SynthSeg, a domain randomization method to segment fetal brain MRI. Our results show that models trained solely on synthetic data outperform models trained on real data. We extend our evaluation to 40 subjects acquired using lowfield (0.55T) MRI and reconstructed with novel SR models.
• Score: 1.1936126505067601
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Segmentation of fetal brain tissue from magnetic resonance imaging (MRI) plays a crucial role in the study of in utero neurodevelopment. However, automated tools face substantial domain shift challenges as they must be robust to highly heterogeneous clinical data, often limited in numbers and lacking annotations. Indeed, high variability of the fetal brain morphology, MRI acquisition parameters, and superresolution reconstruction (SR) algorithms adversely affect the model's performance when evaluated out-of-domain. In this work, we introduce FetalSynthSeg, a domain randomization method to segment fetal brain MRI, inspired by SynthSeg. Our results show that models trained solely on synthetic data outperform models trained on real data in out-ofdomain settings, validated on a 120-subject cross-domain dataset. Furthermore, we extend our evaluation to 40 subjects acquired using lowfield (0.55T) MRI and reconstructed with novel SR models, showcasing robustness across different magnetic field strengths and SR algorithms. Leveraging a generative synthetic approach, we tackle the domain shift problem in fetal brain MRI and offer compelling prospects for applications in fields with limited and highly heterogeneous data.

Related papers

• Pathological MRI Segmentation by Synthetic Pathological Data Generation in Fetuses and Neonates [0.2595862142227317]
  We introduce Fetal&Neonatal-DDPM, a novel diffusion model framework designed to generate high-quality synthetic pathological fetal and neonatal MRIs from semantic label images. By leveraging Fetal&Neonatal-DDPM, we synthesize realistic pathological MRIs from these modified pathological label images. Radiologists rated the synthetic MRIs as significantly superior in quality and diagnostic value compared to real MRIs.
  arXiv  Detail & Related papers  (2025-01-31T17:36:24Z)
• ContextMRI: Enhancing Compressed Sensing MRI through Metadata Conditioning [51.26601171361753]
  We propose ContextMRI, a text-conditioned diffusion model for MRI that integrates granular metadata into the reconstruction process. We show that increasing the fidelity of metadata, ranging from slice location and contrast to patient age, sex, and pathology, systematically boosts reconstruction performance.
  arXiv  Detail & Related papers  (2025-01-08T05:15:43Z)
• Domain-Agnostic Stroke Lesion Segmentation Using Physics-Constrained Synthetic Data [0.15749416770494706]
  We propose two novel approaches using synthetic quantitative MRI (qMRI) images to enhance the robustness and generalisability of segmentation models. We trained a qMRI estimation model to predict qMRI maps from MPRAGE images, which were used to simulate diverse MRI sequences for segmentation training. A second approach built upon prior work in synthetic data for stroke lesion segmentation, generating qMRI maps from a dataset of tissue labels.
  arXiv  Detail & Related papers  (2024-12-04T13:52:05Z)
• Multi-modal Cross-domain Self-supervised Pre-training for fMRI and EEG Fusion [3.8153469790341084]
  We propose a novel approach that leverages self-supervised learning to synergize multi-modal information across domains. We constructed a large-scale pre-training dataset and pretrained MCSP model by leveraging proposed self-supervised paradigms. Our study contributes a significant advancement in the fusion of fMRI and EEG, marking a novel integration of cross-domain features.
  arXiv  Detail & Related papers  (2024-09-27T20:25:17Z)
• A Demographic-Conditioned Variational Autoencoder for fMRI Distribution Sampling and Removal of Confounds [49.34500499203579]
  We create a variational autoencoder (VAE)-based model, DemoVAE, to decorrelate fMRI features from demographics. We generate high-quality synthetic fMRI data based on user-supplied demographics.
  arXiv  Detail & Related papers  (2024-05-13T17:49:20Z)
• fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding [54.17776744076334]
  We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training. Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns. Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
  arXiv  Detail & Related papers  (2023-11-01T07:24:22Z)
• Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs [12.492451825171408]
  We propose a new generative model, Brain Synth, to synthesize metadata-conditioned (e.g., age- and sex-specific) MRIs. Results indicate that more than half of the brain regions in our synthetic MRIs are anatomically accurate, with a small effect size between real and synthetic MRIs. Our synthetic MRIs can significantly improve the training of a Convolutional Neural Network to identify accelerated aging effects.
  arXiv  Detail & Related papers  (2023-10-07T00:05:47Z)
• Source-Free Collaborative Domain Adaptation via Multi-Perspective Feature Enrichment for Functional MRI Analysis [55.03872260158717]
  Resting-state MRI functional (rs-fMRI) is increasingly employed in multi-site research to aid neurological disorder analysis. Many methods have been proposed to reduce fMRI heterogeneity between source and target domains. But acquiring source data is challenging due to concerns and/or data storage burdens in multi-site studies. We design a source-free collaborative domain adaptation framework for fMRI analysis, where only a pretrained source model and unlabeled target data are accessible.
  arXiv  Detail & Related papers  (2023-08-24T01:30:18Z)
• Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
  This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods. We will detail the research in coupling physics and data driven models for MRI acceleration. Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
  arXiv  Detail & Related papers  (2022-04-01T22:48:08Z)
• Fader Networks for domain adaptation on fMRI: ABIDE-II study [68.5481471934606]
  We use 3D convolutional autoencoders to build the domain irrelevant latent space image representation and demonstrate this method to outperform existing approaches on ABIDE data.
  arXiv  Detail & Related papers  (2020-10-14T16:50:50Z)
• Incorporating structured assumptions with probabilistic graphical models in fMRI data analysis [5.23143327587266]
  We review a few recently developed algorithms in various domains of fMRI research. These algorithms all tackle the challenges in fMRI similarly. We advocate wider adoption of explicit model construction in cognitive neuroscience.
  arXiv  Detail & Related papers  (2020-05-11T06:32:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.