Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI

• URL: http://arxiv.org/abs/2412.07783v3
• Date: Thu, 30 Jan 2025 10:33:33 GMT
• Title: Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI
• Authors: Patrick Styll, Dowon Kim, Jiook Cha,
• Abstract summary: Accurately predicting developmental outcomes during this time is crucial for identifying delays and enabling timely interventions. This study introduces the SwiFT (Swin 4D fMRI Transformer) model, designed to predict outcomes using neonatal fMRI. Our analysis shows that SwiFT significantly outperforms baseline models in predicting cognitive, motor, and language outcomes.
• Score: 0.20482269513546453
• License:
• Abstract: Brain development in the first few months of human life is a critical phase characterized by rapid structural growth and functional organization. Accurately predicting developmental outcomes during this time is crucial for identifying delays and enabling timely interventions. This study introduces the SwiFT (Swin 4D fMRI Transformer) model, designed to predict Bayley-III composite scores using neonatal fMRI from the Developing Human Connectome Project (dHCP). To enhance predictive accuracy, we apply dimensionality reduction via group independent component analysis (ICA) and pretrain SwiFT on large adult fMRI datasets to address the challenges of limited neonatal data. Our analysis shows that SwiFT significantly outperforms baseline models in predicting cognitive, motor, and language outcomes, leveraging both single-label and multi-label prediction strategies. The model's attention-based architecture processes spatiotemporal data end-to-end, delivering superior predictive performance. Additionally, we use Integrated Gradients with Smoothgrad sQuare (IG-SQ) to interpret predictions, identifying neural spatial representations linked to early cognitive and behavioral development. These findings underscore the potential of Transformer models to advance neurodevelopmental research and clinical practice.

Related papers

• LoCI-DiffCom: Longitudinal Consistency-Informed Diffusion Model for 3D Infant Brain Image Completion [45.361733575664886]
  We propose LoCI-DiffCom, a novel Longitudinal Consistency-Informed Diffusion model for infant brain image Completion. Our approach can extract individualized developmental features while ensuring context-aware consistency.
  arXiv  Detail & Related papers  (2024-05-17T10:53:40Z)
• Learning Developmental Age from 3D Infant Kinetics Using Adaptive Graph Neural Networks [2.2279946664123664]
  Kinetic Age (KA) is a data-driven metric to quantifies neurodevelopmental maturity by predicting an infant's age based on their movement patterns. Our method leverages 3D video recordings of infants, processed with pose estimation to extract-temporal series of anatomical landmarks. These data are modeled using adaptive graph convolutional networks, able to capture the detection-temporal dependencies in infant movements.
  arXiv  Detail & Related papers  (2024-02-22T09:34:48Z)
• Cas-DiffCom: Cascaded diffusion model for infant longitudinal super-resolution 3D medical image completion [47.83003164569194]
  We propose a two-stage cascaded diffusion model, Cas-DiffCom, for dense and longitudinal 3D infant brain MRI completion and super-resolution. Experiment results validate that Cas-DiffCom achieves both individual consistency and high fidelity in longitudinal infant brain image completion.
  arXiv  Detail & Related papers  (2024-02-21T12:54:40Z)
• Predicting Infant Brain Connectivity with Federated Multi-Trajectory GNNs using Scarce Data [54.55126643084341]
  Existing deep learning solutions suffer from three major limitations. We introduce FedGmTE-Net++, a federated graph-based multi-trajectory evolution network. Using the power of federation, we aggregate local learnings among diverse hospitals with limited datasets.
  arXiv  Detail & Related papers  (2024-01-01T10:20:01Z)
• MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation [58.93221876843639]
  This paper introduces a novel, end-to-end diffusion-based risk prediction model, named MedDiffusion. It enhances risk prediction performance by creating synthetic patient data during training to enlarge sample space. It discerns hidden relationships between patient visits using a step-wise attention mechanism, enabling the model to automatically retain the most vital information for generating high-quality data.
  arXiv  Detail & Related papers  (2023-10-04T01:36:30Z)
• NeuroExplainer: Fine-Grained Attention Decoding to Uncover Cortical Development Patterns of Preterm Infants [73.85768093666582]
  We propose an explainable geometric deep network dubbed NeuroExplainer. NeuroExplainer is used to uncover altered infant cortical development patterns associated with preterm birth.
  arXiv  Detail & Related papers  (2023-01-01T12:48:12Z)
• Neurodevelopmental Phenotype Prediction: A State-of-the-Art Deep Learning Model [0.0]
  We apply a deep neural network to analyse the cortical surface data of neonates. Our goal is to identify neurodevelopmental biomarkers and to predict gestational age at birth based on these biomarkers.
  arXiv  Detail & Related papers  (2022-11-16T11:15:23Z)
• Learning Personal Representations from fMRIby Predicting Neurofeedback Performance [52.77024349608834]
  We present a deep neural network method for learning a personal representation for individuals performing a self neuromodulation task, guided by functional MRI (fMRI) The representation is learned by a self-supervised recurrent neural network, that predicts the Amygdala activity in the next fMRI frame given recent fMRI frames and is conditioned on the learned individual representation.
  arXiv  Detail & Related papers  (2021-12-06T10:16:54Z)
• Towards human-level performance on automatic pose estimation of infant spontaneous movements [2.7086496937827005]
  Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries.
  arXiv  Detail & Related papers  (2020-10-12T18:17:47Z)
• Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression [11.1492931066686]
  We present a temporal deep learning model to perform bidirectional representation learning on EHR sequences to predict depression. The model generated the highest increases of precision-recall area under the curve (PRAUC) from 0.70 to 0.76 in depression prediction compared to the best baseline model.
  arXiv  Detail & Related papers  (2020-09-26T17:56:37Z)
• Neuro-symbolic Neurodegenerative Disease Modeling as Probabilistic Programmed Deep Kernels [93.58854458951431]
  We present a probabilistic programmed deep kernel learning approach to personalized, predictive modeling of neurodegenerative diseases. Our analysis considers a spectrum of neural and symbolic machine learning approaches. We run evaluations on the problem of Alzheimer's disease prediction, yielding results that surpass deep learning.
  arXiv  Detail & Related papers  (2020-09-16T15:16:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.