LoCI-DiffCom: Longitudinal Consistency-Informed Diffusion Model for 3D Infant Brain Image Completion
- URL: http://arxiv.org/abs/2405.10691v1
- Date: Fri, 17 May 2024 10:53:40 GMT
- Title: LoCI-DiffCom: Longitudinal Consistency-Informed Diffusion Model for 3D Infant Brain Image Completion
- Authors: Zihao Zhu, Tianli Tao, Yitian Tao, Haowen Deng, Xinyi Cai, Gaofeng Wu, Kaidong Wang, Haifeng Tang, Lixuan Zhu, Zhuoyang Gu, Jiawei Huang, Dinggang Shen, Han Zhang,
- Abstract summary: We propose LoCI-DiffCom, a novel Longitudinal Consistency-Informed Diffusion model for infant brain image Completion.
Our approach can extract individualized developmental features while ensuring context-aware consistency.
- Score: 45.361733575664886
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The infant brain undergoes rapid development in the first few years after birth.Compared to cross-sectional studies, longitudinal studies can depict the trajectories of infants brain development with higher accuracy, statistical power and flexibility.However, the collection of infant longitudinal magnetic resonance (MR) data suffers a notorious dropout problem, resulting in incomplete datasets with missing time points. This limitation significantly impedes subsequent neuroscience and clinical modeling. Yet, existing deep generative models are facing difficulties in missing brain image completion, due to sparse data and the nonlinear, dramatic contrast/geometric variations in the developing brain. We propose LoCI-DiffCom, a novel Longitudinal Consistency-Informed Diffusion model for infant brain image Completion,which integrates the images from preceding and subsequent time points to guide a diffusion model for generating high-fidelity missing data. Our designed LoCI module can work on highly sparse sequences, relying solely on data from two temporal points. Despite wide separation and diversity between age time points, our approach can extract individualized developmental features while ensuring context-aware consistency. Our experiments on a large infant brain MR dataset demonstrate its effectiveness with consistent performance on missing infant brain MR completion even in big gap scenarios, aiding in better delineation of early developmental trajectories.
Related papers
- Modeling the Neonatal Brain Development Using Implicit Neural Representations [1.5550533143704954]
We propose a neural network, specifically an implicit neural representation (INR), to predict 2D- and 3D images of varying time points.
In order to model a subject-specific development process, it is necessary to disentangle the age from the subjects' identity in the latent space of the INR.
We show that our method can be applied in a memory-efficient way, which is especially important for 3D data.
arXiv Detail & Related papers (2024-08-16T10:22:54Z) - SynthBA: Reliable Brain Age Estimation Across Multiple MRI Sequences and Resolutions [4.543154658281538]
The gap between brain age and chronological age, referred to as brain PAD (Predicted Age Difference), has been utilized to investigate neurodegenerative conditions.
Brain age can be predicted using MRIs and machine learning techniques.
We introduce Synthetic Brain Age ( SynthBA), a robust deep-learning model designed for predicting brain age.
arXiv Detail & Related papers (2024-06-01T08:58:40Z) - BrainODE: Dynamic Brain Signal Analysis via Graph-Aided Neural Ordinary Differential Equations [67.79256149583108]
We propose a novel model called BrainODE to achieve continuous modeling of dynamic brain signals.
By learning latent initial values and neural ODE functions from irregular time series, BrainODE effectively reconstructs brain signals at any time point.
arXiv Detail & Related papers (2024-04-30T10:53:30Z) - SynthBrainGrow: Synthetic Diffusion Brain Aging for Longitudinal MRI Data Generation in Young People [0.49478969093606673]
Synthetic longitudinal brain MRI simulates brain aging and would enable more efficient research on neurodevelopmental and neurodegenerative conditions.
We present a diffusion-based approach called SynthBrainGrow for synthetic brain aging with a two-year step.
Results show that SynthBrainGrow can accurately capture substructures and simulate structural changes such as ventricle enlargement and cortical thinning.
arXiv Detail & Related papers (2024-02-22T20:47:40Z) - Cas-DiffCom: Cascaded diffusion model for infant longitudinal
super-resolution 3D medical image completion [47.83003164569194]
We propose a two-stage cascaded diffusion model, Cas-DiffCom, for dense and longitudinal 3D infant brain MRI completion and super-resolution.
Experiment results validate that Cas-DiffCom achieves both individual consistency and high fidelity in longitudinal infant brain image completion.
arXiv Detail & Related papers (2024-02-21T12:54:40Z) - Long Short-term Memory with Two-Compartment Spiking Neuron [64.02161577259426]
We propose a novel biologically inspired Long Short-Term Memory Leaky Integrate-and-Fire spiking neuron model, dubbed LSTM-LIF.
Our experimental results, on a diverse range of temporal classification tasks, demonstrate superior temporal classification capability, rapid training convergence, strong network generalizability, and high energy efficiency of the proposed LSTM-LIF model.
This work, therefore, opens up a myriad of opportunities for resolving challenging temporal processing tasks on emerging neuromorphic computing machines.
arXiv Detail & Related papers (2023-07-14T08:51:03Z) - The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Tasks [64.08042492426992]
We introduce the Expressive Memory (ELM) neuron model, a biologically inspired model of a cortical neuron.
Our ELM neuron can accurately match the aforementioned input-output relationship with under ten thousand trainable parameters.
We evaluate it on various tasks with demanding temporal structures, including the Long Range Arena (LRA) datasets.
arXiv Detail & Related papers (2023-06-14T13:34:13Z) - Continuous longitudinal fetus brain atlas construction via implicit
neural representation [8.593931751099944]
We propose a multi-stage deep-learning framework to tackle the time inconsistency issue as a 4D (3D brain volume + 1D age) image data denoising task.
Using implicit representation, we construct a continuous and noise-free longitudinal fetus brain atlas as a function of the 4D spatial coordinate.
arXiv Detail & Related papers (2022-09-14T04:51:17Z) - Cross-Modality Neuroimage Synthesis: A Survey [71.27193056354741]
Multi-modality imaging improves disease diagnosis and reveals distinct deviations in tissues with anatomical properties.
The existence of completely aligned and paired multi-modality neuroimaging data has proved its effectiveness in brain research.
An alternative solution is to explore unsupervised or weakly supervised learning methods to synthesize the absent neuroimaging data.
arXiv Detail & Related papers (2022-02-14T19:29:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.