Image Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI

• URL: http://arxiv.org/abs/2108.01659v1
• Date: Tue, 3 Aug 2021 17:56:50 GMT
• Title: Image Augmentation Using a Task Guided Generative Adversarial Network for Age Estimation on Brain MRI
• Authors: Ruizhe Li, Matteo Bastiani, Dorothee Auer, Christian Wagner, and Xin Chen
• Abstract summary: We propose a generative adversarial network (GAN) based image synthesis method to overcome the data scarcity problem. By adding a task-guided loss to the conventional GAN loss, the learned low-dimensional latent space and the synthesised images are more task-specific. Our proposed method outperformed (statistically significant) a deep convolutional neural network based regression model and the GAN-based image synthesis method without the task-guided branch.
• Score: 6.051767128521292
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Brain age estimation based on magnetic resonance imaging (MRI) is an active research area in early diagnosis of some neurodegenerative diseases (e.g. Alzheimer, Parkinson, Huntington, etc.) for elderly people or brain underdevelopment for the young group. Deep learning methods have achieved the state-of-the-art performance in many medical image analysis tasks, including brain age estimation. However, the performance and generalisability of the deep learning model are highly dependent on the quantity and quality of the training data set. Both collecting and annotating brain MRI data are extremely time-consuming. In this paper, to overcome the data scarcity problem, we propose a generative adversarial network (GAN) based image synthesis method. Different from the existing GAN-based methods, we integrate a task-guided branch (a regression model for age estimation) to the end of the generator in GAN. By adding a task-guided loss to the conventional GAN loss, the learned low-dimensional latent space and the synthesised images are more task-specific. It helps to boost the performance of the down-stream task by combining the synthesised images and real images for model training. The proposed method was evaluated on a public brain MRI data set for age estimation. Our proposed method outperformed (statistically significant) a deep convolutional neural network based regression model and the GAN-based image synthesis method without the task-guided branch. More importantly, it enables the identification of age-related brain regions in the image space. The code is available on GitHub (https://github.com/ruizhe-l/tgb-gan).

Related papers

• Self-supervised Brain Lesion Generation for Effective Data Augmentation of Medical Images [0.9626666671366836]
  We propose a framework to efficiently generate new, realistic samples for training a brain lesion segmentation model. We first train a lesion generator, based on an adversarial autoencoder, in a self-supervised manner. Next, we utilize a novel image composition algorithm, Soft Poisson Blending, to seamlessly combine synthetic lesions and brain images.
  arXiv  Detail & Related papers  (2024-06-21T01:53:12Z)
• MindFormer: A Transformer Architecture for Multi-Subject Brain Decoding via fMRI [50.55024115943266]
  We introduce a new Transformer architecture called MindFormer to generate fMRI-conditioned feature vectors. MindFormer incorporates two key innovations: 1) a novel training strategy based on the IP-Adapter to extract semantically meaningful features from fMRI signals, and 2) a subject specific token and linear layer that effectively capture individual differences in fMRI signals.
  arXiv  Detail & Related papers  (2024-05-28T00:36:25Z)
• Synthetic Brain Images: Bridging the Gap in Brain Mapping With Generative Adversarial Model [0.0]
  This work investigates the use of Deep Convolutional Generative Adversarial Networks (DCGAN) for producing high-fidelity and realistic MRI image slices. While the discriminator network discerns between created and real slices, the generator network learns to synthesise realistic MRI image slices. The generator refines its capacity to generate slices that closely mimic real MRI data through an adversarial training approach.
  arXiv  Detail & Related papers  (2024-04-11T05:06:51Z)
• SynthBrainGrow: Synthetic Diffusion Brain Aging for Longitudinal MRI Data Generation in Young People [0.49478969093606673]
  Synthetic longitudinal brain MRI simulates brain aging and would enable more efficient research on neurodevelopmental and neurodegenerative conditions. We present a diffusion-based approach called SynthBrainGrow for synthetic brain aging with a two-year step. Results show that SynthBrainGrow can accurately capture substructures and simulate structural changes such as ventricle enlargement and cortical thinning.
  arXiv  Detail & Related papers  (2024-02-22T20:47:40Z)
• fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for Multi-Subject Brain Activity Decoding [54.17776744076334]
  We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training. Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns. Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
  arXiv  Detail & Related papers  (2023-11-01T07:24:22Z)
• Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
  We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy. We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
  arXiv  Detail & Related papers  (2023-03-07T09:40:22Z)
• Automatic Classification of Alzheimer's Disease using brain MRI data and deep Convolutional Neural Networks [0.0]
  Alzheimer's disease (AD) is one of the most common public health issues the world is facing today. This paper explores the construction of several deep learning architectures evaluated on brain MRI images and segmented images.
  arXiv  Detail & Related papers  (2022-03-31T20:15:51Z)
• Cross-Modality Neuroimage Synthesis: A Survey [71.27193056354741]
  Multi-modality imaging improves disease diagnosis and reveals distinct deviations in tissues with anatomical properties. The existence of completely aligned and paired multi-modality neuroimaging data has proved its effectiveness in brain research. An alternative solution is to explore unsupervised or weakly supervised learning methods to synthesize the absent neuroimaging data.
  arXiv  Detail & Related papers  (2022-02-14T19:29:08Z)
• Predi\c{c}\~ao da Idade Cerebral a partir de Imagens de Resson\^ancia Magn\'etica utilizando Redes Neurais Convolucionais [57.52103125083341]
  Deep learning techniques for brain age prediction from magnetic resonance images are investigated. The identification of biomarkers is useful for detecting an early-stage neurodegenerative process, as well as for predicting age-related or non-age-related cognitive decline. The best result was obtained by the 2D model, which achieved a mean absolute error of 3.83 years.
  arXiv  Detail & Related papers  (2021-12-23T14:51:45Z)
• Patch-based Brain Age Estimation from MR Images [64.66978138243083]
  Brain age estimation from Magnetic Resonance Images (MRI) derives the difference between a subject's biological brain age and their chronological age. Early detection of neurodegeneration manifesting as a higher brain age can potentially facilitate better medical care and planning for affected individuals. We develop a new deep learning approach that uses 3D patches of the brain as well as convolutional neural networks (CNNs) to develop a localised brain age estimator.
  arXiv  Detail & Related papers  (2020-08-29T11:50:37Z)
• Attend and Decode: 4D fMRI Task State Decoding Using Attention Models [2.6954666679827137]
  We present a novel architecture called Brain Attend and Decode (BAnD) BAnD uses residual convolutional neural networks for spatial feature extraction and self-attention mechanisms temporal modeling. We achieve significant performance gain compared to previous works on a 7-task benchmark from the Human Connectome Project-Young Adult dataset.
  arXiv  Detail & Related papers  (2020-04-10T21:29:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.