Meta-Analysis of Transfer Learning for Segmentation of Brain Lesions
- URL: http://arxiv.org/abs/2306.11714v1
- Date: Tue, 20 Jun 2023 17:42:30 GMT
- Title: Meta-Analysis of Transfer Learning for Segmentation of Brain Lesions
- Authors: Sovesh Mohapatra, Advait Gosai, Anant Shinde, Aleksei Rutkovskii,
Sirisha Nouduri, Gottfried Schlaug
- Abstract summary: Manual segmentation of stroke lesions from 3D magnetic resonance (MR) imaging volumes, the current gold standard, is not only very time-consuming, but its accuracy highly depends on the operator's experience.
We have implemented and tested a fully automatic method for stroke lesion segmentation using eight different 2D-model architectures trained via transfer learning (TL) and mixed data approaches.
Cross-validation results indicate that our new method can efficiently and automatically segment lesions fast and with high accuracy compared to ground truth.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: A major challenge in stroke research and stroke recovery predictions is the
determination of a stroke lesion's extent and its impact on relevant brain
systems. Manual segmentation of stroke lesions from 3D magnetic resonance (MR)
imaging volumes, the current gold standard, is not only very time-consuming,
but its accuracy highly depends on the operator's experience. As a result,
there is a need for a fully automated segmentation method that can efficiently
and objectively measure lesion extent and the impact of each lesion to predict
impairment and recovery potential which might be beneficial for clinical,
translational, and research settings. We have implemented and tested a fully
automatic method for stroke lesion segmentation which was developed using eight
different 2D-model architectures trained via transfer learning (TL) and mixed
data approaches. Additionally, the final prediction was made using a novel
ensemble method involving stacking and agreement window. Our novel method was
evaluated in a novel in-house dataset containing 22 T1w brain MR images, which
were challenging in various perspectives, but mostly because they included T1w
MR images from the subacute (which typically less well defined T1 lesions) and
chronic stroke phase (which typically means well defined T1-lesions).
Cross-validation results indicate that our new method can efficiently and
automatically segment lesions fast and with high accuracy compared to ground
truth. In addition to segmentation, we provide lesion volume and weighted
lesion load of relevant brain systems based on the lesions' overlap with a
canonical structural motor system that stretches from the cortical motor region
to the lowest end of the brain stem.
Related papers
- Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI.
Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels.
The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
arXiv Detail & Related papers (2024-07-31T04:32:43Z) - Concurrent ischemic lesion age estimation and segmentation of CT brain
using a Transformer-based network [8.80381582892208]
We propose a novel end-to-end multi-task transformer-based network optimized for concurrent segmentation and age estimation of cerebral ischemic lesions.
Our method obtains promising performance, with an area under the curve (AUC) of 0.933 for classifying lesion ages =4.5 hours compared to 0.858 using a conventional approach.
arXiv Detail & Related papers (2023-06-21T13:00:49Z) - Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network.
We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module.
Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
arXiv Detail & Related papers (2022-12-01T07:32:56Z) - fMRI from EEG is only Deep Learning away: the use of interpretable DL to
unravel EEG-fMRI relationships [68.8204255655161]
We present an interpretable domain grounded solution to recover the activity of several subcortical regions from multichannel EEG data.
We recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei.
arXiv Detail & Related papers (2022-10-23T15:11:37Z) - Whole-Body Lesion Segmentation in 18F-FDG PET/CT [11.662584140924725]
The proposed model is designed on the basis of the joint 2D and 3D nnUNET architecture to predict lesions across the whole body.
We evaluate the proposed method in the context of AutoPet Challenge, which measures the lesion segmentation performance in the metrics of dice score, false-positive volume and false-negative volume.
arXiv Detail & Related papers (2022-09-16T10:49:53Z) - Weakly-supervised Biomechanically-constrained CT/MRI Registration of the
Spine [72.85011943179894]
We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration.
We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI.
Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
arXiv Detail & Related papers (2022-05-16T10:59:55Z) - DFENet: A Novel Dimension Fusion Edge Guided Network for Brain MRI
Segmentation [0.0]
We propose a novel Dimension Fusion Edge-guided network (DFENet) that can meet both of these requirements by fusing the features of 2D and 3D CNNs.
The proposed model is robust, accurate, superior to the existing methods, and can be relied upon for biomedical applications.
arXiv Detail & Related papers (2021-05-17T15:43:59Z) - Combining unsupervised and supervised learning for predicting the final
stroke lesion [2.587975592408692]
We propose a fully automatic deep learning method to predict the final stroke lesion after 90 days.
Our aim is to predict the final stroke lesion location and extent, taking into account the underlying cerebral blood flow dynamics that can influence the prediction.
arXiv Detail & Related papers (2021-01-02T17:56:47Z) - Multiple Sclerosis Lesion Activity Segmentation with Attention-Guided
Two-Path CNNs [49.32653090178743]
convolutional neural networks (CNNs) are studied for lesion activity segmentation from two time points.
CNNs are designed and evaluated that combine the information from two points in different ways.
It is demonstrated that deep learning-based methods outperform classic approaches.
arXiv Detail & Related papers (2020-08-05T08:49:20Z) - A comparative study of 2D image segmentation algorithms for traumatic
brain lesions using CT data from the ProTECTIII multicenter clinical trial [0.0]
We have tried to segment different phenotypes of hemorrhagic lesions found after traumatic brain injury (TBI)
These include: intraparenchymal hemorrhage (IPH), subdural hematoma (SDH), epidural hematoma (EDH), and traumatic contusions.
We were able to achieve an optimal Dice Coefficient1 score of 0.94 using UNet++ 2D Architecture with Focal Tversky Loss Function.
We were also able to achieve the Dice Coefficient score of 0.90 and 0.86 in cases of Extra-Axial bleeds and Traumatic contusions, respectively.
arXiv Detail & Related papers (2020-06-01T21:00:20Z) - 4D Deep Learning for Multiple Sclerosis Lesion Activity Segmentation [49.32653090178743]
We investigate whether extending this problem to full 4D deep learning using a history of MRI volumes can improve performance.
We find that our proposed architecture outperforms previous approaches with a lesion-wise true positive rate of 0.84 at a lesion-wise false positive rate of 0.19.
arXiv Detail & Related papers (2020-04-20T11:41:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.