Simulation of acquisition shifts in T2 Flair MR images to stress test AI
segmentation networks
- URL: http://arxiv.org/abs/2311.01894v1
- Date: Fri, 3 Nov 2023 13:10:55 GMT
- Title: Simulation of acquisition shifts in T2 Flair MR images to stress test AI
segmentation networks
- Authors: Christiane Posselt (1), Mehmet Yigit Avci (2), Mehmet Yigitsoy (2),
Patrick Sch\"unke (3), Christoph Kolbitsch (3), Tobias Sch\"affter (3 and 4),
Stefanie Remmele (1) ((1) University of Applied Sciences, Faculty of
Electrical and Industrial Engineering, Am Lurzenhof 1, Landshut, Germany, (2)
deepc GmbH, Blumenstrasse 28, 80331 Munich, Germany, (3) Physikalisch
Technische Bundesanstalt, Abbestrasse 2-12, 10587 Berlin, Germany, (4)
Technical University of Berlin, Department of Medical Engineering,
Dovestrasse 6, Berlin, Germany)
- Abstract summary: The approach simulates "acquisition shift derivatives" of MR images based on MR signal equations.
Experiments comprise the validation of the simulated images by real MR scans and example stress tests on state-of-the-art MS lesion segmentation networks.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Purpose: To provide a simulation framework for routine neuroimaging test
data, which allows for "stress testing" of deep segmentation networks against
acquisition shifts that commonly occur in clinical practice for T2 weighted
(T2w) fluid attenuated inversion recovery (FLAIR) Magnetic Resonance Imaging
(MRI) protocols.
Approach: The approach simulates "acquisition shift derivatives" of MR images
based on MR signal equations. Experiments comprise the validation of the
simulated images by real MR scans and example stress tests on state-of-the-art
MS lesion segmentation networks to explore a generic model function to describe
the F1 score in dependence of the contrast-affecting sequence parameters echo
time (TE) and inversion time (TI).
Results: The differences between real and simulated images range up to 19 %
in gray and white matter for extreme parameter settings. For the segmentation
networks under test the F1 score dependency on TE and TI can be well described
by quadratic model functions (R^2 > 0.9). The coefficients of the model
functions indicate that changes of TE have more influence on the model
performance than TI.
Conclusions: We show that these deviations are in the range of values as may
be caused by erroneous or individual differences of relaxation times as
described by literature. The coefficients of the F1 model function allow for
quantitative comparison of the influences of TE and TI. Limitations arise
mainly from tissues with the low baseline signal (like CSF) and when the
protocol contains contrast-affecting measures that cannot be modelled due to
missing information in the DICOM header.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Deep Learning Based Apparent Diffusion Coefficient Map Generation from Multi-parametric MR Images for Patients with Diffuse Gliomas [1.5267759610392577]
Apparent diffusion coefficient (ADC) maps derived from diffusion weighted (DWI) MRI provide functional measurements about the water molecules in tissues.
This study aims to develop a deep learning framework to synthesize ADC maps from multi-parametric MR images.
arXiv Detail & Related papers (2024-07-02T19:08:40Z) - NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
This paper proposes to directly modulate the generation process of diffusion models using fMRI signals.
By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
arXiv Detail & Related papers (2024-03-27T02:42:52Z) - Decoupled Diffusion Models: Simultaneous Image to Zero and Zero to Noise [53.04220377034574]
We propose decoupled diffusion models (DDMs) for high-quality (un)conditioned image generation in less than 10 function evaluations.
We mathematically derive 1) the training objectives and 2) for the reverse time the sampling formula based on an analytic transition probability which models image to zero transition.
We experimentally yield very competitive performance compared with the state of the art in 1) unconditioned image generation, textite.g., CIFAR-10 and CelebA-HQ-256 and 2) image-conditioned downstream tasks such as super-resolution, saliency detection, edge detection, and image in
arXiv Detail & Related papers (2023-06-23T18:08:00Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Spatial and Modal Optimal Transport for Fast Cross-Modal MRI Reconstruction [54.19448988321891]
We propose an end-to-end deep learning framework that utilizes T1-weighted images (T1WIs) as auxiliary modalities to expedite T2WIs' acquisitions.
We employ Optimal Transport (OT) to synthesize T2WIs by aligning T1WIs and performing cross-modal synthesis.
We prove that the reconstructed T2WIs and the synthetic T2WIs become closer on the T2 image manifold with iterations increasing.
arXiv Detail & Related papers (2023-05-04T12:20:51Z) - High-fidelity Direct Contrast Synthesis from Magnetic Resonance
Fingerprinting [28.702553164811473]
We propose a supervised learning-based method that directly synthesizes contrast-weighted images from the MRF data without going through the quantitative mapping and spin-dynamics simulation.
In-vivo experiments demonstrate excellent image quality compared to simulation-based contrast synthesis and previous DCS methods, both visually as well as by quantitative metrics.
arXiv Detail & Related papers (2022-12-21T07:11:39Z) - Motion correction in MRI using deep learning and a novel hybrid loss
function [11.424624100447332]
Deep learning method (MC-Net) developed to suppress motion artifacts in brain magnetic resonance imaging (MRI)
MC-Net was derived from a UNet combined with a two-stage multi-loss function.
arXiv Detail & Related papers (2022-10-19T14:40:41Z) - Spatiotemporal Feature Learning Based on Two-Step LSTM and Transformer
for CT Scans [2.3682456328966115]
We propose a novel, effective, two-step-wise approach to tickle this issue for COVID-19 symptom classification thoroughly.
First, the semantic feature embedding of each slice for a CT scan is extracted by conventional backbone networks.
Then, we proposed a long short-term memory (LSTM) and Transformer-based sub-network to deal with temporal feature learning.
arXiv Detail & Related papers (2022-07-04T16:59:05Z) - MR-Contrast-Aware Image-to-Image Translations with Generative
Adversarial Networks [5.3580471186206005]
We train an image-to-image generative adversarial network conditioned on the MR acquisition parameters repetition time and echo time.
Our approach yields a peak signal-to-noise ratio and structural similarity of 24.48 and 0.66, surpassing the pix2pix benchmark model significantly.
arXiv Detail & Related papers (2021-04-03T17:05:13Z) - Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR
Images using a GAN [59.60954255038335]
The proposed framework consists of a stretch-out up-sampling module, a brain atlas encoder, a segmentation consistency module, and multi-scale label-wise discriminators.
Experiments on real clinical data demonstrate that the proposed model can perform significantly better than the state-of-the-art synthesis methods.
arXiv Detail & Related papers (2020-06-26T02:50:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.