Reverse Engineering Breast MRIs: Predicting Acquisition Parameters Directly from Images

• URL: http://arxiv.org/abs/2303.04911v1
• Date: Wed, 8 Mar 2023 22:02:15 GMT
• Title: Reverse Engineering Breast MRIs: Predicting Acquisition Parameters Directly from Images
• Authors: Nicholas Konz, Maciej A. Mazurowski
• Abstract summary: We introduce a neural network model that can predict many complex IAPs used to generate an MR image with high accuracy solely using the image. Even challenging parameters such as contrast agent type can be predicted with good accuracy.
• Score: 1.256413718364189
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The image acquisition parameters (IAPs) used to create MRI scans are central to defining the appearance of the images. Deep learning models trained on data acquired using certain parameters might not generalize well to images acquired with different parameters. Being able to recover such parameters directly from an image could help determine whether a deep learning model is applicable, and could assist with data harmonization and/or domain adaptation. Here, we introduce a neural network model that can predict many complex IAPs used to generate an MR image with high accuracy solely using the image, with a single forward pass. These predicted parameters include field strength, echo and repetition times, acquisition matrix, scanner model, scan options, and others. Even challenging parameters such as contrast agent type can be predicted with good accuracy. We perform a variety of experiments and analyses of our model's ability to predict IAPs on many MRI scans of new patients, and demonstrate its usage in a realistic application. Predicting IAPs from the images is an important step toward better understanding the relationship between image appearance and IAPs. This in turn will advance the understanding of many concepts related to the generalizability of neural network models on medical images, including domain shift, domain adaptation, and data harmonization.

Related papers

• MRI Parameter Mapping via Gaussian Mixture VAE: Breaking the Assumption of Independent Pixels [3.720246718519987]
  We introduce and demonstrate a new paradigm for quantitative parameter mapping in MRI. We propose a self-supervised deep variational approach that breaks the assumption of independent pixels. Our approach can hence support the clinical adoption of parameter mapping methods such as dMRI and qMRI.
  arXiv  Detail & Related papers  (2024-11-16T11:11:36Z)
• Counterfactual MRI Data Augmentation using Conditional Denoising Diffusion Generative Models [0.0]
  Deep learning models in medical imaging face challenges in generalizability and robustness due to variations in image acquisition parameters (IAP) We introduce a novel method using conditional denoising diffusion generative models (cDDGMs) to generate counterfactual magnetic resonance (MR) images that simulate different IAP without altering patient anatomy.
  arXiv  Detail & Related papers  (2024-10-31T11:29:41Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Translating Imaging to Genomics: Leveraging Transformers for Predictive Modeling [9.403446155541346]
  We aim to bridge the gap between imaging and genomics data by leveraging transformer networks. We propose using only available CT/MRI images to predict genomic sequences.
  arXiv  Detail & Related papers  (2024-08-01T06:14:37Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• Deep Learning-Based MR Image Re-parameterization [0.0]
  We propose a novel deep learning (DL) based convolutional model for MRI re- parameterization. Based on our preliminary results, DL-based techniques hold the potential to learn the non-linearities that govern the re- parameterization.
  arXiv  Detail & Related papers  (2022-06-11T12:39:37Z)
• Adversarial Parametric Pose Prior [106.12437086990853]
  We learn a prior that restricts the SMPL parameters to values that produce realistic poses via adversarial training. We show that our learned prior covers the diversity of the real-data distribution, facilitates optimization for 3D reconstruction from 2D keypoints, and yields better pose estimates when used for regression from images.
  arXiv  Detail & Related papers  (2021-12-08T10:05:32Z)
• Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks [5.3580471186206005]
  We trained a generative adversarial network (GAN) to generate synthetic MR knee images conditioned on various acquisition parameters. In a Turing test, two experts mislabeled 40.5% of real and synthetic MR images, demonstrating that the image quality of the generated synthetic and real MR images is comparable.
  arXiv  Detail & Related papers  (2021-02-17T11:39:36Z)
• Deep Co-Attention Network for Multi-View Subspace Learning [73.3450258002607]
  We propose a deep co-attention network for multi-view subspace learning. It aims to extract both the common information and the complementary information in an adversarial setting. In particular, it uses a novel cross reconstruction loss and leverages the label information to guide the construction of the latent representation.
  arXiv  Detail & Related papers  (2021-02-15T18:46:44Z)
• Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
  Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
  arXiv  Detail & Related papers  (2020-06-11T17:29:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.