Synthetic PET via Domain Translation of 3D MRI

• URL: http://arxiv.org/abs/2206.05618v1
• Date: Sat, 11 Jun 2022 21:32:40 GMT
• Title: Synthetic PET via Domain Translation of 3D MRI
• Authors: Abhejit Rajagopal, Yutaka Natsuaki, Kristen Wangerin, Mahdjoub Hamdi, Hongyu An, John J. Sunderland, Richard Laforest, Paul E. Kinahan, Peder E.Z. Larson, Thomas A.Hope
• Abstract summary: We use a dataset of 56 $18$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. The predicted PET images are forward projected to produce synthetic PET time-of-flight sinograms that can be used with vendor-provided PET reconstruction algorithms.
• Score: 1.0052333944678682
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we demonstrate a deep learning technique to generate synthetic but realistic whole-body PET sinograms from abundantly-available whole-body MRI. Specifically, we use a dataset of 56 $^{18}$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. In training we implemented a balanced loss function to generate realistic uptake across a large dynamic range and computed losses along tomographic lines of response to mimic the PET acquisition. The predicted PET images are forward projected to produce synthetic PET time-of-flight (ToF) sinograms that can be used with vendor-provided PET reconstruction algorithms, including using CT-based attenuation correction (CTAC) and MR-based attenuation correction (MRAC). The resulting synthetic data recapitulates physiologic $^{18}$F-FDG uptake, e.g. high uptake localized to the brain and bladder, as well as uptake in liver, kidneys, heart and muscle. To simulate abnormalities with high uptake, we also insert synthetic lesions. We demonstrate that this synthetic PET data can be used interchangeably with real PET data for the PET quantification task of comparing CT and MR-based attenuation correction methods, achieving $\leq 7.6\%$ error in mean-SUV compared to using real data. These results together show that the proposed synthetic PET data pipeline can be reasonably used for development, evaluation, and validation of PET/MRI reconstruction methods.

Related papers

• PASTA: Pathology-Aware MRI to PET Cross-Modal Translation with Diffusion Models [7.6672160690646445]
  We introduce PASTA, a novel pathology-aware image translation framework based on conditional diffusion models. A cycle exchange consistency and volumetric generation strategy elevate PASTA's capability to produce high-quality 3D PET scans. For Alzheimer's classification, the performance of synthesized scans improves over MRI by 4%, almost reaching the performance of actual PET.
  arXiv  Detail & Related papers  (2024-05-27T08:33:24Z)
• Functional Imaging Constrained Diffusion for Brain PET Synthesis from Structural MRI [5.190302448685122]
  We propose a framework for 3D brain PET image synthesis with paired structural MRI as input condition, through a new constrained diffusion model (CDM) The FICD introduces noise to PET and then progressively removes it with CDM, ensuring high output fidelity throughout a stable training phase. The CDM learns to predict denoised PET with a functional imaging constraint introduced to ensure voxel-wise alignment between each denoised PET and its ground truth.
  arXiv  Detail & Related papers  (2024-05-03T22:33:46Z)
• Three-Dimensional Amyloid-Beta PET Synthesis from Structural MRI with Conditional Generative Adversarial Networks [45.426889188365685]
  Alzheimer's Disease hallmarks include amyloid-beta deposits and brain atrophy. PET is expensive, invasive and exposes patients to ionizing radiation. MRI is cheaper, non-invasive, and free from ionizing radiation but limited to measuring brain atrophy.
  arXiv  Detail & Related papers  (2024-05-03T14:10:29Z)
• Two-Phase Multi-Dose-Level PET Image Reconstruction with Dose Level Awareness [43.45142393436787]
  We design a novel two-phase multi-dose-level PET reconstruction algorithm with dose level awareness. The pre-training phase is devised to explore both fine-grained discriminative features and effective semantic representation. The SPET prediction phase adopts a coarse prediction network utilizing pre-learned dose level prior to generate preliminary result.
  arXiv  Detail & Related papers  (2024-04-02T01:57:08Z)
• Revolutionizing Disease Diagnosis with simultaneous functional PET/MR and Deeply Integrated Brain Metabolic, Hemodynamic, and Perfusion Networks [40.986069119392944]
  We propose MX-ARM, a multimodal MiXture-of-experts Alignment Reconstruction and Model. It is modality detachable and exchangeable, allocating different multi-layer perceptrons dynamically ("mixture of experts") through learnable weights to learn respective representations from different modalities.
  arXiv  Detail & Related papers  (2024-03-29T08:47:49Z)
• Contrastive Diffusion Model with Auxiliary Guidance for Coarse-to-Fine PET Reconstruction [62.29541106695824]
  This paper presents a coarse-to-fine PET reconstruction framework that consists of a coarse prediction module (CPM) and an iterative refinement module (IRM) By delegating most of the computational overhead to the CPM, the overall sampling speed of our method can be significantly improved. Two additional strategies, i.e., an auxiliary guidance strategy and a contrastive diffusion strategy, are proposed and integrated into the reconstruction process.
  arXiv  Detail & Related papers  (2023-08-20T04:10:36Z)
• TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms [45.24575167909925]
  TriDoFormer is a transformer-based model that unites triple domains of sinogram, image, and frequency for direct reconstruction. It outperforms state-of-the-art methods qualitatively and quantitatively. GFP serves as a learnable frequency filter that adjusts the frequency components in the frequency domain, enforcing the network to restore high-frequency details.
  arXiv  Detail & Related papers  (2023-08-10T06:20:00Z)
• Brain MRI-to-PET Synthesis using 3D Convolutional Attention Networks [10.095428964324874]
  Positron emission tomography (PET) with radiolabeled water (15O-water) is considered the gold-standard for the measurement of cerebral blood flow (CBF) in humans. PET imaging is not widely available because of its prohibitive costs and use of short-lived radiopharmaceutical tracers that typically require onsite cyclotron production. This study presents a convolutional encoder-decoder network with attention mechanisms to predict gold-standard 15O-water PET CBF from multi-sequence MRI scans.
  arXiv  Detail & Related papers  (2022-11-22T08:25:44Z)
• Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine [72.85011943179894]
  We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration. We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI. Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
  arXiv  Detail & Related papers  (2022-05-16T10:59:55Z)
• A resource-efficient deep learning framework for low-dose brain PET image reconstruction and analysis [13.713286047709982]
  We propose a resource-efficient deep learning framework for L-PET reconstruction and analysis, referred to as transGAN-SDAM. The transGAN generates higher quality F-PET images, and then the SDAM integrates the spatial information of a sequence of generated F-PET slices to synthesize whole-brain F-PET images.
  arXiv  Detail & Related papers  (2022-02-14T08:40:19Z)
• Synthesizing Multi-Tracer PET Images for Alzheimer's Disease Patients using a 3D Unified Anatomy-aware Cyclic Adversarial Network [9.406405460188818]
  Positron Emission Tomography (PET) is an important tool for studying Alzheimer's disease (AD) Previous works on medical image synthesis focus on one-to-one fixed domain translations, and cannot simultaneously learn the feature from multi-tracer domains. We propose a 3D unified anatomy-aware cyclic adversarial network (UCAN) for translating multi-tracer PET volumes with one unified generative model.
  arXiv  Detail & Related papers  (2021-07-12T15:10:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.