TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction

• URL: http://arxiv.org/abs/2402.09567v1
• Date: Wed, 14 Feb 2024 20:39:07 GMT
• Title: TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction
• Authors: Xueqi Guo, Luyao Shi, Xiongchao Chen, Qiong Liu, Bo Zhou, Huidong Xie, Yi-Hwa Liu, Richard Palyo, Edward J. Miller, Albert J. Sinusas, Lawrence H. Staib, Bruce Spottiswoode, Chi Liu, Nicha C. Dvornek
• Abstract summary: We propose a novel method called Temporally and Anatomically Informed Generative Adrial Network (TAI-GAN) to convert early frames into those with tracer distribution similar to the last reference frame. Our proposed method was evaluated on a clinical 82-Rb PET dataset, and the results show that our TAI-GAN can produce converted early frames with high image quality, comparable to the real reference frames.
• Score: 15.380659401728735
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Inter-frame motion in dynamic cardiac positron emission tomography (PET) using rubidium-82 (82-Rb) myocardial perfusion imaging impacts myocardial blood flow (MBF) quantification and the diagnosis accuracy of coronary artery diseases. However, the high cross-frame distribution variation due to rapid tracer kinetics poses a considerable challenge for inter-frame motion correction, especially for early frames where intensity-based image registration techniques often fail. To address this issue, we propose a novel method called Temporally and Anatomically Informed Generative Adversarial Network (TAI-GAN) that utilizes an all-to-one mapping to convert early frames into those with tracer distribution similar to the last reference frame. The TAI-GAN consists of a feature-wise linear modulation layer that encodes channel-wise parameters generated from temporal information and rough cardiac segmentation masks with local shifts that serve as anatomical information. Our proposed method was evaluated on a clinical 82-Rb PET dataset, and the results show that our TAI-GAN can produce converted early frames with high image quality, comparable to the real reference frames. After TAI-GAN conversion, the motion estimation accuracy and subsequent myocardial blood flow (MBF) quantification with both conventional and deep learning-based motion correction methods were improved compared to using the original frames.

Related papers

• Beyond the Eye: A Relational Model for Early Dementia Detection Using Retinal OCTA Images [42.75763279888966]
  We present a novel PolarNet+ that uses retinal optical coherence tomography angiography ( OCTA) to discriminate early-onset Alzheimer's disease (AD) and mild cognitive impairment (MCI) subjects from controls. Our method first maps OCTA images from Cartesian coordinates to polar coordinates, allowing approximate sub-region calculation. We then introduce a multi-view module to serialize and analyze the images along three dimensions for comprehensive, clinically useful information extraction.
  arXiv  Detail & Related papers  (2024-08-09T15:10:34Z)
• LaMoD: Latent Motion Diffusion Model For Myocardial Strain Generation [5.377722774297911]
  We introduce a novel Latent Motion Diffusion model (LaMoD) to predict highly accurate DENSE motions from standard CMR videos. Experimental results demonstrate that our proposed method, LaMoD, significantly improves the accuracy of motion analysis in standard CMR images.
  arXiv  Detail & Related papers  (2024-07-02T12:54:32Z)
• Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registration [50.602074919305636]
  This paper introduces a lightweight end-to-end Cardiac Ultrasound frame-to-volume Registration network, termed CU-Reg. We use epicardium prompt-guided anatomical clues to reinforce the interaction of 2D sparse and 3D dense features, followed by a voxel-wise local-global aggregation of enhanced features.
  arXiv  Detail & Related papers  (2024-06-20T17:47:30Z)
• Attention-aware non-rigid image registration for accelerated MR imaging [10.47044784972188]
  We introduce an attention-aware deep learning-based framework that can perform non-rigid pairwise registration for fully sampled and accelerated MRI. We extract local visual representations to build similarity maps between the registered image pairs at multiple resolution levels. We demonstrate that our model derives reliable and consistent motion fields across different sampling trajectories.
  arXiv  Detail & Related papers  (2024-04-26T14:25:07Z)
• A gradient-based approach to fast and accurate head motion compensation in cone-beam CT [35.44857854720086]
  This paper introduces a novel approach to CBCT motion estimation using a gradient-based optimization algorithm. We drastically accelerate motion estimation yielding a 19-fold speed-up compared to existing methods. It achieves a reduction in reprojection error from an initial average of 3mm to 0.61mm after motion compensation.
  arXiv  Detail & Related papers  (2024-01-17T15:37:00Z)
• AngioMoCo: Learning-based Motion Correction in Cerebral Digital Subtraction Angiography [1.8537989329832776]
  Cerebral X-ray digital subtraction angiography (DSA) is the standard imaging technique for visualizing blood flow and guiding endovascular treatments. The quality of DSA is often negatively impacted by body motion during acquisition, leading to decreased diagnostic value. We present AngioMoCo, a learning-based framework that generates motion-compensated DSA sequences from X-ray angiography.
  arXiv  Detail & Related papers  (2023-10-09T06:42:43Z)
• TAI-GAN: Temporally and Anatomically Informed GAN for early-to-late frame conversion in dynamic cardiac PET motion correction [14.611502926407669]
  The rapid tracer kinetics of rubidium-82 ($82$Rb) raise significant challenges for inter-frame motion correction. We propose a Temporally and Anatomically Informed Generative Adversarial Network (TAI-GAN) to transform the early frames into the late reference frame. We validated our proposed method on a clinical $82$Rb PET dataset and found that our TAI-GAN can produce converted early frames with high image quality.
  arXiv  Detail & Related papers  (2023-08-23T21:51:24Z)
• fRegGAN with K-space Loss Regularization for Medical Image Translation [42.253647362909476]
  Generative adversarial networks (GANs) have shown remarkable success in generating realistic images. GANs tend to suffer from a frequency bias towards low frequencies, which can lead to the removal of important structures in the generated images. We propose a novel frequency-aware image-to-image translation framework based on the supervised RegGAN approach, which we call fRegGAN.
  arXiv  Detail & Related papers  (2023-03-28T12:49:10Z)
• Site Generalization: Stroke Lesion Segmentation on Magnetic Resonance Images from Unseen Sites [40.32385363670918]
  Strokes are the main cause of various cerebrovascular diseases. Deep learning-based models have been proposed for this task, but generalizing these models to unseen sites is difficult. We propose a U-net--based segmentation network termed SG-Net to improve unseen site generalization for stroke lesion segmentation on MR images.
  arXiv  Detail & Related papers  (2022-05-09T14:33:06Z)
• Preservation of High Frequency Content for Deep Learning-Based Medical Image Classification [74.84221280249876]
  An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information.
  arXiv  Detail & Related papers  (2022-05-08T15:29:54Z)
• A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced Cardiac Magnetic Resonance Imaging [90.29017019187282]
  " 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset. Analyse of the submitted algorithms using technical and biological metrics was performed. Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
  arXiv  Detail & Related papers  (2020-04-26T08:49:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.