MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction

• URL: http://arxiv.org/abs/2505.04105v3
• Date: Fri, 09 May 2025 03:03:12 GMT
• Title: MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction
• Authors: Andrew Zhang, Hao Wang, Shuchang Ye, Michael Fulham, Jinman Kim,
• Abstract summary: We propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction.<n> Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts.
• Score: 11.150364980770675
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Patient motion during medical image acquisition causes blurring, ghosting, and distorts organs, which makes image interpretation challenging. Current state-of-the-art algorithms using Generative Adversarial Network (GAN)-based methods with their ability to learn the mappings between corrupted images and their ground truth via Structural Similarity Index Measure (SSIM) loss effectively generate motion-free images. However, we identified the following limitations: (i) they mainly focus on global structural characteristics and therefore overlook localized features that often carry critical pathological information, and (ii) the SSIM loss function struggles to handle images with varying pixel intensities, luminance factors, and variance. In this study, we propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction by: (a) leveraging the foundation model Segment Anything Model (SAM), to dynamically learn spatial patterns along anatomical boundaries where motion artifacts are most pronounced and, (b) introducing the Variance-Selective SSIM (VS-SSIM) loss which adaptively emphasizes spatial regions with high pixel variance to preserve essential anatomical details during artifact correction. Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts, with Peak Signal-to-Noise Ratio (PSNR) increasing by 40%, SSIM by 10%, and Dice by 16%.

Related papers

• DIMA: DIffusing Motion Artifacts for unsupervised correction in brain MRI images [4.117232425638352]
  DIMA (DIffusing Motion Artifacts) is a novel framework that leverages diffusion models to enable unsupervised motion artifact correction in brain MRI.<n>Our two-phase approach first trains a diffusion model on unpaired motion-affected images to learn the distribution of motion artifacts.<n>This model then generates realistic motion artifacts on clean images, creating paired datasets suitable for supervised training of correction networks.
  arXiv  Detail & Related papers  (2025-04-09T10:43:38Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.<n>Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Advancing Medical Image Segmentation: Morphology-Driven Learning with Diffusion Transformer [4.672688418357066]
  We propose a novel Transformer Diffusion (DTS) model for robust segmentation in the presence of noise. Our model, which analyzes the morphological representation of images, shows better results than the previous models in various medical imaging modalities.
  arXiv  Detail & Related papers  (2024-08-01T07:35:54Z)
• On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
  Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input. DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases. We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
  arXiv  Detail & Related papers  (2023-06-23T03:09:03Z)
• Realistic Restorer: artifact-free flow restorer(AF2R) for MRI motion artifact removal [3.8103327351507255]
  Motion artifact severely degrades image quality, reduces examination efficiency, and makes accurate diagnosis difficult. Previous methods often relied on implicit models for artifact correction, resulting in biases in modeling the artifact formation mechanism. We incorporate the artifact generation mechanism to reestablish the relationship between artifacts and anatomical content in the image domain.
  arXiv  Detail & Related papers  (2023-06-19T04:02:01Z)
• Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images [54.739076152240024]
  Motion artefacts in magnetic resonance brain images are a crucial issue. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
  arXiv  Detail & Related papers  (2022-06-14T10:16:54Z)
• Negligible effect of brain MRI data preprocessing for tumor segmentation [36.89606202543839]
  We conduct experiments on three publicly available datasets and evaluate the effect of different preprocessing steps in deep neural networks. Our results demonstrate that most popular standardization steps add no value to the network performance. We suggest that image intensity normalization approaches do not contribute to model accuracy because of the reduction of signal variance with image standardization.
  arXiv  Detail & Related papers  (2022-04-11T17:29:36Z)
• Data Augmentation For Medical MR Image Using Generative Adversarial Networks [10.525550396457586]
  This work improves Progressive Growing of GANs with a structural similarity loss function (PGGAN-SSIM) to solve image blurriness problems and model collapse. Our results show that PGGAN-SSIM successfully generates 256x256 realistic brain tumor MR images which fill the real image distribution uncovered by the original dataset.
  arXiv  Detail & Related papers  (2021-11-29T01:59:50Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Segmentation-Renormalized Deep Feature Modulation for Unpaired Image Harmonization [0.43012765978447565]
  Cycle-consistent Generative Adversarial Networks have been used to harmonize image sets between a source and target domain. These methods are prone to instability, contrast inversion, intractable manipulation of pathology, and steganographic mappings which limit their reliable adoption in real-world medical imaging. We propose a segmentation-renormalized image translation framework to reduce inter-scanner harmonization while preserving anatomical layout.
  arXiv  Detail & Related papers  (2021-02-11T23:53:51Z)
• Limited-angle tomographic reconstruction of dense layered objects by dynamical machine learning [68.9515120904028]
  Limited-angle tomography of strongly scattering quasi-transparent objects is a challenging, highly ill-posed problem. Regularizing priors are necessary to reduce artifacts by improving the condition of such problems. We devised a recurrent neural network (RNN) architecture with a novel split-convolutional gated recurrent unit (SC-GRU) as the building block.
  arXiv  Detail & Related papers  (2020-07-21T11:48:22Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.