Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database

• URL: http://arxiv.org/abs/1912.12838v2
• Date: Tue, 7 Apr 2020 11:06:05 GMT
• Title: Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database
• Authors: Tong Zheng, Hirohisa Oda, Takayasu Moriya, Shota Nakamura, Masahiro Oda, Masaki Mori, Horitsugu Takabatake, Hiroshi Natori and Kensaku Mori
• Abstract summary: This paper introduces multi-modality loss function for GAN-based super-resolution. It can maintain image structure and intensity on unpaired training dataset of clinical CT and micro CT volumes.
• Score: 1.5247645805472543
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper newly introduces multi-modality loss function for GAN-based super-resolution that can maintain image structure and intensity on unpaired training dataset of clinical CT and micro CT volumes. Precise non-invasive diagnosis of lung cancer mainly utilizes 3D multidetector computed-tomography (CT) data. On the other hand, we can take micro CT images of resected lung specimen in 50 micro meter or higher resolution. However, micro CT scanning cannot be applied to living human imaging. For obtaining highly detailed information such as cancer invasion area from pre-operative clinical CT volumes of lung cancer patients, super-resolution (SR) of clinical CT volumes to $\mu$CT level might be one of substitutive solutions. While most SR methods require paired low- and high-resolution images for training, it is infeasible to obtain precisely paired clinical CT and micro CT volumes. We aim to propose unpaired SR approaches for clincial CT using micro CT images based on unpaired image translation methods such as CycleGAN or UNIT. Since clinical CT and micro CT are very different in structure and intensity, direct application of GAN-based unpaired image translation methods in super-resolution tends to generate arbitrary images. Aiming to solve this problem, we propose new loss function called multi-modality loss function to maintain the similarity of input images and corresponding output images in super-resolution task. Experimental results demonstrated that the newly proposed loss function made CycleGAN and UNIT to successfully perform SR of clinical CT images of lung cancer patients into micro CT level resolution, while original CycleGAN and UNIT failed in super-resolution.

Related papers

• Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
  Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements. Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements. We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• WIA-LD2ND: Wavelet-based Image Alignment for Self-supervised Low-Dose CT Denoising [74.14134385961775]
  We introduce a novel self-supervised CT image denoising method called WIA-LD2ND, only using NDCT data. WIA-LD2ND comprises two modules: Wavelet-based Image Alignment (WIA) and Frequency-Aware Multi-scale Loss (FAM)
  arXiv  Detail & Related papers  (2024-03-18T11:20:11Z)
• Rotational Augmented Noise2Inverse for Low-dose Computed Tomography Reconstruction [83.73429628413773]
  Supervised deep learning methods have shown the ability to remove noise in images but require accurate ground truth. We propose a novel self-supervised framework for LDCT, in which ground truth is not required for training the convolutional neural network (CNN) Numerical and experimental results show that the reconstruction accuracy of N2I with sparse views is degrading while the proposed rotational augmented Noise2Inverse (RAN2I) method keeps better image quality over a different range of sampling angles.
  arXiv  Detail & Related papers  (2023-12-19T22:40:51Z)
• Feature-oriented Deep Learning Framework for Pulmonary Cone-beam CT (CBCT) Enhancement with Multi-task Customized Perceptual Loss [9.59233136691378]
  Cone-beam computed tomography (CBCT) is routinely collected during image-guided radiation therapy. Recent deep learning-based CBCT enhancement methods have shown promising results in suppressing artifacts. We propose a novel feature-oriented deep learning framework that translates low-quality CBCT images into high-quality CT-like imaging.
  arXiv  Detail & Related papers  (2023-11-01T10:09:01Z)
• Style transfer between Microscopy and Magnetic Resonance Imaging via Generative Adversarial Network in small sample size settings [49.84018914962972]
  Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising. We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
  arXiv  Detail & Related papers  (2023-10-16T13:58:53Z)
• Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model [2.232713445482175]
  Magnetic resonance imaging (MRI)-based synthetic computed tomography (sCT) simplifies radiation therapy treatment planning. We propose an MRI-to-CT transformer-based denoising diffusion probabilistic model (MC-DDPM) to transform MRI into high-quality sCT.
  arXiv  Detail & Related papers  (2023-05-31T00:32:00Z)
• ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep learning [47.68307909984442]
  Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image. Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
  arXiv  Detail & Related papers  (2021-02-25T14:52:23Z)
• Micro CT Image-Assisted Cross Modality Super-Resolution of Clinical CT Images Utilizing Synthesized Training Dataset [1.590436505368218]
  Super-resolution of clinical CT volume may be helpful for diagnosis of lung cancer. We create corresponding clinical CT-$mu$CT pairs by simulating clinical CT images by modified CycleGAN. We use simulated clinical CT-$mu$CT image pairs to train an SR network based on SRGAN.
  arXiv  Detail & Related papers  (2020-10-20T11:40:24Z)
• Synergistic Learning of Lung Lobe Segmentation and Hierarchical Multi-Instance Classification for Automated Severity Assessment of COVID-19 in CT Images [61.862364277007934]
  We propose a synergistic learning framework for automated severity assessment of COVID-19 in 3D CT images. A multi-task deep network (called M$2$UNet) is then developed to assess the severity of COVID-19 patients. Our M$2$UNet consists of a patch-level encoder, a segmentation sub-network for lung lobe segmentation, and a classification sub-network for severity assessment.
  arXiv  Detail & Related papers  (2020-05-08T03:16:15Z)
• Super-resolution of clinical CT volumes with modified CycleGAN using micro CT volumes [1.4695026366952046]
  This paper presents a super-resolution (SR) method with unpaired training dataset of clinical CT and micro CT volumes. We propose a SR approach based on CycleGAN, which could perform SR on clinical CT into $mu$CT level. Experimental results demonstrated that our proposed method successfully performed SR of clinical CT volume of lung cancer patients into $mu$CT level.
  arXiv  Detail & Related papers  (2020-04-07T11:12:24Z)
• STAN-CT: Standardizing CT Image using Generative Adversarial Network [10.660781755744312]
  We present an end-to-end solution called STAN-CT for CT image standardization and normalization. STAN-CT consists of two components: 1) a novel Generative Adversarial Networks (GAN) model that is capable of effectively learning the data distribution of a standard imaging protocol with only a few rounds of generator training, and 2) an automatic DICOM reconstruction pipeline with systematic image quality control.
  arXiv  Detail & Related papers  (2020-04-02T23:43:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.