Continuous Conversion of CT Kernel using Switchable CycleGAN with AdaIN

• URL: http://arxiv.org/abs/2011.13150v2
• Date: Mon, 26 Apr 2021 00:51:33 GMT
• Title: Continuous Conversion of CT Kernel using Switchable CycleGAN with AdaIN
• Authors: Serin Yang, Eung Yeop Kim, and Jong Chul Ye
• Abstract summary: We propose a novel continuous kernel conversion method using cycle-consistent generative adversarial network (cycleGAN) with instance adaptive normalization (AdaIN) We show that our method not only enables accurate kernel conversion that is comparable to supervised learning methods, but also generates intermediate kernel images in the unseen domain that are useful for hypopharyngeal cancer diagnosis.
• Score: 37.56855009521612
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: X-ray computed tomography (CT) uses different filter kernels to highlight different structures. Since the raw sinogram data is usually removed after the reconstruction, in case there are additional need for other types of kernel images that were not previously generated, the patient may need to be scanned again. Accordingly, there exists increasing demand for post-hoc image domain conversion from one kernel to another without sacrificing the image quality. In this paper, we propose a novel unsupervised continuous kernel conversion method using cycle-consistent generative adversarial network (cycleGAN) with adaptive instance normalization (AdaIN). Even without paired training data, not only can our network translate the images between two different kernels, but it can also convert images along the interpolation path between the two kernel domains. We also show that the quality of generated images can be further improved if intermediate kernel domain images are available. Experimental results confirm that our method not only enables accurate kernel conversion that is comparable to supervised learning methods, but also generates intermediate kernel images in the unseen domain that are useful for hypopharyngeal cancer diagnosis.

Related papers

• Inter-vendor harmonization of Computed Tomography (CT) reconstruction kernels using unpaired image translation [7.398825519944107]
  The reconstruction kernel in computed tomography (CT) generation determines the texture of the image. Harmonization (i.e., kernel conversion) minimizes differences in measurements due to inconsistent reconstruction kernels. We use hard and soft reconstruction kernels from the Siemens and GE vendors from the National Lung Screening Trial dataset.
  arXiv  Detail & Related papers  (2023-09-22T15:53:56Z)
• Enhanced Sharp-GAN For Histopathology Image Synthesis [63.845552349914186]
  Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection. We propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization. The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets.
  arXiv  Detail & Related papers  (2023-01-24T17:54:01Z)
• Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays [65.88435151891369]
  Radiomics-Guided Transformer (RGT) fuses textitglobal image information with textitlocal knowledge-guided radiomics information. RGT consists of an image Transformer branch, a radiomics Transformer branch, and fusion layers that aggregate image and radiomic information.
  arXiv  Detail & Related papers  (2022-07-10T06:32:56Z)
• Adaptation to CT Reconstruction Kernels by Enforcing Cross-domain Feature Maps Consistency [0.06117371161379209]
  We show a decrease in the COVID-19 segmentation quality of the model trained on the smooth and tested on the sharp reconstruction kernels. We propose the unsupervised adaptation method, called F-Consistency, that outperforms the previous approaches.
  arXiv  Detail & Related papers  (2022-03-28T10:00:03Z)
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation [56.622832383316215]
  We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our empirical results show that CyTran outperforms all competing methods.
  arXiv  Detail & Related papers  (2021-10-12T23:25:03Z)
• Zero-Shot Domain Adaptation in CT Segmentation by Filtered Back Projection Augmentation [0.1197985185770095]
  Domain shift is one of the most salient challenges in medical computer vision. We address variability in computed tomography (CT) images caused by different convolution kernels used in the reconstruction process. We propose Filtered Back-Projection Augmentation (FBPAug), a simple and surprisingly efficient approach to augment CT images in sinogram space emulating reconstruction with different kernels.
  arXiv  Detail & Related papers  (2021-07-18T21:46:49Z)
• Properties of the After Kernel [11.4219428942199]
  The Neural Tangent Kernel (NTK) is the wide-network limit of a kernel defined using neural networks. We study the "after kernel", which is defined using the same embedding, except after training, for neural networks with standard architectures.
  arXiv  Detail & Related papers  (2021-05-21T21:50:18Z)
• Flow-based Kernel Prior with Application to Blind Super-Resolution [143.21527713002354]
  Kernel estimation is generally one of the key problems for blind image super-resolution (SR) This paper proposes a normalizing flow-based kernel prior (FKP) for kernel modeling. Experiments on synthetic and real-world images demonstrate that the proposed FKP can significantly improve the kernel estimation accuracy.
  arXiv  Detail & Related papers  (2021-03-29T22:37:06Z)
• Blur Invariant Kernel-Adaptive Network for Single Image Blind deblurring [0.886014926770622]
  We present a novel, blind, single image deblurring method that utilizes information regarding blur kernels. We first introduce a kernel estimation network that produces adaptive blur kernels based on the analysis of the blurred image. We propose a deblurring network that restores sharp images using the estimated blur kernel.
  arXiv  Detail & Related papers  (2020-07-09T03:53:33Z)
• Towards a Complete Pipeline for Segmenting Nuclei in Feulgen-Stained Images [52.946144307741974]
  Cervical cancer is the second most common cancer type in women around the world. We present a complete pipeline for the segmentation of nuclei in Feulgen-stained images using Convolutional Neural Networks. We achieved an overall IoU of 0.78, showing the affordability of the approach of nuclei segmentation on Feulgen-stained images.
  arXiv  Detail & Related papers  (2020-02-19T18:14:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.