Reference-based OCT Angiogram Super-resolution with Learnable Texture
Generation
- URL: http://arxiv.org/abs/2305.05835v1
- Date: Wed, 10 May 2023 01:48:01 GMT
- Title: Reference-based OCT Angiogram Super-resolution with Learnable Texture
Generation
- Authors: Yuyan Ruan, Dawei Yang, Ziqi Tang, An Ran Ran, Carol Y. Cheung and Hao
Chen
- Abstract summary: We propose a reference-based super-resolution (RefSR) framework to preserve the resolution of the OCT angiograms while increasing the scanning area.
Textures from the normal RefSR pipeline are used to train a learnable texture generator (LTG), which is designed to generate textures according to the input.
LTGNet has superior performance and robustness over state-of-the-art methods, indicating good reliability and promise in real-life deployment.
- Score: 11.58649188893076
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Optical coherence tomography angiography (OCTA) is a new imaging modality to
visualize retinal microvasculature and has been readily adopted in clinics.
High-resolution OCT angiograms are important to qualitatively and
quantitatively identify potential biomarkers for different retinal diseases
accurately. However, one significant problem of OCTA is the inevitable decrease
in resolution when increasing the field-of-view given a fixed acquisition time.
To address this issue, we propose a novel reference-based super-resolution
(RefSR) framework to preserve the resolution of the OCT angiograms while
increasing the scanning area. Specifically, textures from the normal RefSR
pipeline are used to train a learnable texture generator (LTG), which is
designed to generate textures according to the input. The key difference
between the proposed method and traditional RefSR models is that the textures
used during inference are generated by the LTG instead of being searched from a
single reference image. Since the LTG is optimized throughout the whole
training process, the available texture space is significantly enlarged and no
longer limited to a single reference image, but extends to all textures
contained in the training samples. Moreover, our proposed LTGNet does not
require a reference image at the inference phase, thereby becoming invulnerable
to the selection of the reference image. Both experimental and visual results
show that LTGNet has superior performance and robustness over state-of-the-art
methods, indicating good reliability and promise in real-life deployment. The
source code will be made available upon acceptance.
Related papers
- Unpaired Optical Coherence Tomography Angiography Image Super-Resolution
via Frequency-Aware Inverse-Consistency GAN [6.717440708401628]
We propose a Generative Adversarial Network (GAN)-based unpaired super-resolution method for OCTA images.
To facilitate a precise spectrum of the reconstructed image, we also propose a frequency-aware adversarial loss for the discriminator.
Experiments show that our method outperforms other state-of-the-art unpaired methods both quantitatively and visually.
arXiv Detail & Related papers (2023-09-29T14:19:51Z) - Synthetic optical coherence tomography angiographs for detailed retinal
vessel segmentation without human annotations [12.571349114534597]
We present a lightweight simulation of the retinal vascular network based on space colonization for faster and more realistic OCTA synthesis.
We demonstrate the superior segmentation performance of our approach in extensive quantitative and qualitative experiments on three public datasets.
arXiv Detail & Related papers (2023-06-19T14:01:47Z) - Cross-modulated Few-shot Image Generation for Colorectal Tissue
Classification [58.147396879490124]
Our few-shot generation method, named XM-GAN, takes one base and a pair of reference tissue images as input and generates high-quality yet diverse images.
To the best of our knowledge, we are the first to investigate few-shot generation in colorectal tissue images.
arXiv Detail & Related papers (2023-04-04T17:50:30Z) - Enhanced Sharp-GAN For Histopathology Image Synthesis [63.845552349914186]
Histopathology image synthesis aims to address the data shortage issue in training deep learning approaches for accurate cancer detection.
We propose a novel approach that enhances the quality of synthetic images by using nuclei topology and contour regularization.
The proposed approach outperforms Sharp-GAN in all four image quality metrics on two datasets.
arXiv Detail & Related papers (2023-01-24T17:54:01Z) - Reliable Joint Segmentation of Retinal Edema Lesions in OCT Images [55.83984261827332]
In this paper, we propose a novel reliable multi-scale wavelet-enhanced transformer network.
We develop a novel segmentation backbone that integrates a wavelet-enhanced feature extractor network and a multi-scale transformer module.
Our proposed method achieves better segmentation accuracy with a high degree of reliability as compared to other state-of-the-art segmentation approaches.
arXiv Detail & Related papers (2022-12-01T07:32:56Z) - Fine-tuned Generative Adversarial Network-based Model for Medical Image Super-Resolution [2.647302105102753]
Real-Enhanced Super-Resolution Generative Adversarial Network (Real-ESRGAN) is a practical model for recovering HR images from real-world LR images.
We employ the high-order degradation model of the Real-ESRGAN which better simulates real-world image degradations.
The proposed model achieves superior perceptual quality compared to the Real-ESRGAN model, effectively preserving fine details and generating images with more realistic textures.
arXiv Detail & Related papers (2022-11-01T16:48:04Z) - Retinal Image Restoration and Vessel Segmentation using Modified
Cycle-CBAM and CBAM-UNet [0.7868449549351486]
A cycle-consistent generative adversarial network (CycleGAN) with a convolution block attention module (CBAM) is used for retinal image restoration.
A modified UNet is used for retinal vessel segmentation for the restored retinal images.
The proposed method can significantly reduce the degradation effects caused by out-of-focus blurring, color distortion, low, high, and uneven illumination.
arXiv Detail & Related papers (2022-09-09T10:47:20Z) - REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT
Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images.
To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
arXiv Detail & Related papers (2022-08-17T03:42:19Z) - GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical
coherence tomography Scans [13.016298207860974]
We propose a Generative Adversarial Network (GAN)-based solution for super-resolution and segmentation of OCT scans of the retinal layers.
GAN-based segmentation model and evaluate incorporating popular networks, namely, U-Net and ResNet, in the GAN architecture.
Our best model configuration empirically achieved the Dice coefficient of 0.867 and mIOU of 0.765.
arXiv Detail & Related papers (2022-06-28T03:53:40Z) - Hierarchical Similarity Learning for Aliasing Suppression Image
Super-Resolution [64.15915577164894]
A hierarchical image super-resolution network (HSRNet) is proposed to suppress the influence of aliasing.
HSRNet achieves better quantitative and visual performance than other works, and remits the aliasing more effectively.
arXiv Detail & Related papers (2022-06-07T14:55:32Z) - Harmonizing Pathological and Normal Pixels for Pseudo-healthy Synthesis [68.5287824124996]
We present a new type of discriminator, the segmentor, to accurately locate the lesions and improve the visual quality of pseudo-healthy images.
We apply the generated images into medical image enhancement and utilize the enhanced results to cope with the low contrast problem.
Comprehensive experiments on the T2 modality of BraTS demonstrate that the proposed method substantially outperforms the state-of-the-art methods.
arXiv Detail & Related papers (2022-03-29T08:41:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.