A Generic Fundus Image Enhancement Network Boosted by Frequency Self-supervised Representation Learning

• URL: http://arxiv.org/abs/2309.00885v1
• Date: Sat, 2 Sep 2023 09:51:30 GMT
• Title: A Generic Fundus Image Enhancement Network Boosted by Frequency Self-supervised Representation Learning
• Authors: Heng Li, Haofeng Liu, Huazhu Fu, Yanwu Xu, Hui Shu, Ke Niu, Yan Hu, Jiang Liu
• Abstract summary: Fundus image enhancement network (GFE-Net) is developed to robustly correct unknown fundus images without supervised or extra data. GFE-Net achieves superior performance in data dependency, enhancement performance, deployment efficiency, and scale generalizability.
• Score: 34.47229102825849
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fundus photography is prone to suffer from image quality degradation that impacts clinical examination performed by ophthalmologists or intelligent systems. Though enhancement algorithms have been developed to promote fundus observation on degraded images, high data demands and limited applicability hinder their clinical deployment. To circumvent this bottleneck, a generic fundus image enhancement network (GFE-Net) is developed in this study to robustly correct unknown fundus images without supervised or extra data. Levering image frequency information, self-supervised representation learning is conducted to learn robust structure-aware representations from degraded images. Then with a seamless architecture that couples representation learning and image enhancement, GFE-Net can accurately correct fundus images and meanwhile preserve retinal structures. Comprehensive experiments are implemented to demonstrate the effectiveness and advantages of GFE-Net. Compared with state-of-the-art algorithms, GFE-Net achieves superior performance in data dependency, enhancement performance, deployment efficiency, and scale generalizability. Follow-up fundus image analysis is also facilitated by GFE-Net, whose modules are respectively verified to be effective for image enhancement.

Related papers

• FGR-Net:Interpretable fundus imagegradeability classification based on deepreconstruction learning [4.377496499420086]
  This paper presents a novel framework called FGR-Net to automatically assess and interpret underlying fundus image quality. The FGR-Net model also provides an interpretable quality assessment through visualizations. The experimental results showed the superiority of FGR-Net over the state-of-the-art quality assessment methods, with an accuracy of 89% and an F1-score of 87%.
  arXiv  Detail & Related papers  (2024-09-16T12:56:23Z)
• Ultrasound Image Enhancement using CycleGAN and Perceptual Loss [4.428854369140015]
  This work introduces an advanced framework designed to enhance ultrasound images, especially those captured by portable hand-held devices. We utilize an enhanced generative adversarial network (CycleGAN) model for ultrasound image enhancement across five organ systems.
  arXiv  Detail & Related papers  (2023-12-18T23:21:00Z)
• Bridging Synthetic and Real Images: a Transferable and Multiple Consistency aided Fundus Image Enhancement Framework [61.74188977009786]
  We propose an end-to-end optimized teacher-student framework to simultaneously conduct image enhancement and domain adaptation. We also propose a novel multi-stage multi-attention guided enhancement network (MAGE-Net) as the backbones of our teacher and student network.
  arXiv  Detail & Related papers  (2023-02-23T06:16:15Z)
• JPEG Steganalysis Based on Steganographic Feature Enhancement and Graph Attention Learning [15.652077779677091]
  We introduce a novel representation learning algorithm for JPEG steganalysis. The graph attention learning module is designed to avoid global feature loss caused by the local feature learning of convolutional neural network. The feature enhancement module is applied to prevent the stacking of convolutional layers from weakening the steganographic information.
  arXiv  Detail & Related papers  (2023-02-05T01:42:19Z)
• Deep Semantic Statistics Matching (D2SM) Denoising Network [70.01091467628068]
  We introduce the Deep Semantic Statistics Matching (D2SM) Denoising Network. It exploits semantic features of pretrained classification networks, then it implicitly matches the probabilistic distribution of clear images at the semantic feature space. By learning to preserve the semantic distribution of denoised images, we empirically find our method significantly improves the denoising capabilities of networks.
  arXiv  Detail & Related papers  (2022-07-19T14:35:42Z)
• Towards Unsupervised Deep Image Enhancement with Generative Adversarial Network [92.01145655155374]
  We present an unsupervised image enhancement generative network (UEGAN) It learns the corresponding image-to-image mapping from a set of images with desired characteristics in an unsupervised manner. Results show that the proposed model effectively improves the aesthetic quality of images.
  arXiv  Detail & Related papers  (2020-12-30T03:22:46Z)
• Leveraging Regular Fundus Images for Training UWF Fundus Diagnosis Models via Adversarial Learning and Pseudo-Labeling [29.009663623719064]
  Ultra-widefield (UWF) 200degreefundus imaging by Optos cameras has gradually been introduced. Regular fundus images contain a large amount of high-quality and well-annotated data. Due to the domain gap, models trained by regular fundus images to recognize UWF fundus images perform poorly. We propose the use of a modified cycle generative adversarial network (CycleGAN) model to bridge the gap between regular and UWF fundus.
  arXiv  Detail & Related papers  (2020-11-27T16:25:30Z)
• Image Augmentations for GAN Training [57.65145659417266]
  We provide insights and guidelines on how to augment images for both vanilla GANs and GANs with regularizations. Surprisingly, we find that vanilla GANs attain generation quality on par with recent state-of-the-art results.
  arXiv  Detail & Related papers  (2020-06-04T00:16:02Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.