Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images

• URL: http://arxiv.org/abs/2411.12278v1
• Date: Tue, 19 Nov 2024 06:57:16 GMT
• Title: Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images
• Authors: Zheng Gong, Zhuo Deng, Weihao Gao, Wenda Zhou, Yuhang Yang, Hanqing Zhao, Zhiyuan Niu, Lei Shao, Wenbin Wei, Lan Ma,
• Abstract summary: This paper establishes a new cataract image restoration method named Catintell. It contains a cataract image synthesizing model, Catintell-Syn, and a restoration model, Catintell-Res. Catintell-Syn uses GAN architecture with fully unsupervised data to generate paired cataract-like images with realistic style and texture. Catintell-Res is an image restoration network that can improve the quality of real cataract fundus images.
• Score: 16.340553839208035
• License:
• Abstract: Cataract is one of the most common blinding eye diseases and can be treated by surgery. However, because cataract patients may also suffer from other blinding eye diseases, ophthalmologists must diagnose them before surgery. The cloudy lens of cataract patients forms a hazy degeneration in the fundus images, making it challenging to observe the patient's fundus vessels, which brings difficulties to the diagnosis process. To address this issue, this paper establishes a new cataract image restoration method named Catintell. It contains a cataract image synthesizing model, Catintell-Syn, and a restoration model, Catintell-Res. Catintell-Syn uses GAN architecture with fully unsupervised data to generate paired cataract-like images with realistic style and texture rather than the conventional Gaussian degradation algorithm. Meanwhile, Catintell-Res is an image restoration network that can improve the quality of real cataract fundus images using the knowledge learned from synthetic cataract images. Extensive experiments show that Catintell-Res outperforms other cataract image restoration methods in PSNR with 39.03 and SSIM with 0.9476. Furthermore, the universal restoration ability that Catintell-Res gained from unpaired cataract images can process cataract images from various datasets. We hope the models can help ophthalmologists identify other blinding eye diseases of cataract patients and inspire more medical image restoration methods in the future.

Related papers

• Step-Calibrated Diffusion for Biomedical Optical Image Restoration [47.191704042917394]
  Restorative Step-Calibrated Diffusion (RSCD) is an unpaired image restoration method. RSCD views the image restoration problem as completing the finishing steps of a diffusion-based image generation task. RSCD outperforms other widely used unpaired image restoration methods on both image quality and perceptual evaluation metrics.
  arXiv  Detail & Related papers  (2024-03-20T15:38:53Z)
• Generating Realistic Counterfactuals for Retinal Fundus and OCT Images using Diffusion Models [36.81751569090276]
  Counterfactual reasoning is often used in clinical settings to explain decisions or weigh alternatives. Here, we demonstrate that using a diffusion model in combination with an adversarially robust classifier trained on retinal disease classification tasks enables the generation of highly realistic counterfactuals. In a user study, domain experts found the counterfactuals generated using our method significantly more realistic than counterfactuals generated from a previous method, and even indistinguishable from real images.
  arXiv  Detail & Related papers  (2023-11-20T09:28:04Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• A CNN-LSTM Combination Network for Cataract Detection using Eye Fundus Images [0.0]
  One of the leading causes of irreversible blindness in persons over the age of 50 is delayed cataract treatment. We developed a CNN-LSTM-based model architecture with the goal of creating a low-cost diagnostic system. The suggested architecture outperformed previous systems with a state-of-the-art 97.53% accuracy.
  arXiv  Detail & Related papers  (2022-10-28T12:35:15Z)
• Structure-consistent Restoration Network for Cataract Fundus Image Enhancement [33.000927682799016]
  Fundus photography is a routine examination in clinics to diagnose and monitor ocular diseases. For cataract patients, the fundus image always suffers quality degradation caused by the clouding lens. To improve the certainty in clinical diagnosis, restoration algorithms have been proposed to enhance the quality of fundus images.
  arXiv  Detail & Related papers  (2022-06-09T02:32:33Z)
• An Annotation-free Restoration Network for Cataractous Fundus Images [33.05266438479094]
  Restoration algorithms are developed to improve the readability of cataract fundus images. The requirement of annotation limits the application of these algorithms in clinics. This paper proposes a network to annotation-freely restore cataractous fundus images (ArcNet)
  arXiv  Detail & Related papers  (2022-03-15T09:11:48Z)
• Artifact Reduction in Fundus Imaging using Cycle Consistent Adversarial Neural Networks [0.0]
  Deep learning is a powerful tool to extract patterns from data without much human intervention. An attempt has been made to automatically rectify such artifacts present in the images of the fundus. We use a CycleGAN based model which consists of residual blocks to reduce the artifacts in the images.
  arXiv  Detail & Related papers  (2021-12-25T18:05:48Z)
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation [56.622832383316215]
  We propose a novel approach to translate unpaired contrast computed tomography (CT) scans to non-contrast CT scans. Our approach is based on cycle-consistent generative adversarial convolutional transformers, for short, CyTran. Our empirical results show that CyTran outperforms all competing methods.
  arXiv  Detail & Related papers  (2021-10-12T23:25:03Z)
• MTCD: Cataract Detection via Near Infrared Eye Images [69.62768493464053]
  cataract is a common eye disease and one of the leading causes of blindness and vision impairment. We present a novel algorithm for cataract detection using near-infrared eye images. Deep learning-based eye segmentation and multitask network classification networks are presented.
  arXiv  Detail & Related papers  (2021-10-06T08:10:28Z)
• An Interpretable Multiple-Instance Approach for the Detection of referable Diabetic Retinopathy from Fundus Images [72.94446225783697]
  We propose a machine learning system for the detection of referable Diabetic Retinopathy in fundus images. By extracting local information from image patches and combining it efficiently through an attention mechanism, our system is able to achieve high classification accuracy. We evaluate our approach on publicly available retinal image datasets, in which it exhibits near state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-03-02T13:14:15Z)
• Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
  Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis. We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors. Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
  arXiv  Detail & Related papers  (2020-05-12T08:01:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.