Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks

• URL: http://arxiv.org/abs/2006.10216v1
• Date: Thu, 18 Jun 2020 00:27:20 GMT
• Title: Generating Fundus Fluorescence Angiography Images from Structure Fundus Images Using Generative Adversarial Networks
• Authors: Wanyue Li, Wen Kong, Yiwei Chen, Jing Wang, Yi He, Guohua Shi, Guohua Deng
• Abstract summary: Fluorescein angiography can provide a map of retinal vascular structure and function. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted.
• Score: 8.205917237367748
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fluorescein angiography can provide a map of retinal vascular structure and function, which is commonly used in ophthalmology diagnosis, however, this imaging modality may pose risks of harm to the patients. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted. In this work, we proposed a conditional generative adversarial network(GAN) - based method to directly learn the mapping relationship between structure fundus images and fundus fluorescence angiography images. Moreover, local saliency maps, which define each pixel's importance, are used to define a novel saliency loss in the GAN cost function. This facilitates more accurate learning of small-vessel and fluorescein leakage features.

Related papers

• Style transfer between Microscopy and Magnetic Resonance Imaging via Generative Adversarial Network in small sample size settings [49.84018914962972]
  Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising. We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
  arXiv  Detail & Related papers  (2023-10-16T13:58:53Z)
• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• Cross-modulated Few-shot Image Generation for Colorectal Tissue Classification [58.147396879490124]
  Our few-shot generation method, named XM-GAN, takes one base and a pair of reference tissue images as input and generates high-quality yet diverse images. To the best of our knowledge, we are the first to investigate few-shot generation in colorectal tissue images.
  arXiv  Detail & Related papers  (2023-04-04T17:50:30Z)
• Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network [9.988115865060589]
  We propose an end-to-end trainable deep learning method for multi-modal retinal image registration. Our method extracts convolutional features from the vessel structure for keypoint detection and description. The keypoint detection and description network and graph neural network are jointly trained in a self-supervised manner.
  arXiv  Detail & Related papers  (2022-07-21T14:36:51Z)
• A Keypoint Detection and Description Network Based on the Vessel Structure for Multi-Modal Retinal Image Registration [0.0]
  Multiple images with different modalities or acquisition times are often analyzed for the diagnosis of retinal diseases. Our method uses a convolutional neural network to extract features of the vessel structure in multi-modal retinal images.
  arXiv  Detail & Related papers  (2022-01-06T20:43:35Z)
• Sharp-GAN: Sharpness Loss Regularized GAN for Histopathology Image Synthesis [65.47507533905188]
  Conditional generative adversarial networks have been applied to generate synthetic histopathology images. We propose a sharpness loss regularized generative adversarial network to synthesize realistic histopathology images.
  arXiv  Detail & Related papers  (2021-10-27T18:54:25Z)
• Generative Residual Attention Network for Disease Detection [51.60842580044539]
  We present a novel approach for disease generation in X-rays using a conditional generative adversarial learning. We generate a corresponding radiology image in a target domain while preserving the identity of the patient. We then use the generated X-ray image in the target domain to augment our training to improve the detection performance.
  arXiv  Detail & Related papers  (2021-10-25T14:15:57Z)
• VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers [0.0]
  In Fluorescein Angiography (FA), an injected dye is injected in the bloodstream to image the vascular structure of the retina. Fundus imaging is a non-invasive technique used for photographing the retina but does not have sufficient fidelity for capturing its vascular structure. We propose a novel conditional generative adversarial network (GAN) capable of simultaneously synthesizing FA images from fundus photographs while predicting retinal degeneration.
  arXiv  Detail & Related papers  (2021-04-14T10:32:36Z)
• Attention2AngioGAN: Synthesizing Fluorescein Angiography from Retinal Fundus Images using Generative Adversarial Networks [0.0]
  Fluorescein Angiography (FA) is a technique that employs the designated camera for Fundus photography incorporating excitation and barrier filters. FA also requires fluorescein dye that is injected intravenously, which might cause adverse effects ranging from nausea, vomiting to even fatal anaphylaxis. We introduce an Attention-based Generative network that can synthesize Fluorescein Angiography from Fundus images.
  arXiv  Detail & Related papers  (2020-07-17T18:58:44Z)
• Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
  Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis. We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors. Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
  arXiv  Detail & Related papers  (2020-05-12T08:01:16Z)
• Fundus2Angio: A Conditional GAN Architecture for Generating Fluorescein Angiography Images from Retinal Fundus Photography [0.0]
  There are no non-invasive systems capable of generating Fluorescein Angiography images. Fundus photography is a non-invasive imaging technique that can be completed in a few seconds. We propose a conditional generative adversarial network (GAN) to translate fundus images to FA images.
  arXiv  Detail & Related papers  (2020-05-11T17:09:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.