Bridge the Domain Gap Between Ultra-wide-field and Traditional Fundus Images via Adversarial Domain Adaptation

• URL: http://arxiv.org/abs/2003.10042v2
• Date: Tue, 24 Mar 2020 01:42:22 GMT
• Title: Bridge the Domain Gap Between Ultra-wide-field and Traditional Fundus Images via Adversarial Domain Adaptation
• Authors: Lie Ju, Xin Wang, Quan Zhou, Hu Zhu, Mehrtash Harandi, Paul Bonnington, Tom Drummond, and Zongyuan Ge
• Abstract summary: Ultra-wide-field fundus imaging by Optos camera is gradually put into use because of its broader insights on fundus. Research on traditional fundus images is an active topic but studies on UWF fundus images are few. We propose a flexible framework to bridge the domain gap between two domains and co-train a UWF fundus diagnosis model by pseudo-labelling and adversarial learning.
• Score: 38.697737290155715
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: For decades, advances in retinal imaging technology have enabled effective diagnosis and management of retinal disease using fundus cameras. Recently, ultra-wide-field (UWF) fundus imaging by Optos camera is gradually put into use because of its broader insights on fundus for some lesions that are not typically seen in traditional fundus images. Research on traditional fundus images is an active topic but studies on UWF fundus images are few. One of the most important reasons is that UWF fundus images are hard to obtain. In this paper, for the first time, we explore domain adaptation from the traditional fundus to UWF fundus images. We propose a flexible framework to bridge the domain gap between two domains and co-train a UWF fundus diagnosis model by pseudo-labelling and adversarial learning. We design a regularisation technique to regulate the domain adaptation. Also, we apply MixUp to overcome the over-fitting issue from incorrect generated pseudo-labels. Our experimental results on either single or both domains demonstrate that the proposed method can well adapt and transfer the knowledge from traditional fundus images to UWF fundus images and improve the performance of retinal disease recognition.

Related papers

• Progressive Retinal Image Registration via Global and Local Deformable Transformations [49.032894312826244]
  We propose a hybrid registration framework called HybridRetina. We use a keypoint detector and a deformation network called GAMorph to estimate the global transformation and local deformable transformation. Experiments on two widely-used datasets, FIRE and FLoRI21, show that our proposed HybridRetina significantly outperforms some state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-09-02T08:43:50Z)
• UWAFA-GAN: Ultra-Wide-Angle Fluorescein Angiography Transformation via Multi-scale Generation and Registration Enhancement [17.28459176559761]
  UWF fluorescein angiography (UWF-FA) requires the administration of a fluorescent dye via injection into the patient's hand or elbow. To mitigate potential adverse effects associated with injections, researchers have proposed the development of cross-modality medical image generation algorithms. We introduce a novel conditional generative adversarial network (UWAFA-GAN) to synthesize UWF-FA from UWF-SLO.
  arXiv  Detail & Related papers  (2024-05-01T14:27:43Z)
• Source-free Active Domain Adaptation for Diabetic Retinopathy Grading Based on Ultra-wide-field Fundus Image [4.679304803181914]
  Domain adaptation (DA) has been widely applied in the diabetic retinopathy (DR) grading of unannotated ultra-wide-field (UWF) fundus images. We propose a novel source-free active domain adaptation (SFADA) in this paper to tackle the DR grading problem itself. Our proposed SFADA achieves state-of-the-art DR grading performance, increasing accuracy by 20.9% and quadratic weighted kappa by 18.63%.
  arXiv  Detail & Related papers  (2023-09-19T13:52:06Z)
• UWAT-GAN: Fundus Fluorescein Angiography Synthesis via Ultra-wide-angle Transformation Multi-scale GAN [1.165405976310311]
  Fundus photography is an essential examination for clinical and differential diagnosis of fundus diseases. Current methods in fundus imaging could not produce high-resolution images and are unable to capture tiny vascular lesion areas. This paper proposes a novel conditional generative adversarial network (UWAT-GAN) to synthesize UWF-FA from UWF-SLO.
  arXiv  Detail & Related papers  (2023-07-21T12:23:39Z)
• Supervised Domain Adaptation for Recognizing Retinal Diseases from Wide-Field Fundus Images [23.503104144297684]
  This paper addresses the emerging task of recognizing multiple retinal diseases from wide-field (WF) and ultra-wide-field (UWF) fundus images. We propose a supervised domain adaptation method named Cross-domain Collaborative Learning (CdCL) Inspired by the success of fixed-based mixup in unsupervised domain adaptation, we re-purpose this strategy for the current task.
  arXiv  Detail & Related papers  (2023-05-14T05:57:11Z)
• GAMMA Challenge:Glaucoma grAding from Multi-Modality imAges [48.98620387924817]
  We set up the Glaucoma grAding from Multi-Modality imAges (GAMMA) Challenge to encourage the development of fundus & OCT-based glaucoma grading. The primary task of the challenge is to grade glaucoma from both the 2D fundus images and 3D OCT scanning volumes. We have publicly released a glaucoma annotated dataset with both 2D fundus color photography and 3D OCT volumes, which is the first multi-modality dataset for glaucoma grading.
  arXiv  Detail & Related papers  (2022-02-14T06:54:15Z)
• PIT: Position-Invariant Transform for Cross-FoV Domain Adaptation [53.428312630479816]
  We observe that the Field of View (FoV) gap induces noticeable instance appearance differences between the source and target domains. Motivated by the observations, we propose the textbfPosition-Invariant Transform (PIT) to better align images in different domains.
  arXiv  Detail & Related papers  (2021-08-16T15:16:47Z)
• Self-Supervised Domain Adaptation for Diabetic Retinopathy Grading using Vessel Image Reconstruction [61.58601145792065]
  We learn invariant target-domain features by defining a novel self-supervised task based on retinal vessel image reconstructions. It can be shown that our approach outperforms existing domain strategies.
  arXiv  Detail & Related papers  (2021-07-20T09:44:07Z)
• Leveraging Regular Fundus Images for Training UWF Fundus Diagnosis Models via Adversarial Learning and Pseudo-Labeling [29.009663623719064]
  Ultra-widefield (UWF) 200degreefundus imaging by Optos cameras has gradually been introduced. Regular fundus images contain a large amount of high-quality and well-annotated data. Due to the domain gap, models trained by regular fundus images to recognize UWF fundus images perform poorly. We propose the use of a modified cycle generative adversarial network (CycleGAN) model to bridge the gap between regular and UWF fundus.
  arXiv  Detail & Related papers  (2020-11-27T16:25:30Z)
• Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
  Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis. We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors. Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
  arXiv  Detail & Related papers  (2020-05-12T08:01:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.