Exploiting the Transferability of Deep Learning Systems Across Multi-modal Retinal Scans for Extracting Retinopathy Lesions

• URL: http://arxiv.org/abs/2006.02662v2
• Date: Fri, 14 Aug 2020 15:48:51 GMT
• Title: Exploiting the Transferability of Deep Learning Systems Across Multi-modal Retinal Scans for Extracting Retinopathy Lesions
• Authors: Taimur Hassan, Muhammad Usman Akram and Naoufel Werghi
• Abstract summary: This paper presents a detailed evaluation of semantic segmentation, scene parsing and hybrid deep learning systems for extracting the retinal lesions. We present a novel strategy exploiting the transferability of these models across multiple retinal scanner specifications. Overall, a hybrid retinal analysis and grading network (RAGNet), backboned through ResNet-50, stood first for extracting the retinal lesions.
• Score: 11.791160309522013
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Retinal lesions play a vital role in the accurate classification of retinal abnormalities. Many researchers have proposed deep lesion-aware screening systems that analyze and grade the progression of retinopathy. However, to the best of our knowledge, no literature exploits the tendency of these systems to generalize across multiple scanner specifications and multi-modal imagery. Towards this end, this paper presents a detailed evaluation of semantic segmentation, scene parsing and hybrid deep learning systems for extracting the retinal lesions such as intra-retinal fluid, sub-retinal fluid, hard exudates, drusen, and other chorioretinal anomalies from fused fundus and optical coherence tomography (OCT) imagery. Furthermore, we present a novel strategy exploiting the transferability of these models across multiple retinal scanner specifications. A total of 363 fundus and 173,915 OCT scans from seven publicly available datasets were used in this research (from which 297 fundus and 59,593 OCT scans were used for testing purposes). Overall, a hybrid retinal analysis and grading network (RAGNet), backboned through ResNet-50, stood first for extracting the retinal lesions, achieving a mean dice coefficient score of 0.822. Moreover, the complete source code and its documentation are released at: http://biomisa.org/index.php/downloads/.

Related papers

• Deep learning network to correct axial and coronal eye motion in 3D OCT retinal imaging [65.47834983591957]
  We propose deep learning based neural networks to correct axial and coronal motion artifacts in OCT based on a single scan. The experimental result shows that the proposed method can effectively correct motion artifacts and achieve smaller error than other methods.
  arXiv  Detail & Related papers  (2023-05-27T03:55:19Z)
• nnUNet RASPP for Retinal OCT Fluid Detection, Segmentation and Generalisation over Variations of Data Sources [25.095695898777656]
  We propose two variants of the nnUNet with consistent high performance across images from multiple device vendors. The algorithm was validated on the MICCAI 2017 RETOUCH challenge dataset. Experimental results show that our algorithms outperform the current state-of-the-arts algorithms.
  arXiv  Detail & Related papers  (2023-02-25T23:47:23Z)
• Incremental Cross-Domain Adaptation for Robust Retinopathy Screening via Bayesian Deep Learning [7.535751594024775]
  Retinopathy represents a group of retinal diseases that, if not treated timely, can cause severe visual impairments or even blindness. This paper presents a novel incremental cross-domain adaptation instrument that allows any deep classification model to progressively learn abnormal retinal pathologies. The proposed framework, evaluated on six public datasets, outperforms the state-of-the-art competitors by achieving an overall accuracy and F1 score of 0.9826 and 0.9846, respectively.
  arXiv  Detail & Related papers  (2021-10-18T13:45:21Z)
• Transfer Learning Through Weighted Loss Function and Group Normalization for Vessel Segmentation from Retinal Images [0.0]
  The vascular structure of blood vessels is important in diagnosing retinal conditions such as glaucoma and diabetic retinopathy. We propose an approach for segmenting retinal vessels that uses deep learning along with transfer learning. Our approach results in greater segmentation accuracy than other approaches.
  arXiv  Detail & Related papers  (2020-12-16T20:34:48Z)
• RetiNerveNet: Using Recursive Deep Learning to Estimate Pointwise 24-2 Visual Field Data based on Retinal Structure [109.33721060718392]
  glaucoma is the leading cause of irreversible blindness in the world, affecting over 70 million people. Due to the Standard Automated Perimetry (SAP) test's innate difficulty and its high test-retest variability, we propose the RetiNerveNet.
  arXiv  Detail & Related papers  (2020-10-15T03:09:08Z)
• Classification of COVID-19 in CT Scans using Multi-Source Transfer Learning [91.3755431537592]
  We propose the use of Multi-Source Transfer Learning to improve upon traditional Transfer Learning for the classification of COVID-19 from CT scans. With our multi-source fine-tuning approach, our models outperformed baseline models fine-tuned with ImageNet. Our best performing model was able to achieve an accuracy of 0.893 and a Recall score of 0.897, outperforming its baseline Recall score by 9.3%.
  arXiv  Detail & Related papers  (2020-09-22T11:53:06Z)
• Assignment Flow for Order-Constrained OCT Segmentation [0.0]
  The identification of retinal layer thicknesses serves as an essential task be done for each patient separately. The elaboration of automated segmentation models has become an important task in the field of medical image processing. We propose a novel, purely data driven textitgeometric approach to order-constrained 3D OCT retinal cell layer segmentation
  arXiv  Detail & Related papers  (2020-09-10T01:57:53Z)
• Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification [49.64863177155927]
  We propose a multi-task deep neural network with spatial activation mechanism to segment full retinal vessel, artery and vein simultaneously. The proposed network achieves pixel-wise accuracy of 95.70% for vessel segmentation, and A/V classification accuracy of 94.50%, which is the state-of-the-art performance for both tasks.
  arXiv  Detail & Related papers  (2020-07-18T05:46:47Z)
• Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification [49.32653090178743]
  We demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
  arXiv  Detail & Related papers  (2020-07-02T12:00:53Z)
• Automated segmentation of retinal fluid volumes from structural and angiographic optical coherence tomography using deep learning [2.041049231600541]
  We proposed a deep convolutional neural network (CNN) named Retinal Fluid Network (ReF-Net) to segment volumetric retinal fluid on optical coherence tomography ( OCT) volume. Cross-sectional OCT and angiography ( OCTA) scans were used for training and testing ReF-Net. ReF-Net shows high accuracy (F1 = 0.864 +/- 0.084) in retinal fluid segmentation.
  arXiv  Detail & Related papers  (2020-06-03T22:55:47Z)
• Modeling and Enhancing Low-quality Retinal Fundus Images [167.02325845822276]
  Low-quality fundus images increase uncertainty in clinical observation and lead to the risk of misdiagnosis. We propose a clinically oriented fundus enhancement network (cofe-Net) to suppress global degradation factors. Experiments on both synthetic and real images demonstrate that our algorithm effectively corrects low-quality fundus images without losing retinal details.
  arXiv  Detail & Related papers  (2020-05-12T08:01:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.