Detection of diabetic retinopathy using longitudinal self-supervised learning

• URL: http://arxiv.org/abs/2209.00915v3
• Date: Sun, 24 Mar 2024 19:39:00 GMT
• Title: Detection of diabetic retinopathy using longitudinal self-supervised learning
• Authors: Rachid Zeghlache, Pierre-Henri Conze, Mostafa El Habib Daho, Ramin Tadayoni, Pascal Massin, Béatrice Cochener, Gwenolé Quellec, Mathieu Lamard,
• Abstract summary: We investigate the benefit of exploiting self-supervised learning with a longitudinal nature for diabetic retinopathy diagnosis purposes. We compare different longitudinal self-supervised learning (LSSL) methods to model the disease progression from longitudinal retinal color fundus photographs. Results achieve an AUC of 0.875 for the baseline (model trained from scratch) and an AUC of 0.96 with a p-value 2.2e-16 on early fusion using a simple ResNet alike architecture with frozen LSSL weights.
• Score: 0.57961065199507
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Longitudinal imaging is able to capture both static anatomical structures and dynamic changes in disease progression towards earlier and better patient-specific pathology management. However, conventional approaches for detecting diabetic retinopathy (DR) rarely take advantage of longitudinal information to improve DR analysis. In this work, we investigate the benefit of exploiting self-supervised learning with a longitudinal nature for DR diagnosis purposes. We compare different longitudinal self-supervised learning (LSSL) methods to model the disease progression from longitudinal retinal color fundus photographs (CFP) to detect early DR severity changes using a pair of consecutive exams. The experiments were conducted on a longitudinal DR screening dataset with or without those trained encoders (LSSL) acting as a longitudinal pretext task. Results achieve an AUC of 0.875 for the baseline (model trained from scratch) and an AUC of 0.96 (95% CI: 0.9593-0.9655 DeLong test) with a p-value < 2.2e-16 on early fusion using a simple ResNet alike architecture with frozen LSSL weights, suggesting that the LSSL latent space enables to encode the dynamic of DR progression.

Related papers

• Enhancing Angular Resolution via Directionality Encoding and Geometric Constraints in Brain Diffusion Tensor Imaging [70.66500060987312]
  Diffusion-weighted imaging (DWI) is a type of Magnetic Resonance Imaging (MRI) technique sensitised to the diffusivity of water molecules. This work proposes DirGeo-DTI, a deep learning-based method to estimate reliable DTI metrics even from a set of DWIs acquired with the minimum theoretical number (6) of gradient directions.
  arXiv  Detail & Related papers  (2024-09-11T11:12:26Z)
• Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer [56.17737749551133]
  We propose ALS longitudinal speech transformer (ALST), a neural network-based automatic predictor of ALS disease progression. By taking advantage of high-quality pretrained speech features and longitudinal information in the recordings, our best model achieves 91.0% AUC. ALST is capable of fine-grained and interpretable predictions of ALS progression, especially for distinguishing between rarer and more severe cases.
  arXiv  Detail & Related papers  (2024-06-26T13:28:24Z)
• LMT: Longitudinal Mixing Training, a Framework to Predict Disease Progression from a Single Image [1.805673949640389]
  We introduce a new way to train time-aware models using $t_mix$, a weighted average time between two consecutive examinations. We predict whether an eye would develop a severe DR in the following visit using a single image, with an AUC of 0.798 compared to baseline results of 0.641.
  arXiv  Detail & Related papers  (2023-10-16T14:01:20Z)
• Longitudinal Multimodal Transformer Integrating Imaging and Latent Clinical Signatures From Routine EHRs for Pulmonary Nodule Classification [4.002181247287472]
  We propose a transformer-based multimodal strategy to integrate repeat imaging with longitudinal clinical signatures from EHRs for solitary pulmonary nodule (SPN) classification. We perform unsupervised disentanglement of latent clinical signatures and leverage time-distance scaled self-attention to jointly learn from clinical signatures expressions and chest computed tomography (CT) scans.
  arXiv  Detail & Related papers  (2023-04-06T03:03:07Z)
• Self-supervised contrastive learning of echocardiogram videos enables label-efficient cardiac disease diagnosis [48.64462717254158]
  We developed a self-supervised contrastive learning approach, EchoCLR, to catered to echocardiogram videos. When fine-tuned on small portions of labeled data, EchoCLR pretraining significantly improved classification performance for left ventricular hypertrophy (LVH) and aortic stenosis (AS) EchoCLR is unique in its ability to learn representations of medical videos and demonstrates that SSL can enable label-efficient disease classification from small, labeled datasets.
  arXiv  Detail & Related papers  (2022-07-23T19:17:26Z)
• Building Brains: Subvolume Recombination for Data Augmentation in Large Vessel Occlusion Detection [56.67577446132946]
  A large training data set is required for a standard deep learning-based model to learn this strategy from data. We propose an augmentation method that generates artificial training samples by recombining vessel tree segmentations of the hemispheres from different patients. In line with the augmentation scheme, we use a 3D-DenseNet fed with task-specific input, fostering a side-by-side comparison between the hemispheres.
  arXiv  Detail & Related papers  (2022-05-05T10:31:57Z)
• Blindness (Diabetic Retinopathy) Severity Scale Detection [0.0]
  Diabetic retinopathy (DR) is a severe complication of diabetes that can cause permanent blindness. Timely diagnosis and treatment of DR are critical to avoid total loss of vision. We propose a novel deep learning based method for automatic screening of retinal fundus images.
  arXiv  Detail & Related papers  (2021-10-04T11:31:15Z)
• FEDI: Few-shot learning based on Earth Mover's Distance algorithm combined with deep residual network to identify diabetic retinopathy [3.6623193507510012]
  This paper proposes a few-shot learning model of a deep residual network based on Earth Mover's algorithm to assist in diagnosing diabetic retinopathy. We build training and validation classification tasks for few-shot learning based on 39 categories of 1000 sample data, train deep residual networks, and obtain experience pre-training models. Based on the weights of the pre-trained model, the Earth Mover's Distance algorithm calculates the distance between the images, obtains the similarity between the images, and changes the model's parameters to improve the accuracy of the training model.
  arXiv  Detail & Related papers  (2021-08-22T13:05:02Z)
• Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studies [19.890200389017213]
  Deep lesion tracker (DLT) is a deep learning approach that uses both appearance- and anatomical-based signals. We release the first lesion tracking benchmark, consisting of 3891 lesion pairs from the public DeepLesion database. DLT generalizes well on an external clinical test set of 100 longitudinal studies, achieving 88% accuracy.
  arXiv  Detail & Related papers  (2020-12-09T05:23:46Z)
• A Benchmark for Studying Diabetic Retinopathy: Segmentation, Grading, and Transferability [76.64661091980531]
  People with diabetes are at risk of developing diabetic retinopathy (DR) Computer-aided DR diagnosis is a promising tool for early detection of DR and severity grading. This dataset has 1,842 images with pixel-level DR-related lesion annotations, and 1,000 images with image-level labels graded by six board-certified ophthalmologists.
  arXiv  Detail & Related papers  (2020-08-22T07:48:04Z)
• 1-D Convlutional Neural Networks for the Analysis of Pupil Size Variations in Scotopic Conditions [79.71065005161566]
  1-D convolutional neural network models are trained for classification of short-range sequences. Model provides prediction with high average accuracy on a hold out test set.
  arXiv  Detail & Related papers  (2020-02-06T17:25:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.