Uncertainty-inspired Open Set Learning for Retinal Anomaly
Identification
- URL: http://arxiv.org/abs/2304.03981v3
- Date: Tue, 29 Aug 2023 13:50:43 GMT
- Title: Uncertainty-inspired Open Set Learning for Retinal Anomaly
Identification
- Authors: Meng Wang, Tian Lin, Lianyu Wang, Aidi Lin, Ke Zou, Xinxing Xu, Yi
Zhou, Yuanyuan Peng, Qingquan Meng, Yiming Qian, Guoyao Deng, Zhiqun Wu,
Junhong Chen, Jianhong Lin, Mingzhi Zhang, Weifang Zhu, Changqing Zhang,
Daoqiang Zhang, Rick Siow Mong Goh, Yong Liu, Chi Pui Pang, Xinjian Chen,
Haoyu Chen, Huazhu Fu
- Abstract summary: We establish an uncertainty-inspired open-set (UIOS) model, which was trained with fundus images of 9 retinal conditions.
Our UIOS model with thresholding strategy achieved an F1 score of 99.55%, 97.01% and 91.91% for the internal testing set.
UIOS correctly predicted high uncertainty scores, which would prompt the need for a manual check in the datasets of non-target categories retinal diseases, low-quality fundus images, and non-fundus images.
- Score: 71.06194656633447
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Failure to recognize samples from the classes unseen during training is a
major limitation of artificial intelligence in the real-world implementation
for recognition and classification of retinal anomalies. We established an
uncertainty-inspired open-set (UIOS) model, which was trained with fundus
images of 9 retinal conditions. Besides assessing the probability of each
category, UIOS also calculated an uncertainty score to express its confidence.
Our UIOS model with thresholding strategy achieved an F1 score of 99.55%,
97.01% and 91.91% for the internal testing set, external target categories
(TC)-JSIEC dataset and TC-unseen testing set, respectively, compared to the F1
score of 92.20%, 80.69% and 64.74% by the standard AI model. Furthermore, UIOS
correctly predicted high uncertainty scores, which would prompt the need for a
manual check in the datasets of non-target categories retinal diseases,
low-quality fundus images, and non-fundus images. UIOS provides a robust method
for real-world screening of retinal anomalies.
Related papers
- Enhancing Diagnostic Reliability of Foundation Model with Uncertainty Estimation in OCT Images [41.002573031087856]
We developed a foundation model with uncertainty estimation (FMUE) to detect 11 retinal conditions on optical coherence tomography ( OCT)
FMUE achieved a higher F1 score of 96.76% than two state-of-the-art algorithms, RETFound and UIOS, and got further improvement with thresholding strategy to 98.44%.
Our model is superior to two ophthalmologists with a higher F1 score (95.17% vs. 61.93% &71.72%)
arXiv Detail & Related papers (2024-06-18T03:04:52Z) - RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detection [60.960988614701414]
RIGID is a training-free and model-agnostic method for robust AI-generated image detection.
RIGID significantly outperforms existing trainingbased and training-free detectors.
arXiv Detail & Related papers (2024-05-30T14:49:54Z) - InceptionCaps: A Performant Glaucoma Classification Model for
Data-scarce Environment [0.0]
glaucoma is an irreversible ocular disease and is the second leading cause of visual disability worldwide.
This work reviews existing state of the art models and proposes InceptionCaps, a novel capsule network (CapsNet) based deep learning model having pre-trained InceptionV3 as its convolution base, for automatic glaucoma classification.
InceptionCaps achieved an accuracy of 0.956, specificity of 0.96, and AUC of 0.9556, which surpasses several state-of-the-art deep learning model performances on the RIM-ONE v2 dataset.
arXiv Detail & Related papers (2023-11-24T11:58:11Z) - A Federated Learning Framework for Stenosis Detection [70.27581181445329]
This study explores the use of Federated Learning (FL) for stenosis detection in coronary angiography images (CA)
Two heterogeneous datasets from two institutions were considered: dataset 1 includes 1219 images from 200 patients, which we acquired at the Ospedale Riuniti of Ancona (Italy)
dataset 2 includes 7492 sequential images from 90 patients from a previous study available in the literature.
arXiv Detail & Related papers (2023-10-30T11:13:40Z) - FundusQ-Net: a Regression Quality Assessment Deep Learning Algorithm for
Fundus Images Quality Grading [0.0]
Glaucoma, diabetic retinopathy and age-related macular degeneration are major causes of blindness and vision impairment.
Key step in this process is to automatically estimate the quality of the fundus images to make sure these are interpretable by a human operator or a machine learning model.
We present a novel fundus image quality scale and deep learning (DL) model that can estimate fundus image quality relative to this new scale.
arXiv Detail & Related papers (2022-05-02T21:01:34Z) - The Report on China-Spain Joint Clinical Testing for Rapid COVID-19 Risk
Screening by Eye-region Manifestations [59.48245489413308]
We developed and tested a COVID-19 rapid prescreening model using the eye-region images captured in China and Spain with cellphone cameras.
The performance was measured using area under receiver-operating-characteristic curve (AUC), sensitivity, specificity, accuracy, and F1.
arXiv Detail & Related papers (2021-09-18T02:28:01Z) - Vision Transformers for femur fracture classification [59.99241204074268]
The Vision Transformer (ViT) was able to correctly predict 83% of the test images.
Good results were obtained in sub-fractures with the largest and richest dataset ever.
arXiv Detail & Related papers (2021-08-07T10:12:42Z) - Robust Pollen Imagery Classification with Generative Modeling and Mixup
Training [0.0]
We present a robust deep learning framework that can generalize well for pollen grain aerobiological imagery classification.
We develop a convolutional neural network-based pollen grain classification approach and combine some of the best practices in deep learning for better generalization.
The proposed approach earned a fourth-place in the final rankings in the ICPR-2020 Pollen Grain Classification Challenge.
arXiv Detail & Related papers (2021-02-25T19:39:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.