Out-of-Distribution Detection for Dermoscopic Image Classification
- URL: http://arxiv.org/abs/2104.07819v2
- Date: Mon, 19 Apr 2021 05:47:57 GMT
- Title: Out-of-Distribution Detection for Dermoscopic Image Classification
- Authors: Mohammadreza Mohseni, Jordan Yap, William Yolland, Majid Razmara, M
Stella Atkins
- Abstract summary: We develop a novel yet simple method to train neural networks, which enables them to classify in-distribution dermoscopic skin disease images.
We show that our BinaryHeads model not only does not hurt classification balanced accuracy when the data is imbalanced, but also consistently improves the balanced accuracy.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Medical image diagnosis can be achieved by deep neural networks, provided
there is enough varied training data for each disease class. However, a
hitherto unknown disease class not encountered during training will inevitably
be misclassified, even if predicted with low probability. This problem is
especially important for medical image diagnosis, when an image of a hitherto
unknown disease is presented for diagnosis, especially when the images come
from the same image domain, such as dermoscopic skin images.
Current out-of-distribution detection algorithms act unfairly when the
in-distribution classes are imbalanced, by favouring the most numerous disease
in the training sets. This could lead to false diagnoses for rare cases which
are often medically important. We developed a novel yet simple method to train
neural networks, which enables them to classify in-distribution dermoscopic
skin disease images and also detect novel diseases from dermoscopic images at
test time. We show that our BinaryHeads model not only does not hurt
classification balanced accuracy when the data is imbalanced, but also
consistently improves the balanced accuracy. We also introduce an important
method to investigate the effectiveness of out-of-distribution detection
methods based on presence of varying amounts of out-of-distribution data, which
may arise in real-world settings.
Related papers
- FairSkin: Fair Diffusion for Skin Disease Image Generation [54.29840149709033]
Diffusion Model (DM) has become a leading method in generating synthetic medical images, but it suffers from a critical twofold bias.
We propose FairSkin, a novel DM framework that mitigates these biases through a three-level resampling mechanism.
Our approach significantly improves the diversity and quality of generated images, contributing to more equitable skin disease detection in clinical settings.
arXiv Detail & Related papers (2024-10-29T21:37:03Z) - AnoDODE: Anomaly Detection with Diffusion ODE [0.0]
Anomaly detection is the process of identifying atypical data samples that significantly deviate from the majority of the dataset.
We propose a new anomaly detection method based on diffusion ODEs by estimating the density of features extracted from medical images.
Our proposed method not only identifie anomalies but also provides interpretability at both the image and pixel levels.
arXiv Detail & Related papers (2023-10-10T08:44:47Z) - Are Deep Learning Classification Results Obtained on CT Scans Fair and
Interpretable? [0.0]
Most lung nodule classification papers using deep learning randomly shuffle data and split it into training, validation, and test sets.
In contrast, deep neural networks trained with strict patient-level separation maintain their accuracy rates even when new patient images are tested.
Heat-map visualizations of the activations of the deep neural networks trained with strict patient-level separation indicate a higher degree of focus on the relevant nodules.
arXiv Detail & Related papers (2023-09-22T05:57:25Z) - AnoMalNet: Outlier Detection based Malaria Cell Image Classification
Method Leveraging Deep Autoencoder [0.0]
We propose an outlier detection based binary medical image classification technique which can handle even the most extreme case of class imbalance.
An autoencoder model titled AnoMalNet is trained with only the uninfected cell images at the beginning.
We have achieved an accuracy, precision, recall, and F1 score of 98.49%, 97.07%, 100%, and 98.52% respectively.
arXiv Detail & Related papers (2023-03-10T08:49:31Z) - Analyzing the Effects of Handling Data Imbalance on Learned Features
from Medical Images by Looking Into the Models [50.537859423741644]
Training a model on an imbalanced dataset can introduce unique challenges to the learning problem.
We look deeper into the internal units of neural networks to observe how handling data imbalance affects the learned features.
arXiv Detail & Related papers (2022-04-04T09:38:38Z) - Assessing glaucoma in retinal fundus photographs using Deep Feature
Consistent Variational Autoencoders [63.391402501241195]
glaucoma is challenging to detect since it remains asymptomatic until the symptoms are severe.
Early identification of glaucoma is generally made based on functional, structural, and clinical assessments.
Deep learning methods have partially solved this dilemma by bypassing the marker identification stage and analyzing high-level information directly to classify the data.
arXiv Detail & Related papers (2021-10-04T16:06:49Z) - Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for
Thoracic Disease Identification [83.6017225363714]
deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance.
For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming.
In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
arXiv Detail & Related papers (2021-02-26T02:29:30Z) - Detecting Pulmonary Coccidioidomycosis (Valley fever) with Deep
Convolutional Neural Networks [6.280530476948474]
Coccidioidomycosis is the most common systemic mycosis in dogs in the southwestern United States.
We apply machine learning models to provide accurate and interpretable predictions of Coccidioidomycosis.
arXiv Detail & Related papers (2021-01-30T18:06:40Z) - Multi-label Thoracic Disease Image Classification with Cross-Attention
Networks [65.37531731899837]
We propose a novel scheme of Cross-Attention Networks (CAN) for automated thoracic disease classification from chest x-ray images.
We also design a new loss function that beyond cross-entropy loss to help cross-attention process and is able to overcome the imbalance between classes and easy-dominated samples within each class.
arXiv Detail & Related papers (2020-07-21T14:37:00Z) - Quantifying and Leveraging Predictive Uncertainty for Medical Image
Assessment [13.330243305948278]
We propose a system that learns not only the probabilistic estimate for classification, but also an explicit uncertainty measure.
We argue that this approach is essential to account for the inherent ambiguity characteristic of medical images from different radiologic exams.
In our experiments we demonstrate that sample rejection based on the predicted uncertainty can significantly improve the ROC-AUC for various tasks.
arXiv Detail & Related papers (2020-07-08T16:47:55Z) - Semi-supervised Medical Image Classification with Relation-driven
Self-ensembling Model [71.80319052891817]
We present a relation-driven semi-supervised framework for medical image classification.
It exploits the unlabeled data by encouraging the prediction consistency of given input under perturbations.
Our method outperforms many state-of-the-art semi-supervised learning methods on both single-label and multi-label image classification scenarios.
arXiv Detail & Related papers (2020-05-15T06:57:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.