CheXseen: Unseen Disease Detection for Deep Learning Interpretation of
Chest X-rays
- URL: http://arxiv.org/abs/2103.04590v1
- Date: Mon, 8 Mar 2021 08:13:21 GMT
- Title: CheXseen: Unseen Disease Detection for Deep Learning Interpretation of
Chest X-rays
- Authors: Siyu Shi, Ishaan Malhi, Kevin Tran, Andrew Y. Ng, Pranav Rajpurkar
- Abstract summary: We systematically evaluate the performance of deep learning models in the presence of diseases not labeled for or present during training.
First, we evaluate whether deep learning models trained on a subset of diseases (seen diseases) can detect the presence of any one of a larger set of diseases.
Second, we evaluate whether models trained on seen diseases can detect seen diseases when co-occurring with diseases outside the subset (unseen diseases)
Third, we evaluate whether feature representations learned by models may be used to detect the presence of unseen diseases given a small labeled set of unseen diseases.
- Score: 6.3556514837221725
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We systematically evaluate the performance of deep learning models in the
presence of diseases not labeled for or present during training. First, we
evaluate whether deep learning models trained on a subset of diseases (seen
diseases) can detect the presence of any one of a larger set of diseases. We
find that models tend to falsely classify diseases outside of the subset
(unseen diseases) as "no disease". Second, we evaluate whether models trained
on seen diseases can detect seen diseases when co-occurring with diseases
outside the subset (unseen diseases). We find that models are still able to
detect seen diseases even when co-occurring with unseen diseases. Third, we
evaluate whether feature representations learned by models may be used to
detect the presence of unseen diseases given a small labeled set of unseen
diseases. We find that the penultimate layer of the deep neural network
provides useful features for unseen disease detection. Our results can inform
the safe clinical deployment of deep learning models trained on a
non-exhaustive set of disease classes.
Related papers
- Detection of Emerging Infectious Diseases in Lung CT based on Spatial Anomaly Patterns [1.7681509210293134]
Local anomalies are relevant, but often novel diseases involve familiar disease patterns in new spatial distributions.
Here, we present a novel approach to detect the emergence of new disease phenotypes exhibiting distinct patterns of the spatial distribution of lesions.
arXiv Detail & Related papers (2024-10-25T13:02:46Z) - Assessing and Enhancing Large Language Models in Rare Disease Question-answering [64.32570472692187]
We introduce a rare disease question-answering (ReDis-QA) dataset to evaluate the performance of Large Language Models (LLMs) in diagnosing rare diseases.
We collected 1360 high-quality question-answer pairs within the ReDis-QA dataset, covering 205 rare diseases.
We then benchmarked several open-source LLMs, revealing that diagnosing rare diseases remains a significant challenge for these models.
Experiment results demonstrate that ReCOP can effectively improve the accuracy of LLMs on the ReDis-QA dataset by an average of 8%.
arXiv Detail & Related papers (2024-08-15T21:09:09Z) - Expert Uncertainty and Severity Aware Chest X-Ray Classification by
Multi-Relationship Graph Learning [48.29204631769816]
We re-extract disease labels from CXR reports to make them more realistic by considering disease severity and uncertainty in classification.
Our experimental results show that models considering disease severity and uncertainty outperform previous state-of-the-art methods.
arXiv Detail & Related papers (2023-09-06T19:19:41Z) - Interpretable histopathology-based prediction of disease relevant
features in Inflammatory Bowel Disease biopsies using weakly-supervised deep
learning [0.8521205677945196]
Crohn's Disease (CD) and Ulcerative Colitis (UC) are the two main Inflammatory Bowel Disease (IBD) types.
We developed deep learning models to identify histological disease features for both CD and UC using only endoscopic labels.
arXiv Detail & Related papers (2023-03-20T15:59:29Z) - Common human diseases prediction using machine learning based on survey
data [0.0]
We analyze disease symptoms and have done disease predictions based on their symptoms.
We studied a range of symptoms and took a survey from people in order to complete the task.
Several classification algorithms have been employed to train the model.
arXiv Detail & Related papers (2022-09-22T02:59:47Z) - Continual Learning with Bayesian Model based on a Fixed Pre-trained
Feature Extractor [55.9023096444383]
Current deep learning models are characterised by catastrophic forgetting of old knowledge when learning new classes.
Inspired by the process of learning new knowledge in human brains, we propose a Bayesian generative model for continual learning.
arXiv Detail & Related papers (2022-04-28T08:41:51Z) - LifeLonger: A Benchmark for Continual Disease Classification [59.13735398630546]
We introduce LifeLonger, a benchmark for continual disease classification on the MedMNIST collection.
Task and class incremental learning of diseases address the issue of classifying new samples without re-training the models from scratch.
Cross-domain incremental learning addresses the issue of dealing with datasets originating from different institutions while retaining the previously obtained knowledge.
arXiv Detail & Related papers (2022-04-12T12:25:05Z) - Forecasting new diseases in low-data settings using transfer learning [0.0]
We show how knowledge of related diseases can help make predictions of new diseases using transfer learning.
We find that transfer learning offers the potential to improve predictions, even beyond a model based on data from the target disease.
arXiv Detail & Related papers (2022-04-07T17:54:39Z) - Correlation-based Discovery of Disease Patterns for Syndromic
Surveillance [0.0]
syndromic surveillance aims at the detection of cases with early symptoms.
Early symptoms are usually shared among many diseases and a particular disease can have several clinical pictures in the early phase of an infection.
We present a novel, data-driven approach to discover such patterns in historic data.
arXiv Detail & Related papers (2021-10-18T11:50:26Z) - Relational Subsets Knowledge Distillation for Long-tailed Retinal
Diseases Recognition [65.77962788209103]
We propose class subset learning by dividing the long-tailed data into multiple class subsets according to prior knowledge.
It enforces the model to focus on learning the subset-specific knowledge.
The proposed framework proved to be effective for the long-tailed retinal diseases recognition task.
arXiv Detail & Related papers (2021-04-22T13:39:33Z) - Viral Pneumonia Screening on Chest X-ray Images Using Confidence-Aware
Anomaly Detection [86.81773672627406]
Clusters of viral pneumonia during a short period of time may be a harbinger of an outbreak or pandemic, like SARS, MERS, and recent COVID-19.
Rapid and accurate detection of viral pneumonia using chest X-ray can be significantly useful in large-scale screening and epidemic prevention.
Viral pneumonia often have diverse causes and exhibit notably different visual appearances on X-ray images.
arXiv Detail & Related papers (2020-03-27T11:32:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.