Extracting and Learning Fine-Grained Labels from Chest Radiographs
- URL: http://arxiv.org/abs/2011.09517v1
- Date: Wed, 18 Nov 2020 19:56:08 GMT
- Title: Extracting and Learning Fine-Grained Labels from Chest Radiographs
- Authors: Tanveer Syeda-Mahmood, Ph.D, K.C.L Wong, Ph.D, Joy T. Wu, M.D., M.P.H,
Ashutosh Jadhav, Ph.D, Orest Boyko, M.D. Ph.D
- Abstract summary: We focus on extracting and learning fine-grained labels for chest X-ray images.
A total of 457 fine-grained labels depicting the largest spectrum of findings to date were selected.
We show results that indicate a highly accurate label extraction process and a reliable learning of fine-grained labels.
- Score: 0.157292030677369
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Chest radiographs are the most common diagnostic exam in emergency rooms and
intensive care units today. Recently, a number of researchers have begun
working on large chest X-ray datasets to develop deep learning models for
recognition of a handful of coarse finding classes such as opacities, masses
and nodules. In this paper, we focus on extracting and learning fine-grained
labels for chest X-ray images. Specifically we develop a new method of
extracting fine-grained labels from radiology reports by combining
vocabulary-driven concept extraction with phrasal grouping in dependency parse
trees for association of modifiers with findings. A total of 457 fine-grained
labels depicting the largest spectrum of findings to date were selected and
sufficiently large datasets acquired to train a new deep learning model
designed for fine-grained classification. We show results that indicate a
highly accurate label extraction process and a reliable learning of
fine-grained labels. The resulting network, to our knowledge, is the first to
recognize fine-grained descriptions of findings in images covering over nine
modifiers including laterality, location, severity, size and appearance.
Related papers
- Automated Labeling of German Chest X-Ray Radiology Reports using Deep
Learning [50.591267188664666]
We propose a deep learning-based CheXpert label prediction model, pre-trained on reports labeled by a rule-based German CheXpert model.
Our results demonstrate the effectiveness of our approach, which significantly outperformed the rule-based model on all three tasks.
arXiv Detail & Related papers (2023-06-09T16:08:35Z) - Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New
Benchmark Study [75.05049024176584]
We present a benchmark study of the long-tailed learning problem in the specific domain of thorax diseases on chest X-rays.
We focus on learning from naturally distributed chest X-ray data, optimizing classification accuracy over not only the common "head" classes, but also the rare yet critical "tail" classes.
The benchmark consists of two chest X-ray datasets for 19- and 20-way thorax disease classification, containing classes with as many as 53,000 and as few as 7 labeled training images.
arXiv Detail & Related papers (2022-08-29T04:34:15Z) - Graph Enhanced Contrastive Learning for Radiology Findings Summarization [25.377658879658306]
A section of a radiology report summarizes the most prominent observation from the findings.
We propose a unified framework for exploiting both extra knowledge and the original findings.
Key words and their relations can be extracted in an appropriate way to facilitate impression generation.
arXiv Detail & Related papers (2022-04-01T04:39:44Z) - Cross-Modal Contrastive Learning for Abnormality Classification and
Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images.
We first apply an image encoder to classify the chest X-rays and to generate the image features.
The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
arXiv Detail & Related papers (2021-04-11T09:16:29Z) - Cascaded Robust Learning at Imperfect Labels for Chest X-ray
Segmentation [61.09321488002978]
We present a novel cascaded robust learning framework for chest X-ray segmentation with imperfect annotation.
Our model consists of three independent network, which can effectively learn useful information from the peer networks.
Our methods could achieve a significant improvement on the accuracy in segmentation tasks compared to the previous methods.
arXiv Detail & Related papers (2021-04-05T15:50:16Z) - A Relational-learning Perspective to Multi-label Chest X-ray
Classification [1.4489463428855132]
Multi-label classification of chest X-ray images is frequently performed using discriminative approaches.
We propose a novel knowledge graph reformulation of multi-label classification.
arXiv Detail & Related papers (2021-03-10T17:44:59Z) - Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for
Thoracic Disease Identification [83.6017225363714]
deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance.
For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming.
In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
arXiv Detail & Related papers (2021-02-26T02:29:30Z) - Learning Invariant Feature Representation to Improve Generalization
across Chest X-ray Datasets [55.06983249986729]
We show that a deep learning model performing well when tested on the same dataset as training data starts to perform poorly when it is tested on a dataset from a different source.
By employing an adversarial training strategy, we show that a network can be forced to learn a source-invariant representation.
arXiv Detail & Related papers (2020-08-04T07:41:15Z) - Paying Per-label Attention for Multi-label Extraction from Radiology
Reports [1.9601378412924186]
We tackle the automated extraction of structured labels from head CT reports for imaging of suspected stroke patients.
We propose a set of 31 labels which correspond to radiographic findings and clinical impressions related to neurological abnormalities.
We are able to robustly extract many labels with a single model, classified according to the radiologist's reporting.
arXiv Detail & Related papers (2020-07-31T16:11:09Z) - Chest X-ray Report Generation through Fine-Grained Label Learning [46.352966049776875]
We present a domain-aware automatic chest X-ray radiology report generation algorithm that learns fine-grained description of findings from images.
We also develop an automatic labeling algorithm for assigning such descriptors to images and build a novel deep learning network that recognizes both coarse and fine-grained descriptions of findings.
arXiv Detail & Related papers (2020-07-27T19:50:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.