Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation

• URL: http://arxiv.org/abs/2104.00793v1
• Date: Thu, 1 Apr 2021 22:37:29 GMT
• Title: Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation
• Authors: Saahil Jain, Akshay Smit, Andrew Y. Ng, Pranav Rajpurkar
• Abstract summary: This study investigates the impact of improvements in radiology report labeling on the performance of chest X-ray classification models. We compare the CheXpert, CheXbert, and VisualCheXbert labelers on the task of extracting accurate chest X-ray image labels from radiology reports. We show that an image classification model trained on labels from the VisualCheXbert labeler outperforms image classification models trained on labels from the CheXpert and CheXbert labelers.
• Score: 6.360030720258042
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ray classification models has not been systematically investigated. We first compare the CheXpert, CheXbert, and VisualCheXbert labelers on the task of extracting accurate chest X-ray image labels from radiology reports, reporting that the VisualCheXbert labeler outperforms the CheXpert and CheXbert labelers. Next, after training image classification models using labels generated from the different radiology report labelers on one of the largest datasets of chest X-rays, we show that an image classification model trained on labels from the VisualCheXbert labeler outperforms image classification models trained on labels from the CheXpert and CheXbert labelers. Our work suggests that recent improvements in radiology report labeling can translate to the development of higher performing chest X-ray classification models.

Related papers

• Automated Labeling of German Chest X-Ray Radiology Reports using Deep Learning [50.591267188664666]
  We propose a deep learning-based CheXpert label prediction model, pre-trained on reports labeled by a rule-based German CheXpert model. Our results demonstrate the effectiveness of our approach, which significantly outperformed the rule-based model on all three tasks.
  arXiv  Detail & Related papers  (2023-06-09T16:08:35Z)
• German CheXpert Chest X-ray Radiology Report Labeler [50.591267188664666]
  This study aimed to develop an algorithm to automatically extract annotations for chest X-ray classification models from German thoracic radiology reports. Results showed that automated label extraction can reduce time spent on manual labeling and improve overall modeling performance.
  arXiv  Detail & Related papers  (2023-06-05T11:01:58Z)
• Long-Tailed Classification of Thorax Diseases on Chest X-Ray: A New Benchmark Study [75.05049024176584]
  We present a benchmark study of the long-tailed learning problem in the specific domain of thorax diseases on chest X-rays. We focus on learning from naturally distributed chest X-ray data, optimizing classification accuracy over not only the common "head" classes, but also the rare yet critical "tail" classes. The benchmark consists of two chest X-ray datasets for 19- and 20-way thorax disease classification, containing classes with as many as 53,000 and as few as 7 labeled training images.
  arXiv  Detail & Related papers  (2022-08-29T04:34:15Z)
• BoMD: Bag of Multi-label Descriptors for Noisy Chest X-ray Classification [25.76256302330625]
  New medical imaging classification problems may need to rely on machine-generated noisy labels extracted from radiology reports. Current noisy-label learning methods designed for multi-class problems cannot be easily adapted. We propose a new method designed for the noisy multi-label CXR learning, which detects and smoothly re-labels samples from the dataset.
  arXiv  Detail & Related papers  (2022-03-03T08:04:59Z)
• Cross-Modal Contrastive Learning for Abnormality Classification and Localization in Chest X-rays with Radiomics using a Feedback Loop [63.81818077092879]
  We propose an end-to-end semi-supervised cross-modal contrastive learning framework for medical images. We first apply an image encoder to classify the chest X-rays and to generate the image features. The radiomic features are then passed through another dedicated encoder to act as the positive sample for the image features generated from the same chest X-ray.
  arXiv  Detail & Related papers  (2021-04-11T09:16:29Z)
• Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for Thoracic Disease Identification [83.6017225363714]
  deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance. For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming. In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
  arXiv  Detail & Related papers  (2021-02-26T02:29:30Z)
• VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labels [4.865330207715854]
  We show that radiologists labeling reports significantly disagree with radiologists labeling chest X-ray images. We develop and evaluate methods to produce labels from radiology reports that have better agreement with radiologists labeling images.
  arXiv  Detail & Related papers  (2021-02-23T03:02:36Z)
• Extracting and Learning Fine-Grained Labels from Chest Radiographs [0.157292030677369]
  We focus on extracting and learning fine-grained labels for chest X-ray images. A total of 457 fine-grained labels depicting the largest spectrum of findings to date were selected. We show results that indicate a highly accurate label extraction process and a reliable learning of fine-grained labels.
  arXiv  Detail & Related papers  (2020-11-18T19:56:08Z)
• Chest X-ray Report Generation through Fine-Grained Label Learning [46.352966049776875]
  We present a domain-aware automatic chest X-ray radiology report generation algorithm that learns fine-grained description of findings from images. We also develop an automatic labeling algorithm for assigning such descriptors to images and build a novel deep learning network that recognizes both coarse and fine-grained descriptions of findings.
  arXiv  Detail & Related papers  (2020-07-27T19:50:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.