Related papers: CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT

CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT

URL: http://arxiv.org/abs/2004.09167v3
Date: Sun, 18 Oct 2020 20:30:22 GMT
Title: CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT
Authors: Akshay Smit, Saahil Jain, Pranav Rajpurkar, Anuj Pareek, Andrew Y. Ng, Matthew P. Lungren
Abstract summary: We introduce a BERT-based approach to medical image report labeling. We demonstrate superior performance of a biomedically pretrained BERT model first trained on annotations of a rule-based labeler. We find that our final model, CheXbert, is able to outperform the previous best rules-based labeler with statistical significance.
Score: 6.458158112222296
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Abstract: The extraction of labels from radiology text reports enables large-scale training of medical imaging models. Existing approaches to report labeling typically rely either on sophisticated feature engineering based on medical domain knowledge or manual annotations by experts. In this work, we introduce a BERT-based approach to medical image report labeling that exploits both the scale of available rule-based systems and the quality of expert annotations. We demonstrate superior performance of a biomedically pretrained BERT model first trained on annotations of a rule-based labeler and then finetuned on a small set of expert annotations augmented with automated backtranslation. We find that our final model, CheXbert, is able to outperform the previous best rules-based labeler with statistical significance, setting a new SOTA for report labeling on one of the largest datasets of chest x-rays.