CLARA: Clinical Report Auto-completion
- URL: http://arxiv.org/abs/2002.11701v2
- Date: Wed, 4 Mar 2020 13:32:52 GMT
- Title: CLARA: Clinical Report Auto-completion
- Authors: Siddharth Biswal, Cao Xiao, Lucas M. Glass, M. Brandon Westover, and
Jimeng Sun
- Abstract summary: CLinicit Al it Report it Auto-completion (CLARA) is an interactive method that generates reports in a sentence by sentence fashion based on doctors' anchor words and partially completed sentences.
In our experimental evaluation, CLARA achieved 0.393 CIDEr and 0.248 BLEU-4 on X-ray reports and 0.482 CIDEr and 0.491 BLEU-4 for EEG reports for sentence-level generation.
- Score: 56.206459591367405
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Generating clinical reports from raw recordings such as X-rays and
electroencephalogram (EEG) is an essential and routine task for doctors.
However, it is often time-consuming to write accurate and detailed reports.
Most existing methods try to generate the whole reports from the raw input with
limited success because 1) generated reports often contain errors that need
manual review and correction, 2) it does not save time when doctors want to
write additional information into the report, and 3) the generated reports are
not customized based on individual doctors' preference. We propose {\it
CL}inic{\it A}l {\it R}eport {\it A}uto-completion (CLARA), an interactive
method that generates reports in a sentence by sentence fashion based on
doctors' anchor words and partially completed sentences. CLARA searches for
most relevant sentences from existing reports as the template for the current
report. The retrieved sentences are sequentially modified by combining with the
input feature representations to create the final report. In our experimental
evaluation, CLARA achieved 0.393 CIDEr and 0.248 BLEU-4 on X-ray reports and
0.482 CIDEr and 0.491 BLEU-4 for EEG reports for sentence-level generation,
which is up to 35% improvement over the best baseline. Also via our qualitative
evaluation, CLARA is shown to produce reports which have a significantly higher
level of approval by doctors in a user study (3.74 out of 5 for CLARA vs 2.52
out of 5 for the baseline).
Related papers
- Resource-Efficient Medical Report Generation using Large Language Models [3.2627279988912194]
Medical report generation is the task of automatically writing radiology reports for chest X-ray images.
We propose a new framework leveraging vision-enabled Large Language Models (LLM) for the task of medical report generation.
arXiv Detail & Related papers (2024-10-21T05:08:18Z) - RaDialog: A Large Vision-Language Model for Radiology Report Generation
and Conversational Assistance [53.20640629352422]
Conversational AI tools can generate and discuss clinically correct radiology reports for a given medical image.
RaDialog is the first thoroughly evaluated and publicly available large vision-language model for radiology report generation and interactive dialog.
Our method achieves state-of-the-art clinical correctness in report generation and shows impressive abilities in interactive tasks such as correcting reports and answering questions.
arXiv Detail & Related papers (2023-11-30T16:28:40Z) - Replace and Report: NLP Assisted Radiology Report Generation [31.309987297324845]
We propose a template-based approach to generate radiology reports from radiographs.
This is the first attempt to generate chest X-ray radiology reports by first creating small sentences for abnormal findings and then replacing them in the normal report template.
arXiv Detail & Related papers (2023-06-19T10:04:42Z) - Cross-modal Clinical Graph Transformer for Ophthalmic Report Generation [116.87918100031153]
We propose a Cross-modal clinical Graph Transformer (CGT) for ophthalmic report generation (ORG)
CGT injects clinical relation triples into the visual features as prior knowledge to drive the decoding procedure.
Experiments on the large-scale FFA-IR benchmark demonstrate that the proposed CGT is able to outperform previous benchmark methods.
arXiv Detail & Related papers (2022-06-04T13:16:30Z) - FlexR: Few-shot Classification with Language Embeddings for Structured
Reporting of Chest X-rays [37.15474283789249]
We propose a method to predict clinical findings defined by sentences in structured reporting templates.
The approach involves training a contrastive language-image model using chest X-rays and related free-text radiological reports.
Results show that even with limited image-level annotations for training, the method can accomplish the structured reporting tasks of severity assessment of cardiomegaly and localizing pathologies in chest X-rays.
arXiv Detail & Related papers (2022-03-29T16:31:39Z) - Supervised Machine Learning Algorithm for Detecting Consistency between
Reported Findings and the Conclusions of Mammography Reports [66.89977257992568]
Mammography reports document the diagnosis of patients' conditions.
Many reports contain non-standard terms (non-BI-RADS descriptors) and incomplete statements.
Our aim was to develop a tool to detect such discrepancies by comparing the reported conclusions to those that would be expected based on the reported radiology findings.
arXiv Detail & Related papers (2022-02-28T08:59:04Z) - Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation [3.3978173451092437]
Radiology report generation aims at generating descriptive text from radiology images automatically.
A typical setting consists of training encoder-decoder models on image-report pairs with a cross entropy loss.
We propose a novel weakly supervised contrastive loss for medical report generation.
arXiv Detail & Related papers (2021-09-25T00:06:23Z) - Writing by Memorizing: Hierarchical Retrieval-based Medical Report
Generation [26.134055930805523]
We propose MedWriter that incorporates a novel hierarchical retrieval mechanism to automatically extract both report and sentence-level templates.
MedWriter first employs the Visual-Language Retrieval(VLR) module to retrieve the most relevant reports for the given images.
To guarantee the logical coherence between sentences, the Language-Language Retrieval(LLR) module is introduced to retrieve relevant sentences.
At last, a language decoder fuses image features and features from retrieved reports and sentences to generate meaningful medical reports.
arXiv Detail & Related papers (2021-05-25T07:47:23Z) - Unifying Relational Sentence Generation and Retrieval for Medical Image
Report Composition [142.42920413017163]
Current methods often generate the most common sentences due to dataset bias for individual case.
We propose a novel framework that unifies template retrieval and sentence generation to handle both common and rare abnormality.
arXiv Detail & Related papers (2021-01-09T04:33:27Z) - Text Mining to Identify and Extract Novel Disease Treatments From
Unstructured Datasets [56.38623317907416]
We use Google Cloud to transcribe podcast episodes of an NPR radio show.
We then build a pipeline for systematically pre-processing the text.
Our model successfully identified that Omeprazole can help treat heartburn.
arXiv Detail & Related papers (2020-10-22T19:52:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.