Parameter-Efficient Methods for Metastases Detection from Clinical Notes
- URL: http://arxiv.org/abs/2310.18472v1
- Date: Fri, 27 Oct 2023 20:30:59 GMT
- Title: Parameter-Efficient Methods for Metastases Detection from Clinical Notes
- Authors: Maede Ashofteh Barabadi, Xiaodan Zhu, Wai Yip Chan, Amber L. Simpson,
Richard K.G. Do
- Abstract summary: The objective of this study is to automate the detection of metastatic liver disease from free-style computed tomography (CT) radiology reports.
Our research demonstrates that transferring knowledge using three approaches can improve model performance.
- Score: 19.540079966780954
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Understanding the progression of cancer is crucial for defining treatments
for patients. The objective of this study is to automate the detection of
metastatic liver disease from free-style computed tomography (CT) radiology
reports. Our research demonstrates that transferring knowledge using three
approaches can improve model performance. First, we utilize generic language
models (LMs), pretrained in a self-supervised manner. Second, we use a
semi-supervised approach to train our model by automatically annotating a large
unlabeled dataset; this approach substantially enhances the model's
performance. Finally, we transfer knowledge from related tasks by designing a
multi-task transfer learning methodology. We leverage the recent advancement of
parameter-efficient LM adaptation strategies to improve performance and
training efficiency. Our dataset consists of CT reports collected at Memorial
Sloan Kettering Cancer Center (MSKCC) over the course of 12 years. 2,641
reports were manually annotated by domain experts; among them, 841 reports have
been annotated for the presence of liver metastases. Our best model achieved an
F1-score of 73.8%, a precision of 84%, and a recall of 65.8%.
Related papers
- Multi-modal Medical Image Fusion For Non-Small Cell Lung Cancer Classification [7.002657345547741]
Non-small cell lung cancer (NSCLC) is a predominant cause of cancer mortality worldwide.
In this paper, we introduce an innovative integration of multi-modal data, synthesizing fused medical imaging (CT and PET scans) with clinical health records and genomic data.
Our research surpasses existing approaches, as evidenced by a substantial enhancement in NSCLC detection and classification precision.
arXiv Detail & Related papers (2024-09-27T12:59:29Z) - Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reports [68.39938936308023]
We propose a novel text-guided learning method to achieve highly accurate cancer detection results.
Our approach can leverage clinical knowledge by large-scale pre-trained VLM to enhance generalization ability.
arXiv Detail & Related papers (2024-05-23T07:03:38Z) - Improving Breast Cancer Grade Prediction with Multiparametric MRI Created Using Optimized Synthetic Correlated Diffusion Imaging [71.91773485443125]
Grading plays a vital role in breast cancer treatment planning.
The current tumor grading method involves extracting tissue from patients, leading to stress, discomfort, and high medical costs.
This paper examines using optimized CDI$s$ to improve breast cancer grade prediction.
arXiv Detail & Related papers (2024-05-13T15:48:26Z) - EXACT-Net:EHR-guided lung tumor auto-segmentation for non-small cell lung cancer radiotherapy [7.531407604292937]
Over 60% of non-small cell lung cancer (NSCLC) patients require radiation therapy.
Our approach resulted in a 250% boost in successful nodule detection using the data from ten NSCLC patients treated in our institution.
arXiv Detail & Related papers (2024-02-21T19:49:12Z) - Semi-supervised ViT knowledge distillation network with style transfer
normalization for colorectal liver metastases survival prediction [1.283897253352624]
We propose an end-to-end approach for automated prognosis prediction using histology slides stained with H&E and HPS.
We first employ a Generative Adversarial Network (GAN) for slide normalization to reduce staining variations and improve the overall quality of the images that are used as input to our prediction pipeline.
We exploit the extracted features for the metastatic nodules and surrounding tissue to train a prognosis model. In parallel, we train a vision Transformer (ViT) in a knowledge distillation framework to replicate and enhance the performance of the prognosis prediction.
arXiv Detail & Related papers (2023-11-17T03:32:11Z) - Efficient Lung Cancer Image Classification and Segmentation Algorithm
Based on Improved Swin Transformer [0.0]
transformer model has been applied to the field of computer vision (CV) after its success in natural language processing (NLP)
This paper creatively proposes a segmentation method based on efficient transformer and applies it to medical image analysis.
The algorithm completes the task of lung cancer classification and segmentation by analyzing lung cancer data, and aims to provide efficient technical support for medical staff.
arXiv Detail & Related papers (2022-07-04T15:50:06Z) - Dissecting Self-Supervised Learning Methods for Surgical Computer Vision [51.370873913181605]
Self-Supervised Learning (SSL) methods have begun to gain traction in the general computer vision community.
The effectiveness of SSL methods in more complex and impactful domains, such as medicine and surgery, remains limited and unexplored.
We present an extensive analysis of the performance of these methods on the Cholec80 dataset for two fundamental and popular tasks in surgical context understanding, phase recognition and tool presence detection.
arXiv Detail & Related papers (2022-07-01T14:17:11Z) - EMT-NET: Efficient multitask network for computer-aided diagnosis of
breast cancer [58.720142291102135]
We propose an efficient and light-weighted learning architecture to classify and segment breast tumors simultaneously.
We incorporate a segmentation task into a tumor classification network, which makes the backbone network learn representations focused on tumor regions.
The accuracy, sensitivity, and specificity of tumor classification is 88.6%, 94.1%, and 85.3%, respectively.
arXiv Detail & Related papers (2022-01-13T05:24:40Z) - Lung Cancer Lesion Detection in Histopathology Images Using Graph-Based
Sparse PCA Network [93.22587316229954]
We propose a graph-based sparse principal component analysis (GS-PCA) network, for automated detection of cancerous lesions on histological lung slides stained by hematoxylin and eosin (H&E)
We evaluate the performance of the proposed algorithm on H&E slides obtained from an SVM K-rasG12D lung cancer mouse model using precision/recall rates, F-score, Tanimoto coefficient, and area under the curve (AUC) of the receiver operator characteristic (ROC)
arXiv Detail & Related papers (2021-10-27T19:28:36Z) - A Transfer Learning Based Active Learning Framework for Brain Tumor
Classification [10.437969366798411]
We propose a novel transfer learning based active learning framework to reduce the annotation cost.
We employ a 2D slice-based approach to train and finetune our model on the Magnetic Resonance Imaging (MRI) training dataset of 203 patients.
With our proposed method, the model achieved Area Under Receiver Operating Characteristic (ROC) Curve (AUC) of 82.89% on a separate test dataset of 66 patients.
arXiv Detail & Related papers (2020-11-16T21:11:40Z) - Automatic Data Augmentation via Deep Reinforcement Learning for
Effective Kidney Tumor Segmentation [57.78765460295249]
We develop a novel automatic learning-based data augmentation method for medical image segmentation.
In our method, we innovatively combine the data augmentation module and the subsequent segmentation module in an end-to-end training manner with a consistent loss.
We extensively evaluated our method on CT kidney tumor segmentation which validated the promising results of our method.
arXiv Detail & Related papers (2020-02-22T14:10:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.