An Attention Based Pipeline for Identifying Pre-Cancer Lesions in Head and Neck Clinical Images
- URL: http://arxiv.org/abs/2405.01937v2
- Date: Tue, 7 May 2024 11:15:37 GMT
- Title: An Attention Based Pipeline for Identifying Pre-Cancer Lesions in Head and Neck Clinical Images
- Authors: Abdullah Alsalemi, Anza Shakeel, Mollie Clark, Syed Ali Khurram, Shan E Ahmed Raza,
- Abstract summary: Head and neck cancer is diagnosed in specialist centres after a surgical biopsy, but there is a potential for these to be missed leading to delayed diagnosis.
We present an attention based pipeline that identifies suspected lesions, segments, and classifies them as non-dysplastic, dysplastic and cancerous lesions.
- Score: 1.0957311485487375
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Early detection of cancer can help improve patient prognosis by early intervention. Head and neck cancer is diagnosed in specialist centres after a surgical biopsy, however, there is a potential for these to be missed leading to delayed diagnosis. To overcome these challenges, we present an attention based pipeline that identifies suspected lesions, segments, and classifies them as non-dysplastic, dysplastic and cancerous lesions. We propose (a) a vision transformer based Mask R-CNN network for lesion detection and segmentation of clinical images, and (b) Multiple Instance Learning (MIL) based scheme for classification. Current results show that the segmentation model produces segmentation masks and bounding boxes with up to 82% overlap accuracy score on unseen external test data and surpassing reviewed segmentation benchmarks. Next, a classification F1-score of 85% on the internal cohort test set. An app has been developed to perform lesion segmentation taken via a smart device. Future work involves employing endoscopic video data for precise early detection and prognosis.
Related papers
- ISLES'24: Improving final infarct prediction in ischemic stroke using multimodal imaging and clinical data [3.2816454618159008]
This work presents the ISLES'24 challenge, which addresses final post-treatment stroke infarct prediction from pre-interventional acute stroke imaging and clinical data.
The contributions of this work are two-fold: first, we introduce a standardized benchmarking of final stroke infarct segmentation algorithms through the ISLES'24 challenge; second, we provide insights into infarct segmentation using multimodal imaging and clinical data strategies.
arXiv Detail & Related papers (2024-08-20T16:01:05Z) - Deep Rib Fracture Instance Segmentation and Classification from CT on
the RibFrac Challenge [66.86170104167608]
The RibFrac Challenge provides a benchmark dataset of over 5,000 rib fractures from 660 CT scans.
During the MICCAI 2020 challenge period, 243 results were evaluated, and seven teams were invited to participate in the challenge summary.
The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts.
arXiv Detail & Related papers (2024-02-14T18:18:33Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - Automated Segmentation and Recurrence Risk Prediction of Surgically
Resected Lung Tumors with Adaptive Convolutional Neural Networks [3.5413688566798096]
Lung cancer is the leading cause of cancer related mortality by a significant margin.
In this paper, we explore the use of convolutional neural networks (CNNs) for the segmentation and recurrence risk prediction of lung tumors.
To the best of our knowledge, it is the first fully automated segmentation and recurrence risk prediction system.
arXiv Detail & Related papers (2022-09-17T23:06:22Z) - Lesion detection in contrast enhanced spectral mammography [0.0]
The recent emergence of neural networks models for the analysis of breast images has been a breakthrough in computer aided diagnostic.
This work proposes a deep-learning-based Computer Aided Diagnostic development for CESM recombined images able to detect lesions and classify cases.
arXiv Detail & Related papers (2022-07-20T06:49:02Z) - Improving Classification Model Performance on Chest X-Rays through Lung
Segmentation [63.45024974079371]
We propose a deep learning approach to enhance abnormal chest x-ray (CXR) identification performance through segmentations.
Our approach is designed in a cascaded manner and incorporates two modules: a deep neural network with criss-cross attention modules (XLSor) for localizing lung region in CXR images and a CXR classification model with a backbone of a self-supervised momentum contrast (MoCo) model pre-trained on large-scale CXR data sets.
arXiv Detail & Related papers (2022-02-22T15:24:06Z) - BI-RADS-Net: An Explainable Multitask Learning Approach for Cancer
Diagnosis in Breast Ultrasound Images [69.41441138140895]
This paper introduces BI-RADS-Net, a novel explainable deep learning approach for cancer detection in breast ultrasound images.
The proposed approach incorporates tasks for explaining and classifying breast tumors, by learning feature representations relevant to clinical diagnosis.
Explanations of the predictions (benign or malignant) are provided in terms of morphological features that are used by clinicians for diagnosis and reporting in medical practice.
arXiv Detail & Related papers (2021-10-05T19:14:46Z) - Segmentation and ABCD rule extraction for skin tumors classification [0.0]
We present an automated diagnosis system based on the ABCD rule used in clinical diagnosis in order to discriminate benign from malignant skin lesions.
This framework has been tested on a dermoscopic database [16] of 320 images.
arXiv Detail & Related papers (2021-06-08T14:07:59Z) - Robust Medical Instrument Segmentation Challenge 2019 [56.148440125599905]
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions.
Our challenge was based on a surgical data set comprising 10,040 annotated images acquired from a total of 30 surgical procedures.
The results confirm the initial hypothesis, namely that algorithm performance degrades with an increasing domain gap.
arXiv Detail & Related papers (2020-03-23T14:35:08Z) - VerSe: A Vertebrae Labelling and Segmentation Benchmark for
Multi-detector CT Images [121.31355003451152]
Large Scale Vertebrae Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020.
We present the the results of this evaluation and further investigate the performance-variation at vertebra-level, scan-level, and at different fields-of-view.
arXiv Detail & Related papers (2020-01-24T21:09:18Z) - Weakly-Supervised Lesion Segmentation on CT Scans using Co-Segmentation [18.58056402884405]
Lesion segmentation on computed tomography (CT) scans is an important step for precisely monitoring changes in lesion/tumor growth.
Current practices rely on an imprecise substitute called response evaluation criteria in solid tumors.
This paper proposes a convolutional neural network based weakly-supervised lesion segmentation method.
arXiv Detail & Related papers (2020-01-23T15:15:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.