Deep learning for detection and segmentation of artefact and disease
instances in gastrointestinal endoscopy
- URL: http://arxiv.org/abs/2010.06034v2
- Date: Wed, 17 Feb 2021 17:49:32 GMT
- Title: Deep learning for detection and segmentation of artefact and disease
instances in gastrointestinal endoscopy
- Authors: Sharib Ali, Mariia Dmitrieva, Noha Ghatwary, Sophia Bano, Gorkem
Polat, Alptekin Temizel, Adrian Krenzer, Amar Hekalo, Yun Bo Guo, Bogdan
Matuszewski, Mourad Gridach, Irina Voiculescu, Vishnusai Yoganand, Arnav
Chavan, Aryan Raj, Nhan T. Nguyen, Dat Q. Tran, Le Duy Huynh, Nicolas Boutry,
Shahadate Rezvy, Haijian Chen, Yoon Ho Choi, Anand Subramanian, Velmurugan
Balasubramanian, Xiaohong W. Gao, Hongyu Hu, Yusheng Liao, Danail Stoyanov,
Christian Daul, Stefano Realdon, Renato Cannizzaro, Dominique Lamarque, Terry
Tran-Nguyen, Adam Bailey, Barbara Braden, James East and Jens Rittscher
- Abstract summary: The Endoscopy Computer Vision Challenge (EndoCV) is a crowd-sourcing initiative to address eminent problems in developing reliable computer aided detection and diagnosis endoscopy systems.
There are several core challenges often faced by endoscopists, mainly: 1) presence of multi-class artefacts that hinder their visual interpretation, and 2) difficulty in identifying subtle precancerous precursors and cancer abnormalities.
EndoCV 2020 challenges are designed to address research questions in these remits.
- Score: 7.840459682652335
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: The Endoscopy Computer Vision Challenge (EndoCV) is a crowd-sourcing
initiative to address eminent problems in developing reliable computer aided
detection and diagnosis endoscopy systems and suggest a pathway for clinical
translation of technologies. Whilst endoscopy is a widely used diagnostic and
treatment tool for hollow-organs, there are several core challenges often faced
by endoscopists, mainly: 1) presence of multi-class artefacts that hinder their
visual interpretation, and 2) difficulty in identifying subtle precancerous
precursors and cancer abnormalities. Artefacts often affect the robustness of
deep learning methods applied to the gastrointestinal tract organs as they can
be confused with tissue of interest. EndoCV2020 challenges are designed to
address research questions in these remits. In this paper, we present a summary
of methods developed by the top 17 teams and provide an objective comparison of
state-of-the-art methods and methods designed by the participants for two
sub-challenges: i) artefact detection and segmentation (EAD2020), and ii)
disease detection and segmentation (EDD2020). Multi-center, multi-organ,
multi-class, and multi-modal clinical endoscopy datasets were compiled for both
EAD2020 and EDD2020 sub-challenges. The out-of-sample generalization ability of
detection algorithms was also evaluated. Whilst most teams focused on accuracy
improvements, only a few methods hold credibility for clinical usability. The
best performing teams provided solutions to tackle class imbalance, and
variabilities in size, origin, modality and occurrences by exploring data
augmentation, data fusion, and optimal class thresholding techniques.
Related papers
- Artificial Intelligence in Gastrointestinal Bleeding Analysis for Video Capsule Endoscopy: Insights, Innovations, and Prospects (2008-2023) [0.7119794757408745]
An estimated 300,000 annual deaths worldwide are associated with gastrointestinal (GI) bleeding.
Video Capsule Endoscopy (VCE) has marked a significant advancement, offering a comprehensive, non-invasive visualization of the digestive tract.
Despite its benefits, the efficacy of VCE is hindered by diagnostic challenges, including time-consuming analysis and susceptibility to human error.
This review assesses the current state of Machine Learning (ML) methodologies in bleeding detection, highlighting their effectiveness, challenges, and prospective directions.
arXiv Detail & Related papers (2024-09-01T07:13:28Z) - Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary
Task Integration [54.76511683427566]
This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information.
A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction.
The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
arXiv Detail & Related papers (2024-02-16T05:16:20Z) - Multi-task Explainable Skin Lesion Classification [54.76511683427566]
We propose a few-shot-based approach for skin lesions that generalizes well with few labelled data.
The proposed approach comprises a fusion of a segmentation network that acts as an attention module and classification network.
arXiv Detail & Related papers (2023-10-11T05:49:47Z) - Learning Through Guidance: Knowledge Distillation for Endoscopic Image
Classification [40.366659911178964]
Endoscopy plays a major role in identifying any underlying abnormalities within the gastrointestinal (GI) tract.
Deep learning, specifically Convolution Neural Networks (CNNs) which are designed to perform automatic feature learning without any prior feature engineering, has recently reported great benefits for GI endoscopy image analysis.
We investigate three KD-based learning frameworks, response-based, feature-based, and relation-based mechanisms, and introduce a novel multi-head attention-based feature fusion mechanism to support relation-based learning.
arXiv Detail & Related papers (2023-08-17T02:02:11Z) - Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges [58.32937972322058]
"Medico automatic polyp segmentation (Medico 2020)" and "MedAI: Transparency in Medical Image (MedAI 2021)" competitions.
We present a comprehensive summary and analyze each contribution, highlight the strength of the best-performing methods, and discuss the possibility of clinical translations of such methods into the clinic.
arXiv Detail & Related papers (2023-07-30T16:08:45Z) - Factored Attention and Embedding for Unstructured-view Topic-related
Ultrasound Report Generation [70.7778938191405]
We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation.
The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
arXiv Detail & Related papers (2022-03-12T15:24:03Z) - Assessing generalisability of deep learning-based polyp detection and
segmentation methods through a computer vision challenge [11.914243295893984]
Polyps are well-known cancer precursors identified by colonoscopy.
Surveillance and removal of colonic polyps are highly operator-dependent procedures.
There exist a high missed detection rate and incomplete removal of colonic polyps.
arXiv Detail & Related papers (2022-02-24T11:25:52Z) - Inheritance-guided Hierarchical Assignment for Clinical Automatic
Diagnosis [50.15205065710629]
Clinical diagnosis, which aims to assign diagnosis codes for a patient based on the clinical note, plays an essential role in clinical decision-making.
We propose a novel framework to combine the inheritance-guided hierarchical assignment and co-occurrence graph propagation for clinical automatic diagnosis.
arXiv Detail & Related papers (2021-01-27T13:16:51Z) - Robust Medical Instrument Segmentation Challenge 2019 [56.148440125599905]
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions.
Our challenge was based on a surgical data set comprising 10,040 annotated images acquired from a total of 30 surgical procedures.
The results confirm the initial hypothesis, namely that algorithm performance degrades with an increasing domain gap.
arXiv Detail & Related papers (2020-03-23T14:35:08Z) - Endoscopy disease detection challenge 2020 [0.40631409309544825]
This paper provides an overview of the EDD2020 dataset, challenge tasks, evaluation strategies and a short summary of results on test data.
EDD2020 is a crowd sourcing initiative to test the feasibility of recent deep learning methods.
A detailed paper will be drafted after the challenge workshop with more detailed analysis of the results.
arXiv Detail & Related papers (2020-03-07T00:41:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.