Colorectal Polyp Classification from White-light Colonoscopy Images via
Domain Alignment
- URL: http://arxiv.org/abs/2108.02476v1
- Date: Thu, 5 Aug 2021 09:31:46 GMT
- Title: Colorectal Polyp Classification from White-light Colonoscopy Images via
Domain Alignment
- Authors: Qin Wang, Hui Che, Weizhen Ding, Li Xiang, Guanbin Li, Zhen Li,
Shuguang Cui
- Abstract summary: A computer-aided diagnosis system is required to assist accurate diagnosis from colonoscopy images.
Most previous studies at-tempt to develop models for polyp differentiation using Narrow-Band Imaging (NBI) or other enhanced images.
We propose a novel framework based on a teacher-student architecture for the accurate colorectal polyp classification.
- Score: 57.419727894848485
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Differentiation of colorectal polyps is an important clinical examination. A
computer-aided diagnosis system is required to assist accurate diagnosis from
colonoscopy images. Most previous studies at-tempt to develop models for polyp
differentiation using Narrow-Band Imaging (NBI) or other enhanced images.
However, the wide range of these models' applications for clinical work has
been limited by the lagging of imaging techniques. Thus, we propose a novel
framework based on a teacher-student architecture for the accurate colorectal
polyp classification (CPC) through directly using white-light (WL) colonoscopy
images in the examination. In practice, during training, the auxiliary NBI
images are utilized to train a teacher network and guide the student network to
acquire richer feature representation from WL images. The feature transfer is
realized by domain alignment and contrastive learning. Eventually the final
student network has the ability to extract aligned features from only WL images
to facilitate the CPC task. Besides, we release the first public-available
paired CPC dataset containing WL-NBI pairs for the alignment training.
Quantitative and qualitative evaluation indicates that the proposed method
outperforms the previous methods in CPC, improving the accuracy by 5.6%with
very fast speed.
Related papers
- Disease Classification and Impact of Pretrained Deep Convolution Neural Networks on Diverse Medical Imaging Datasets across Imaging Modalities [0.0]
This paper investigates the intricacies of using pretrained deep convolutional neural networks with transfer learning across diverse medical imaging datasets.
It shows that the use of pretrained models as fixed feature extractors yields poor performance irrespective of the datasets.
It is also found that deeper and more complex architectures did not necessarily result in the best performance.
arXiv Detail & Related papers (2024-08-30T04:51:19Z) - EndoFinder: Online Image Retrieval for Explainable Colorectal Polyp Diagnosis [10.83700068295662]
EndoFinder is a content-based image retrieval framework.
It finds the 'digital twin' polyp in the reference database given a newly detected polyp.
The clinical semantics of the new polyp can be inferred referring to the matched ones.
arXiv Detail & Related papers (2024-07-16T05:40:17Z) - CLIP in Medical Imaging: A Comprehensive Survey [59.429714742927956]
Contrastive Language-Image Pre-training successfully introduces text supervision to vision models.
It has shown promising results across various tasks, attributable to its generalizability and interpretability.
Use of CLIP has recently gained increasing interest in the medical imaging domain.
arXiv Detail & Related papers (2023-12-12T15:21:57Z) - Forward-Forward Contrastive Learning [4.465144120325802]
We propose Forward Forward Contrastive Learning (FFCL) as a novel pretraining approach for medical image classification.
FFCL achieves superior performance (3.69% accuracy over ImageNet pretrained ResNet-18) over existing pretraining models in the pneumonia classification task.
arXiv Detail & Related papers (2023-05-04T15:29:06Z) - Performance of GAN-based augmentation for deep learning COVID-19 image
classification [57.1795052451257]
The biggest challenge in the application of deep learning to the medical domain is the availability of training data.
Data augmentation is a typical methodology used in machine learning when confronted with a limited data set.
In this work, a StyleGAN2-ADA model of Generative Adversarial Networks is trained on the limited COVID-19 chest X-ray image set.
arXiv Detail & Related papers (2023-04-18T15:39:58Z) - Iterative Prompt Learning for Unsupervised Backlit Image Enhancement [86.90993077000789]
We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT.
We show that the open-world CLIP prior aids in distinguishing between backlit and well-lit images.
Our method alternates between updating the prompt learning framework and enhancement network until visually pleasing results are achieved.
arXiv Detail & Related papers (2023-03-30T17:37:14Z) - Toward Clinically Assisted Colorectal Polyp Recognition via Structured
Cross-modal Representation Consistency [16.225144477302923]
Most computer-aided diagnosis algorithms recognize colorectal polyps by adopting Narrow-Band Imaging (NBI)
NBI usually suffers from missing utilization in real clinic scenarios since the acquisition of this specific image requires manual switching of the light mode.
We propose a novel method to directly achieve accurate white-light colonoscopy image classification by conducting structured cross-modal representation consistency.
arXiv Detail & Related papers (2022-06-23T16:51:28Z) - Explaining Clinical Decision Support Systems in Medical Imaging using
Cycle-Consistent Activation Maximization [112.2628296775395]
Clinical decision support using deep neural networks has become a topic of steadily growing interest.
clinicians are often hesitant to adopt the technology because its underlying decision-making process is considered to be intransparent and difficult to comprehend.
We propose a novel decision explanation scheme based on CycleGAN activation which generates high-quality visualizations of classifier decisions even in smaller data sets.
arXiv Detail & Related papers (2020-10-09T14:39:27Z) - Improving Endoscopic Decision Support Systems by Translating Between
Imaging Modalities [4.760079434948197]
We investigate the applicability of image-to-image translation to endoscopic images showing different imaging modalities.
In a study on computer-aided celiac disease diagnosis, we explore whether image-to-image translation is capable of effectively performing the translation between the domains.
arXiv Detail & Related papers (2020-04-27T06:55:56Z) - Retinopathy of Prematurity Stage Diagnosis Using Object Segmentation and
Convolutional Neural Networks [68.96150598294072]
Retinopathy of Prematurity (ROP) is an eye disorder primarily affecting premature infants with lower weights.
It causes proliferation of vessels in the retina and could result in vision loss and, eventually, retinal detachment, leading to blindness.
In recent years, there has been a significant effort to automate the diagnosis using deep learning.
This paper builds upon the success of previous models and develops a novel architecture, which combines object segmentation and convolutional neural networks (CNN)
Our proposed system first trains an object segmentation model to identify the demarcation line at a pixel level and adds the resulting mask as an additional "color" channel in
arXiv Detail & Related papers (2020-04-03T14:07:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.