EndoL2H: Deep Super-Resolution for Capsule Endoscopy

• URL: http://arxiv.org/abs/2002.05459v2
• Date: Mon, 22 Jun 2020 19:18:33 GMT
• Title: EndoL2H: Deep Super-Resolution for Capsule Endoscopy
• Authors: Yasin Almalioglu, Kutsev Bengisu Ozyoruk, Abdulkadir Gokce, Kagan Incetan, Guliz Irem Gokceler, Muhammed Ali Simsek, Kivanc Ararat, Richard J. Chen, Nicholas J. Durr, Faisal Mahmood, Mehmet Turan
• Abstract summary: Enhanced-resolution endoscopy has shown to improve adenoma detection rate for conventional endoscopy. We propose and quantitatively validate a novel framework to learn a mapping from low-to-high resolution endoscopic images.
• Score: 8.949916545542296
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although wireless capsule endoscopy is the preferred modality for diagnosis and assessment of small bowel diseases, the poor camera resolution is a substantial limitation for both subjective and automated diagnostics. Enhanced-resolution endoscopy has shown to improve adenoma detection rate for conventional endoscopy and is likely to do the same for capsule endoscopy. In this work, we propose and quantitatively validate a novel framework to learn a mapping from low-to-high resolution endoscopic images. We combine conditional adversarial networks with a spatial attention block to improve the resolution by up to factors of 8x, 10x, 12x, respectively. Quantitative and qualitative studies performed demonstrate the superiority of EndoL2H over state-of-the-art deep super-resolution methods DBPN, RCAN and SRGAN. MOS tests performed by 30 gastroenterologists qualitatively assess and confirm the clinical relevance of the approach. EndoL2H is generally applicable to any endoscopic capsule system and has the potential to improve diagnosis and better harness computational approaches for polyp detection and characterization. Our code and trained models are available at https://github.com/CapsuleEndoscope/EndoL2H.

Related papers

• Clinical Evaluation of Medical Image Synthesis: A Case Study in Wireless Capsule Endoscopy [63.39037092484374]
  This study focuses on the clinical evaluation of medical Synthetic Data Generation using Artificial Intelligence (AI) models. The paper contributes by a) presenting a protocol for the systematic evaluation of synthetic images by medical experts and b) applying it to assess TIDE-II, a novel variational autoencoder-based model for high-resolution WCE image synthesis. The results show that TIDE-II generates clinically relevant WCE images, helping to address data scarcity and enhance diagnostic tools.
  arXiv  Detail & Related papers  (2024-10-31T19:48:50Z)
• Super-resolution of biomedical volumes with 2D supervision [84.5255884646906]
  Masked slice diffusion for super-resolution exploits the inherent equivalence in the data-generating distribution across all spatial dimensions of biological specimens. We focus on the application of SliceR to stimulated histology (SRH), characterized by its rapid acquisition of high-resolution 2D images but slow and costly optical z-sectioning.
  arXiv  Detail & Related papers  (2024-04-15T02:41:55Z)
• UGCANet: A Unified Global Context-Aware Transformer-based Network with Feature Alignment for Endoscopic Image Analysis [0.0]
  This paper presents a novel Transformer-based deep neural network designed to perform multiple tasks simultaneously. Our approach proposes a unique global context-aware module and leverages the powerful MiT backbone, along with a feature alignment block, to enhance the network's representation capability.
  arXiv  Detail & Related papers  (2023-07-12T16:01:56Z)
• Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imaging [59.79875531898648]
  DeepGlioma is an artificial-intelligence-based diagnostic screening system. DeepGlioma can predict the molecular alterations used by the World Health Organization to define the adult-type diffuse glioma taxonomy.
  arXiv  Detail & Related papers  (2023-03-23T18:50:18Z)
• Intra-operative Brain Tumor Detection with Deep Learning-Optimized Hyperspectral Imaging [37.21885467891782]
  Surgery for gliomas (intrinsic brain tumors) is challenging due to the infiltrative nature of the lesion. No real-time, intra-operative, label-free and wide-field tool is available to assist and guide the surgeon to find the relevant demarcations for these tumors. We build a deep-learning-based diagnostic tool for cancer resection with potential for intra-operative guidance.
  arXiv  Detail & Related papers  (2023-02-06T15:52:03Z)
• GAN-based Super-Resolution and Segmentation of Retinal Layers in Optical coherence tomography Scans [13.016298207860974]
  We propose a Generative Adversarial Network (GAN)-based solution for super-resolution and segmentation of OCT scans of the retinal layers. GAN-based segmentation model and evaluate incorporating popular networks, namely, U-Net and ResNet, in the GAN architecture. Our best model configuration empirically achieved the Dice coefficient of 0.867 and mIOU of 0.765.
  arXiv  Detail & Related papers  (2022-06-28T03:53:40Z)
• Automatic Estimation of Ulcerative Colitis Severity from Endoscopy Videos using Ordinal Multi-Instance Learning [50.591267188664666]
  Ulcerative colitis (UC) is a chronic inflammatory bowel disease characterized by relapsing inflammation of the large intestine. The severity of UC is often represented by the Mayo Endoscopic Subscore (MES) which quantifies mucosal disease activity from endoscopy videos. We propose a novel weakly supervised, ordinal classification method to estimate frame severity from video MES labels alone.
  arXiv  Detail & Related papers  (2021-09-29T19:42:51Z)
• Interpretable Automated Diagnosis of Retinal Disease using Deep OCT Analysis [7.005458308454871]
  We develop a CNN-based model for accurate classification of OCT scans. We place an emphasis on producing both qualitative and quantitative explanations of the model's decisions. Our work is the first to produce detailed explanations of the model's decisions.
  arXiv  Detail & Related papers  (2021-09-03T17:59:34Z)
• Learned super resolution ultrasound for improved breast lesion characterization [52.77024349608834]
  Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level. In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges. By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs.
  arXiv  Detail & Related papers  (2021-07-12T09:04:20Z)
• NanoNet: Real-Time Polyp Segmentation in Video Capsule Endoscopy and Colonoscopy [0.6125117548653111]
  We propose NanoNet, a novel architecture for the segmentation of video capsule endoscopy and colonoscopy images. Our proposed architecture allows real-time performance and has higher segmentation accuracy compared to other more complex ones.
  arXiv  Detail & Related papers  (2021-04-22T15:40:28Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.