Automatic Estimation of Ulcerative Colitis Severity from Endoscopy Videos using Ordinal Multi-Instance Learning

• URL: http://arxiv.org/abs/2109.14685v1
• Date: Wed, 29 Sep 2021 19:42:51 GMT
• Title: Automatic Estimation of Ulcerative Colitis Severity from Endoscopy Videos using Ordinal Multi-Instance Learning
• Authors: Evan Schwab and Gabriela Oana Cula and Kristopher Standish and Stephen S. F. Yip and Aleksandar Stojmirovic and Louis Ghanem and Christel Chehoud
• Abstract summary: Ulcerative colitis (UC) is a chronic inflammatory bowel disease characterized by relapsing inflammation of the large intestine. The severity of UC is often represented by the Mayo Endoscopic Subscore (MES) which quantifies mucosal disease activity from endoscopy videos. We propose a novel weakly supervised, ordinal classification method to estimate frame severity from video MES labels alone.
• Score: 50.591267188664666
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ulcerative colitis (UC) is a chronic inflammatory bowel disease characterized by relapsing inflammation of the large intestine. The severity of UC is often represented by the Mayo Endoscopic Subscore (MES) which quantifies mucosal disease activity from endoscopy videos. In clinical trials, an endoscopy video is assigned an MES based upon the most severe disease activity observed in the video. For this reason, severe inflammation spread throughout the colon will receive the same MES as an otherwise healthy colon with severe inflammation restricted to a small, localized segment. Therefore, the extent of disease activity throughout the large intestine, and overall response to treatment, may not be completely captured by the MES. In this work, we aim to automatically estimate UC severity for each frame in an endoscopy video to provide a higher resolution assessment of disease activity throughout the colon. Because annotating severity at the frame-level is expensive, labor-intensive, and highly subjective, we propose a novel weakly supervised, ordinal classification method to estimate frame severity from video MES labels alone. Using clinical trial data, we first achieved 0.92 and 0.90 AUC for predicting mucosal healing and remission of UC, respectively. Then, for severity estimation, we demonstrate that our models achieve substantial Cohen's Kappa agreement with ground truth MES labels, comparable to the inter-rater agreement of expert clinicians. These findings indicate that our framework could serve as a foundation for novel clinical endpoints, based on a more localized scoring system, to better evaluate UC drug efficacy in clinical trials.

Related papers

• Arges: Spatio-Temporal Transformer for Ulcerative Colitis Severity Assessment in Endoscopy Videos [2.0735422289416605]
  Expert MES/UCEIS annotation is time-consuming and susceptible to inter-rater variability. CNN-based weakly-supervised models with end-to-end (e2e) training lack generalization to new disease scores. "Arges" is a deep learning framework that incorporates positional encoding to estimate disease severity scores in endoscopy.
  arXiv  Detail & Related papers  (2024-10-01T09:23:14Z)
• Assessing and Enhancing Large Language Models in Rare Disease Question-answering [64.32570472692187]
  We introduce a rare disease question-answering (ReDis-QA) dataset to evaluate the performance of Large Language Models (LLMs) in diagnosing rare diseases. We collected 1360 high-quality question-answer pairs within the ReDis-QA dataset, covering 205 rare diseases. We then benchmarked several open-source LLMs, revealing that diagnosing rare diseases remains a significant challenge for these models. Experiment results demonstrate that ReCOP can effectively improve the accuracy of LLMs on the ReDis-QA dataset by an average of 8%.
  arXiv  Detail & Related papers  (2024-08-15T21:09:09Z)
• Automated Assessment of Critical View of Safety in Laparoscopic Cholecystectomy [51.240181118593114]
  Cholecystectomy (gallbladder removal) is one of the most common procedures in the US, with more than 1.2M procedures annually. LC is associated with an increase in bile duct injuries (BDIs), resulting in significant morbidity and mortality. In this paper, we develop deep-learning techniques to automate the assessment of critical view of safety (CVS) in LCs.
  arXiv  Detail & Related papers  (2023-09-13T22:01:36Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• Interpretable histopathology-based prediction of disease relevant features in Inflammatory Bowel Disease biopsies using weakly-supervised deep learning [0.8521205677945196]
  Crohn's Disease (CD) and Ulcerative Colitis (UC) are the two main Inflammatory Bowel Disease (IBD) types. We developed deep learning models to identify histological disease features for both CD and UC using only endoscopic labels.
  arXiv  Detail & Related papers  (2023-03-20T15:59:29Z)
• Coherence Learning using Keypoint-based Pooling Network for Accurately Assessing Radiographic Knee Osteoarthritis [18.47511520060851]
  Knee osteoarthritis (OA) is a common degenerate joint disorder that affects a large population of elderly people worldwide. Current clinically-adopted knee OA grading systems are observer subjective and suffer from inter-rater disagreements. We propose a computer-aided diagnosis approach to provide more accurate and consistent assessments of both composite and fine-grained OA grades simultaneously.
  arXiv  Detail & Related papers  (2021-12-16T19:59:13Z)
• COVID-19 Detection from Chest X-ray Images using Imprinted Weights Approach [67.05664774727208]
  Chest radiography is an alternative screening method for the COVID-19. Computer-aided diagnosis (CAD) has proven to be a viable solution at low cost and with fast speed. To address this challenge, we propose the use of a low-shot learning approach named imprinted weights.
  arXiv  Detail & Related papers  (2021-05-04T19:01:40Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)
• Lesion2Vec: Deep Metric Learning for Few-Shot Multiple Lesions Recognition in Wireless Capsule Endoscopy Video [0.0]
  Wireless Capsule Endoscopy (WCE) has revolutionized traditional endoscopy procedure by allowing gastroenterologists visualize the entire GI tract non-invasively. A single video can last up to 8 hours producing between 30,000 to 100,000 images. We propose a metric-based learning framework followed by a few-shot lesion recognition in WCE data.
  arXiv  Detail & Related papers  (2021-01-11T23:58:56Z)
• EndoL2H: Deep Super-Resolution for Capsule Endoscopy [8.949916545542296]
  Enhanced-resolution endoscopy has shown to improve adenoma detection rate for conventional endoscopy. We propose and quantitatively validate a novel framework to learn a mapping from low-to-high resolution endoscopic images.
  arXiv  Detail & Related papers  (2020-02-13T11:52:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.