Estimating the coverage in 3d reconstructions of the colon from colonoscopy videos

• URL: http://arxiv.org/abs/2210.10459v1
• Date: Wed, 19 Oct 2022 10:53:34 GMT
• Title: Estimating the coverage in 3d reconstructions of the colon from colonoscopy videos
• Authors: Emmanuelle Muhlethaler and Erez Posner and Moshe Bouhnik
• Abstract summary: Insufficient visual coverage of the colon during the procedure often results in missed polyps. To mitigate this issue, reconstructing the 3D surfaces of the colon in order to visualize the missing regions has been proposed. We present a new method to estimate the coverage from a reconstructed colon pointcloud.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Colonoscopy is the most common procedure for early detection and removal of polyps, a critical component of colorectal cancer prevention. Insufficient visual coverage of the colon surface during the procedure often results in missed polyps. To mitigate this issue, reconstructing the 3D surfaces of the colon in order to visualize the missing regions has been proposed. However, robustly estimating the local and global coverage from such a reconstruction has not been thoroughly investigated until now. In this work, we present a new method to estimate the coverage from a reconstructed colon pointcloud. Our method splits a reconstructed colon into segments and estimates the coverage of each segment by estimating the area of the missing surfaces. We achieve a mean absolute coverage error of 3-6\% on colon segments generated from synthetic colonoscopy data and real colonography CT scans. In addition, we show good qualitative results on colon segments reconstructed from real colonoscopy videos.

Related papers

• Frontiers in Intelligent Colonoscopy [96.57251132744446]
  This study investigates the frontiers of intelligent colonoscopy techniques and their prospective implications for multimodal medical applications. We assess the current data-centric and model-centric landscapes through four tasks for colonoscopic scene perception. To embrace the coming multimodal era, we establish three foundational initiatives: a large-scale multimodal instruction tuning dataset ColonINST, a colonoscopy-designed multimodal language model ColonGPT, and a multimodal benchmark.
  arXiv  Detail & Related papers  (2024-10-22T17:57:12Z)
• ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptation [67.22294293695255]
  We propose a novel reconstruction pipeline with a bi-directional adaptation architecture named ToDER to get precise depth estimations. Experimental results demonstrate that our approach can precisely predict depth maps in both realistic and synthetic colonoscopy videos.
  arXiv  Detail & Related papers  (2024-07-23T14:24:26Z)
• CoCPF: Coordinate-based Continuous Projection Field for Ill-Posed Inverse Problem in Imaging [78.734927709231]
  Sparse-view computed tomography (SVCT) reconstruction aims to acquire CT images based on sparsely-sampled measurements. Due to ill-posedness, implicit neural representation (INR) techniques may leave considerable holes'' (i.e., unmodeled spaces) in their fields, leading to sub-optimal results. We propose the Coordinate-based Continuous Projection Field (CoCPF), which aims to build hole-free representation fields for SVCT reconstruction.
  arXiv  Detail & Related papers  (2024-06-21T08:38:30Z)
• COLON: The largest COlonoscopy LONg sequence public database [0.0]
  Polyps, as the main biomarker of the disease, are detected, localized, and characterized through colonoscopy procedures. Currently, publicly available polyp datasets have allowed significant advances in computational strategies dedicated to characterizing non-parametric polyp shapes. This work introduces COLON: the largest COlonoscopy LONg sequence dataset with around of 30 thousand polyp labeled frames and 400 thousand background frames.
  arXiv  Detail & Related papers  (2024-03-01T16:50:16Z)
• ColonNeRF: High-Fidelity Neural Reconstruction of Long Colonoscopy [20.617076071039282]
  ColonNeRF is a novel reconstruction framework based on neural rendering for novel view synthesis of long-sequence colonoscopy. ColonNeRF reduces shape dissimilarity and ensures geometric consistency in each segment. Our reconstruction visualizations show much clearer textures and more accurate geometric details.
  arXiv  Detail & Related papers  (2023-12-04T16:38:16Z)
• Colonoscopy Coverage Revisited: Identifying Scanning Gaps in Real-Time [0.0]
  Colonoscopy is the most widely used medical technique for preventing Colorectal Cancer, by detecting and removing polyps before they become malignant. Recent studies show that around one quarter of the existing polyps are routinely missed. While some of these do appear in the endoscopist's field of view, others are missed due to a partial coverage of the colon.
  arXiv  Detail & Related papers  (2023-05-17T08:12:56Z)
• What Makes for Automatic Reconstruction of Pulmonary Segments [50.216231776343115]
  3D reconstruction of pulmonary segments plays an important role in surgical treatment planning of lung cancer. However, automatic reconstruction of pulmonary segments remains unexplored in the era of deep learning. We propose ImPulSe, a deep implicit surface model designed for pulmonary segment reconstruction.
  arXiv  Detail & Related papers  (2022-07-07T04:24:17Z)
• C$^3$Fusion: Consistent Contrastive Colon Fusion, Towards Deep SLAM in Colonoscopy [0.0]
  3D colon reconstruction from Optical Colonoscopy (OC) to detect non-examined surfaces remains an unsolved problem. Recent methods demonstrate compelling results, but suffer from: (1) frangible frame-to-frame (or frame-to-model) pose estimation resulting in many tracking failures; or (2) rely on point-based representations at the cost of scan quality. We propose a novel reconstruction framework that addresses these issues end to end, which result in both quantitatively and qualitatively accurate and robust 3D colon reconstruction.
  arXiv  Detail & Related papers  (2022-06-04T10:38:19Z)
• Deep Negative Volume Segmentation [60.44793799306154]
  We propose a new angle to the 3D segmentation task: segment empty spaces between all the tissues surrounding the object. Our approach is an end-to-end pipeline that comprises a V-Net for bone segmentation. We validate the idea on the CT scans in a 50-patient dataset, annotated by experts in maxillofacial medicine.
  arXiv  Detail & Related papers  (2020-06-22T16:55:23Z)
• PraNet: Parallel Reverse Attention Network for Polyp Segmentation [155.93344756264824]
  We propose a parallel reverse attention network (PraNet) for accurate polyp segmentation in colonoscopy images. We first aggregate the features in high-level layers using a parallel partial decoder (PPD) In addition, we mine the boundary cues using a reverse attention (RA) module, which is able to establish the relationship between areas and boundary cues.
  arXiv  Detail & Related papers  (2020-06-13T08:13:43Z)
• Detecting Deficient Coverage in Colonoscopies [24.21649198309876]
  Colonoscopy is the tool of choice for preventing Colorectal Cancer. However, colonoscopy is hampered by the fact that endoscopists routinely miss 22-28% of polyps. This paper introduces the C2D2 (Colonoscopy Coverage Deficiency via Depth) algorithm which detects deficient coverage.
  arXiv  Detail & Related papers  (2020-01-23T15:12:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.