SimCol3D -- 3D Reconstruction during Colonoscopy Challenge

• URL: http://arxiv.org/abs/2307.11261v2
• Date: Tue, 2 Jul 2024 20:49:46 GMT
• Title: SimCol3D -- 3D Reconstruction during Colonoscopy Challenge
• Authors: Anita Rau, Sophia Bano, Yueming Jin, Pablo Azagra, Javier Morlana, Rawen Kader, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posner, Netanel Frank, Varshini Elangovan, Sista Raviteja, Zhengwen Li, Jiquan Liu, Seenivasan Lalithkumar, Mobarakol Islam, Hongliang Ren, Laurence B. Lovat, José M. M. Montiel, Danail Stoyanov,
• Abstract summary: The 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.
• Score: 31.01817462784811
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could enhance the identification of unscreened colon tissue and serve as a training platform. However, reconstructing the colon from video footage remains difficult. Learning-based approaches hold promise as robust alternatives, but necessitate extensive datasets. Establishing a benchmark dataset, the 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. The challenge was hosted as part of MICCAI 2022 in Singapore. Six teams from around the world and representatives from academia and industry participated in the three sub-challenges: synthetic depth prediction, synthetic pose prediction, and real pose prediction. This paper describes the challenge, the submitted methods, and their results. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.

Related papers

• Frontiers in Intelligent Colonoscopy [96.57251132744446]
  This study investigates the frontiers of intelligent colonoscopy techniques and their prospective implications for multimodal medical applications. We assess the current data-centric and model-centric landscapes through four tasks for colonoscopic scene perception. To embrace the coming multimodal era, we establish three foundational initiatives: a large-scale multimodal instruction tuning dataset ColonINST, a colonoscopy-designed multimodal language model ColonGPT, and a multimodal benchmark.
  arXiv  Detail & Related papers  (2024-10-22T17:57:12Z)
• ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptation [67.22294293695255]
  We propose a novel reconstruction pipeline with a bi-directional adaptation architecture named ToDER to get precise depth estimations. Experimental results demonstrate that our approach can precisely predict depth maps in both realistic and synthetic colonoscopy videos.
  arXiv  Detail & Related papers  (2024-07-23T14:24:26Z)
• REAL-Colon: A dataset for developing real-world AI applications in colonoscopy [1.8590283101866463]
  We introduce the REAL-Colon (Real-world multi-center Endoscopy Annotated video Library) dataset. It is a compilation of 2.7M native video frames from sixty full-resolution, real-world colonoscopy recordings across multiple centers. The dataset contains 350k bounding-box annotations, each created under the supervision of expert gastroenterologists.
  arXiv  Detail & Related papers  (2024-03-04T16:11:41Z)
• Colonoscopy Coverage Revisited: Identifying Scanning Gaps in Real-Time [0.0]
  Colonoscopy is the most widely used medical technique for preventing Colorectal Cancer, by detecting and removing polyps before they become malignant. Recent studies show that around one quarter of the existing polyps are routinely missed. While some of these do appear in the endoscopist's field of view, others are missed due to a partial coverage of the colon.
  arXiv  Detail & Related papers  (2023-05-17T08:12:56Z)
• SoftEnNet: Symbiotic Monocular Depth Estimation and Lumen Segmentation for Colonoscopy Endorobots [2.9696400288366127]
  Colorectal cancer is the third most common cause of cancer death worldwide. A vision-based autonomous endorobot can improve colonoscopy procedures significantly.
  arXiv  Detail & Related papers  (2023-01-19T16:22:17Z)
• FetReg2021: A Challenge on Placental Vessel Segmentation and Registration in Fetoscopy [52.3219875147181]
  Fetoscopic laser photocoagulation is a widely adopted procedure for treating Twin-to-Twin Transfusion Syndrome (TTTS) The procedure is particularly challenging due to the limited field of view, poor manoeuvrability of the fetoscope, poor visibility, and variability in illumination. Computer-assisted intervention (CAI) can provide surgeons with decision support and context awareness by identifying key structures in the scene and expanding the fetoscopic field of view through video mosaicking. Seven teams participated in this challenge and their model performance was assessed on an unseen test dataset of 658 pixel-annotated images from 6 fet
  arXiv  Detail & Related papers  (2022-06-24T23:44:42Z)
• Bimodal Camera Pose Prediction for Endoscopy [23.12495584329767]
  We propose SimCol, a synthetic dataset for camera pose estimation in colonoscopy. Our dataset replicates real colonoscope motion and highlights the drawbacks of existing methods. We publish 18k RGB images from simulated colonoscopy with corresponding depth and camera poses and make our data generation environment in Unity publicly available.
  arXiv  Detail & Related papers  (2022-04-11T09:34:34Z)
• Colorectal Polyp Detection in Real-world Scenario: Design and Experiment Study [8.112428008139117]
  Colorectal polyps are abnormal tissues growing on the intima of the colon or rectum with a high risk of developing into colorectal cancer. We propose an integrated system architecture to address the unique challenges for polyp detection.
  arXiv  Detail & Related papers  (2021-01-11T17:10:47Z)
• Colonoscopy Polyp Detection: Domain Adaptation From Medical Report Images to Real-time Videos [76.37907640271806]
  We propose an Image-video-joint polyp detection network (Ivy-Net) to address the domain gap between colonoscopy images from historical medical reports and real-time videos. Experiments on the collected dataset demonstrate that our Ivy-Net achieves the state-of-the-art result on colonoscopy video.
  arXiv  Detail & Related papers  (2020-12-31T10:33:09Z)
• SHARP 2020: The 1st Shape Recovery from Partial Textured 3D Scans Challenge Results [90.42321856720633]
  SHARP 2020 is the first edition of a challenge fostering and benchmarking methods for recovering complete textured 3D scans from raw incomplete data. There are two complementary challenges, the first one on 3D human scans, and the second one on generic objects. A novel evaluation metric is proposed to quantify jointly the shape reconstruction, the texture reconstruction and the amount of completed data.
  arXiv  Detail & Related papers  (2020-10-26T12:05:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.