EndoMapper dataset of complete calibrated endoscopy procedures
- URL: http://arxiv.org/abs/2204.14240v1
- Date: Fri, 29 Apr 2022 17:10:01 GMT
- Title: EndoMapper dataset of complete calibrated endoscopy procedures
- Authors: Pablo Azagra, Carlos Sostres, \'Angel Ferrandez, Luis Riazuelo, Clara
Tomasini, Oscar Le\'on Barbed, Javier Morlana, David Recasens, Victor M.
Batlle, Juan J. G\'omez-Rodr\'iguez, Richard Elvira, Julia L\'opez, Cristina
Oriol, Javier Civera, Juan D. Tard\'os, Ana Cristina Murillo, Angel Lanas and
Jos\'e M.M. Montiel
- Abstract summary: This paper introduces the Endomapper dataset, the first collection of complete endoscopy sequences acquired during regular medical practice.
Data will be used to build a 3D mapping and localization systems that can perform special task like, for example, detect blind zones during exploration.
- Score: 8.577980383972005
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Computer-assisted systems are becoming broadly used in medicine. In
endoscopy, most research focuses on automatic detection of polyps or other
pathologies, but localization and navigation of the endoscope is completely
performed manually by physicians. To broaden this research and bring spatial
Artificial Intelligence to endoscopies, data from complete procedures are
needed. This data will be used to build a 3D mapping and localization systems
that can perform special task like, for example, detect blind zones during
exploration, provide automatic polyp measurements, guide doctors to a polyp
found in a previous exploration and retrieve previous images of the same area
aligning them for easy comparison. These systems will provide an improvement in
the quality and precision of the procedures while lowering the burden on the
physicians. This paper introduces the Endomapper dataset, the first collection
of complete endoscopy sequences acquired during regular medical practice,
including slow and careful screening explorations, making secondary use of
medical data. Its original purpose is to facilitate the development and
evaluation of VSLAM (Visual Simultaneous Localization and Mapping) methods in
real endoscopy data. The first release of the dataset is composed of 59
sequences with more than 15 hours of video. It is also the first endoscopic
dataset that includes both the computed geometric and photometric endoscope
calibration with the original calibration videos. Meta-data and annotations
associated to the dataset varies from anatomical landmark and description of
the procedure labeling, tools segmentation masks, COLMAP 3D reconstructions,
simulated sequences with groundtruth and meta-data related to special cases,
such as sequences from the same patient. This information will improve the
research in endoscopic VSLAM, as well as other research lines, and create new
research lines.
Related papers
- Frontiers in Intelligent Colonoscopy [96.57251132744446]
This study investigates the frontiers of intelligent colonoscopy techniques and their prospective implications for multimodal medical applications.
We assess the current data-centric and model-centric landscapes through four tasks for colonoscopic scene perception.
To embrace the coming multimodal era, we establish three foundational initiatives: a large-scale multimodal instruction tuning dataset ColonINST, a colonoscopy-designed multimodal language model ColonGPT, and a multimodal benchmark.
arXiv Detail & Related papers (2024-10-22T17:57:12Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - REAL-Colon: A dataset for developing real-world AI applications in
colonoscopy [1.8590283101866463]
We introduce the REAL-Colon (Real-world multi-center Endoscopy Annotated video Library) dataset.
It is a compilation of 2.7M native video frames from sixty full-resolution, real-world colonoscopy recordings across multiple centers.
The dataset contains 350k bounding-box annotations, each created under the supervision of expert gastroenterologists.
arXiv Detail & Related papers (2024-03-04T16:11:41Z) - AiAReSeg: Catheter Detection and Segmentation in Interventional
Ultrasound using Transformers [75.20925220246689]
endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature.
This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
arXiv Detail & Related papers (2023-09-25T19:34:12Z) - ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic
Diffusion Models [69.9178140563928]
Colonoscopy analysis is essential for assisting clinical diagnosis and treatment.
The scarcity of annotated data limits the effectiveness and generalization of existing methods.
We propose an Adaptive Refinement Semantic Diffusion Model (ArSDM) to generate colonoscopy images that benefit the downstream tasks.
arXiv Detail & Related papers (2023-09-03T07:55:46Z) - Medical Image Captioning via Generative Pretrained Transformers [57.308920993032274]
We combine two language models, the Show-Attend-Tell and the GPT-3, to generate comprehensive and descriptive radiology records.
The proposed model is tested on two medical datasets, the Open-I, MIMIC-CXR, and the general-purpose MS-COCO.
arXiv Detail & Related papers (2022-09-28T10:27:10Z) - Unsupervised pre-training of graph transformers on patient population
graphs [48.02011627390706]
We propose a graph-transformer-based network to handle heterogeneous clinical data.
We show the benefit of our pre-training method in a self-supervised and a transfer learning setting.
arXiv Detail & Related papers (2022-07-21T16:59:09Z) - A Temporal Learning Approach to Inpainting Endoscopic Specularities and
Its effect on Image Correspondence [13.25903945009516]
We propose using a temporal generative adversarial network (GAN) to inpaint the hidden anatomy under specularities.
This is achieved using in-vivo data of gastric endoscopy (Hyper-Kvasir) in a fully unsupervised manner.
We also assess the effect of our method in computer vision tasks that underpin 3D reconstruction and camera motion estimation.
arXiv Detail & Related papers (2022-03-31T13:14:00Z) - NanoNet: Real-Time Polyp Segmentation in Video Capsule Endoscopy and
Colonoscopy [0.6125117548653111]
We propose NanoNet, a novel architecture for the segmentation of video capsule endoscopy and colonoscopy images.
Our proposed architecture allows real-time performance and has higher segmentation accuracy compared to other more complex ones.
arXiv Detail & Related papers (2021-04-22T15:40:28Z) - EndoSLAM Dataset and An Unsupervised Monocular Visual Odometry and Depth
Estimation Approach for Endoscopic Videos: Endo-SfMLearner [10.341552258136572]
We introduce a comprehensive endoscopic SLAM dataset consisting of 3D point cloud data for six porcine organs.
A synthetic capsule endoscopy frame with both depth and pose annotations is included to facilitate the study of simulation-to-real transfer learning algorithms.
We propound Endo-SfMLearner, an unsupervised monocular depth and pose estimation method.
arXiv Detail & Related papers (2020-06-30T10:43:27Z) - Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor
Operating Room [1.6276355161958829]
This paper introduces the Heidelberg Colorectal (HeiCo) data set - the first publicly available data set enabling comprehensive benchmarking of medical instrument detection and segmentation algorithms.
Our data set comprises 30 laparoscopic videos and corresponding sensor data from medical devices in the operating room for three different types of laparoscopic surgery.
arXiv Detail & Related papers (2020-05-07T14:04:29Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.