Colonoscope tracking method based on shape estimation network
- URL: http://arxiv.org/abs/2004.09056v1
- Date: Mon, 20 Apr 2020 05:10:38 GMT
- Title: Colonoscope tracking method based on shape estimation network
- Authors: Masahiro Oda, Holger R. Roth, Takayuki Kitasaka, Kazuhiro Furukawa,
Ryoji Miyahara, Yoshiki Hirooka, Nassir Navab, Kensaku Mori
- Abstract summary: A colonoscope navigation system is necessary to reduce overlooking of polyps.
We propose a colonoscope tracking method for navigation systems.
We utilize the shape estimation network (SEN), which estimates deformed colon shape during colonoscope insertions.
- Score: 36.08151254973927
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper presents a colonoscope tracking method utilizing a colon shape
estimation method. CT colonography is used as a less-invasive colon diagnosis
method. If colonic polyps or early-stage cancers are found, they are removed in
a colonoscopic examination. In the colonoscopic examination, understanding
where the colonoscope running in the colon is difficult. A colonoscope
navigation system is necessary to reduce overlooking of polyps. We propose a
colonoscope tracking method for navigation systems. Previous colonoscope
tracking methods caused large tracking errors because they do not consider
deformations of the colon during colonoscope insertions. We utilize the shape
estimation network (SEN), which estimates deformed colon shape during
colonoscope insertions. The SEN is a neural network containing long short-term
memory (LSTM) layer. To perform colon shape estimation suitable to the real
clinical situation, we trained the SEN using data obtained during colonoscope
operations of physicians. The proposed tracking method performs mapping of the
colonoscope tip position to a position in the colon using estimation results of
the SEN. We evaluated the proposed method in a phantom study. We confirmed that
tracking errors of the proposed method was enough small to perform navigation
in the ascending, transverse, and descending colons.
Related papers
- Frontiers in Intelligent Colonoscopy [96.57251132744446]
This study investigates the frontiers of intelligent colonoscopy techniques and their prospective implications for multimodal medical applications.
We assess the current data-centric and model-centric landscapes through four tasks for colonoscopic scene perception.
To embrace the coming multimodal era, we establish three foundational initiatives: a large-scale multimodal instruction tuning dataset ColonINST, a colonoscopy-designed multimodal language model ColonGPT, and a multimodal benchmark.
arXiv Detail & Related papers (2024-10-22T17:57:12Z) - ToDER: Towards Colonoscopy Depth Estimation and Reconstruction with Geometry Constraint Adaptation [67.22294293695255]
We propose a novel reconstruction pipeline with a bi-directional adaptation architecture named ToDER to get precise depth estimations.
Experimental results demonstrate that our approach can precisely predict depth maps in both realistic and synthetic colonoscopy videos.
arXiv Detail & Related papers (2024-07-23T14:24:26Z) - Colonoscopy Coverage Revisited: Identifying Scanning Gaps in Real-Time [0.0]
Colonoscopy is the most widely used medical technique for preventing Colorectal Cancer, by detecting and removing polyps before they become malignant.
Recent studies show that around one quarter of the existing polyps are routinely missed.
While some of these do appear in the endoscopist's field of view, others are missed due to a partial coverage of the colon.
arXiv Detail & Related papers (2023-05-17T08:12:56Z) - KST-Mixer: Kinematic Spatio-Temporal Data Mixer For Colon Shape
Estimation [44.083624544770245]
Endoscope tracking or a navigation system that navigates physicians to target positions is needed to reduce such complications as organ perforations.
We propose a colon shape estimation method using a Kinematic S-temporal data Mixer (KST-Mixer) that can be used during colonoscope insertions to the colon.
arXiv Detail & Related papers (2023-02-02T06:14:21Z) - Estimating the coverage in 3d reconstructions of the colon from
colonoscopy videos [0.0]
Insufficient visual coverage of the colon during the procedure often results in missed polyps.
To mitigate this issue, reconstructing the 3D surfaces of the colon in order to visualize the missing regions has been proposed.
We present a new method to estimate the coverage from a reconstructed colon pointcloud.
arXiv Detail & Related papers (2022-10-19T10:53:34Z) - Deep Transformers for Fast Small Intestine Grounding in Capsule
Endoscope Video [42.84449937667722]
We propose a deep model to ground shooting range of small intestine from a capsule endoscope video.
This is the first attempt to attack the small intestine grounding task using deep neural network method.
arXiv Detail & Related papers (2021-04-07T02:35:18Z) - Colon Shape Estimation Method for Colonoscope Tracking using Recurrent
Neural Networks [34.591643339874445]
Colonoscope tracking or a navigation system that navigates physician to polyp positions is needed to reduce such complications as colon perforation.
Previous tracking methods caused large tracking errors at the transverse and sigmoid colons because these areas largely deform during colonoscope insertion.
We propose a colon deformation estimation method using RNN and obtain the colonoscope shape from electromagnetic sensors during its insertion into the colon.
arXiv Detail & Related papers (2020-04-20T04:43:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.