Learning-Based Keypoint Registration for Fetoscopic Mosaicking

• URL: http://arxiv.org/abs/2207.13185v1
• Date: Tue, 26 Jul 2022 21:21:12 GMT
• Title: Learning-Based Keypoint Registration for Fetoscopic Mosaicking
• Authors: Alessandro Casella, Sophia Bano, Francisco Vasconcelos, Anna L. David, Dario Paladini, Jan Deprest, Elena De Momi, Leonardo S. Mattos, Sara Moccia, Danail Stoyanov
• Abstract summary: In Twin-to-Twin Transfusion Syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the two fetuses. We propose a learning-based framework for in-vivo fetoscopy frame registration for field-of-view expansion.
• Score: 65.02392513942533
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In Twin-to-Twin Transfusion Syndrome (TTTS), abnormal vascular anastomoses in the monochorionic placenta can produce uneven blood flow between the two fetuses. In the current practice, TTTS is treated surgically by closing abnormal anastomoses using laser ablation. This surgery is minimally invasive and relies on fetoscopy. Limited field of view makes anastomosis identification a challenging task for the surgeon. To tackle this challenge, we propose a learning-based framework for in-vivo fetoscopy frame registration for field-of-view expansion. The novelties of this framework relies on a learning-based keypoint proposal network and an encoding strategy to filter (i) irrelevant keypoints based on fetoscopic image segmentation and (ii) inconsistent homographies. We validate of our framework on a dataset of 6 intraoperative sequences from 6 TTTS surgeries from 6 different women against the most recent state of the art algorithm, which relies on the segmentation of placenta vessels. The proposed framework achieves higher performance compared to the state of the art, paving the way for robust mosaicking to provide surgeons with context awareness during TTTS surgery.

Related papers

• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
  We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images. The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism. We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
  arXiv  Detail & Related papers  (2024-03-21T15:13:36Z)
• Simultaneous segmentation and classification of the retinal arteries and veins from color fundus images [6.027522272446452]
  The study of the retinal vasculature is a fundamental stage in the screening and diagnosis of many diseases. We propose a novel approach for the simultaneous segmentation and classification of the retinal A/V from eye fundus images.
  arXiv  Detail & Related papers  (2022-09-20T09:54:01Z)
• FetReg2021: A Challenge on Placental Vessel Segmentation and Registration in Fetoscopy [52.3219875147181]
  Fetoscopic laser photocoagulation is a widely adopted procedure for treating Twin-to-Twin Transfusion Syndrome (TTTS) The procedure is particularly challenging due to the limited field of view, poor manoeuvrability of the fetoscope, poor visibility, and variability in illumination. Computer-assisted intervention (CAI) can provide surgeons with decision support and context awareness by identifying key structures in the scene and expanding the fetoscopic field of view through video mosaicking. Seven teams participated in this challenge and their model performance was assessed on an unseen test dataset of 658 pixel-annotated images from 6 fet
  arXiv  Detail & Related papers  (2022-06-24T23:44:42Z)
• AI-based Aortic Vessel Tree Segmentation for Cardiovascular Diseases Treatment: Status Quo [55.04215695343928]
  The aortic vessel tree is composed of the aorta and its branching arteries. We systematically review computing techniques for the automatic and semi-automatic segmentation of the aortic vessel tree.
  arXiv  Detail & Related papers  (2021-08-06T08:18:28Z)
• LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos [6.743968799949719]
  A critical complication after cataract surgery is the dislocation of the lens implant leading to vision deterioration and eye trauma. We propose an end-to-end recurrent neural network to recognize the lens-implantation phase and a novel semantic segmentation network to segment the lens and pupil after the implantation phase.
  arXiv  Detail & Related papers  (2021-07-02T07:27:29Z)
• FetReg: Placental Vessel Segmentation and Registration in Fetoscopy Challenge Dataset [57.30136148318641]
  Fetoscopy laser photocoagulation is a widely used procedure for the treatment of Twin-to-Twin Transfusion Syndrome (TTTS) This may lead to increased procedural time and incomplete ablation, resulting in persistent TTTS. Computer-assisted intervention may help overcome these challenges by expanding the fetoscopic field of view through video mosaicking and providing better visualization of the vessel network. We present a large-scale multi-centre dataset for the development of generalized and robust semantic segmentation and video mosaicking algorithms for the fetal environment with a focus on creating drift-free mosaics from long duration fetoscopy videos.
  arXiv  Detail & Related papers  (2021-06-10T17:14:27Z)
• Deep Placental Vessel Segmentation for Fetoscopic Mosaicking [12.90721035124636]
  We propose a solution utilising the U-Net architecture for performing placental vessel segmentation in fetoscopic videos. Experiments on 6 different in vivo fetoscopic videos demonstrate that the vessel intensity-based registration outperformed image intensity-based registration approaches.
  arXiv  Detail & Related papers  (2020-07-08T18:09:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.