Heatmap-based 2D Landmark Detection with a Varying Number of Landmarks

• URL: http://arxiv.org/abs/2101.02737v1
• Date: Thu, 7 Jan 2021 19:42:44 GMT
• Title: Heatmap-based 2D Landmark Detection with a Varying Number of Landmarks
• Authors: Antonia Stern, Lalith Sharan, Gabriele Romano, Sven Koehler, Matthias Karck, Raffaele De Simone, Ivo Wolf, Sandy Engelhardt
• Abstract summary: This work presents a neural network approach which detects the sutures in endoscopic images of mitral valve repair. The proposed heatmap-based neural network achieves a mean positive predictive value (PPV) of 66.68$pm$4.67%.
• Score: 1.1692203972491388
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mitral valve repair is a surgery to restore the function of the mitral valve. To achieve this, a prosthetic ring is sewed onto the mitral annulus. Analyzing the sutures, which are punctured through the annulus for ring implantation, can be useful in surgical skill assessment, for quantitative surgery and for positioning a virtual prosthetic ring model in the scene via augmented reality. This work presents a neural network approach which detects the sutures in endoscopic images of mitral valve repair and therefore solves a landmark detection problem with varying amount of landmarks, as opposed to most other existing deep learning-based landmark detection approaches. The neural network is trained separately on two data collections from different domains with the same architecture and hyperparameter settings. The datasets consist of more than 1,300 stereo frame pairs each, with a total over 60,000 annotated landmarks. The proposed heatmap-based neural network achieves a mean positive predictive value (PPV) of 66.68$\pm$4.67% and a mean true positive rate (TPR) of 24.45$\pm$5.06% on the intraoperative test dataset and a mean PPV of 81.50\pm5.77\% and a mean TPR of 61.60$\pm$6.11% on a dataset recorded during surgical simulation. The best detection results are achieved when the camera is positioned above the mitral valve with good illumination. A detection from a sideward view is also possible if the mitral valve is well perceptible.

Related papers

• Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery [52.63271687382495]
  We present an approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner. A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models. An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system.
  arXiv  Detail & Related papers  (2023-08-05T16:26:41Z)
• Automatic Classification of Symmetry of Hemithoraces in Canine and Feline Radiographs [0.0]
  We propose a hemithoraces segmentation method based on Convolutional Neural Networks (CNNs) and active contours. To test the robustness of the proposed thorax segmentation method to underexposure and overexposure, we synthetically corrupted properly exposed radiographs.
  arXiv  Detail & Related papers  (2023-02-24T22:46:16Z)
• Estimation of mitral valve hinge point coordinates -- deep neural net for echocardiogram segmentation [0.0]
  We propose a fully automatic detection method for mitral valve hinge points. The method extracts the mitral valve hinge points from the resulting segmentations in a second step. Results measured with this automatic detection method were compared to reference coordinate values.
  arXiv  Detail & Related papers  (2023-01-20T19:46:16Z)
• Development of Automatic Endotracheal Tube and Carina Detection on Portable Supine Chest Radiographs using Artificial Intelligence [1.651690213572386]
  The endotracheal intubation detection requires the locations of the endotracheal tube (ETT) tip and carina. We propose a feature extraction method with Mask R-CNN to find the distance between the ETT tip and the carina in chest radiography.
  arXiv  Detail & Related papers  (2022-06-07T05:18:46Z)
• Point detection through multi-instance deep heatmap regression for sutures in endoscopy [0.8937790536664091]
  We formulate the suture detection task as a multi-instance deep heatmap regression problem. We introduce the novel use of a 2D Gaussian layer followed by a differentiable 2D spatial Soft-Argmax layer to function as a local non-maximum suppression. The proposed model shows an improvement over the baseline in the intra-operative and the simulator domains.
  arXiv  Detail & Related papers  (2021-11-16T13:45:23Z)
• Osteoporosis Prescreening using Panoramic Radiographs through a Deep Convolutional Neural Network with Attention Mechanism [65.70943212672023]
  Deep convolutional neural network (CNN) with an attention module can detect osteoporosis on panoramic radiographs. dataset of 70 panoramic radiographs (PRs) from 70 different subjects of age between 49 to 60 was used.
  arXiv  Detail & Related papers  (2021-10-19T00:03:57Z)
• CNN Based Segmentation of Infarcted Regions in Acute Cerebral Stroke Patients From Computed Tomography Perfusion Imaging [2.1626699124055504]
  Thrombolytic treatment can reduce brain damage but has a narrow treatment window. Computed To Perfusion imaging is a commonly used primary assessment tool for stroke patients. We propose a fully automated four-dimensional convolutional neural network based segmentation method.
  arXiv  Detail & Related papers  (2021-04-07T09:09:13Z)
• Pose-dependent weights and Domain Randomization for fully automatic X-ray to CT Registration [51.280096834264256]
  Fully automatic X-ray to CT registration requires an initial alignment within the capture range of existing intensity-based registrations. This work provides a novel automatic initialization, which enables end to end registration. The mean (+-standard deviation) target registration error in millimetres is 4.1 +- 4.3 for simulated X-rays with a success rate of 92% and 4.2 +- 3.9 for real X-rays with a success rate of 86.8%, where a success is defined as a translation error of less than 30mm.
  arXiv  Detail & Related papers  (2020-11-14T12:50:32Z)
• Assisted Probe Positioning for Ultrasound Guided Radiotherapy Using Image Sequence Classification [55.96221340756895]
  Effective transperineal ultrasound image guidance in prostate external beam radiotherapy requires consistent alignment between probe and prostate at each session during patient set-up. We demonstrate a method for ensuring accurate probe placement through joint classification of images and probe position data. Using a multi-input multi-task algorithm, spatial coordinate data from an optically tracked ultrasound probe is combined with an image clas-sifier using a recurrent neural network to generate two sets of predictions in real-time. The algorithm identified optimal probe alignment within a mean (standard deviation) range of 3.7$circ$ (1.2$circ$) from
  arXiv  Detail & Related papers  (2020-10-06T13:55:02Z)
• Neural collaborative filtering for unsupervised mitral valve segmentation in echocardiography [60.08918310097638]
  We propose an automated and unsupervised method for the mitral valve segmentation based on a low dimensional embedding of the echocardiography videos. The method is evaluated in a collection of echocardiography videos of patients with a variety of mitral valve diseases and on an independent test cohort. It outperforms state-of-the-art emphunsupervised and emphsupervised methods on low-quality videos or in the case of sparse annotation.
  arXiv  Detail & Related papers  (2020-08-13T12:53:26Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.