Landmark Tracking in Liver US images Using Cascade Convolutional Neural Networks with Long Short-Term Memory

• URL: http://arxiv.org/abs/2209.06952v1
• Date: Wed, 14 Sep 2022 22:01:20 GMT
• Title: Landmark Tracking in Liver US images Using Cascade Convolutional Neural Networks with Long Short-Term Memory
• Authors: Yupei Zhang, Xianjin Dai, Zhen Tian, Yang Lei, Jacob F. Wynne, Pretesh Patel, Yue Chen, Tian Liu and Xiaofeng Yang
• Abstract summary: This study proposed a deep learning-based tracking method for ultrasound (US) image-guided radiation therapy. The proposed model was tested on the liver US tracking datasets used in the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 challenges.
• Score: 9.49563286905127
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study proposed a deep learning-based tracking method for ultrasound (US) image-guided radiation therapy. The proposed cascade deep learning model is composed of an attention network, a mask region-based convolutional neural network (mask R-CNN), and a long short-term memory (LSTM) network. The attention network learns a mapping from a US image to a suspected area of landmark motion in order to reduce the search region. The mask R-CNN then produces multiple region-of-interest (ROI) proposals in the reduced region and identifies the proposed landmark via three network heads: bounding box regression, proposal classification, and landmark segmentation. The LSTM network models the temporal relationship among the successive image frames for bounding box regression and proposal classification. To consolidate the final proposal, a selection method is designed according to the similarities between sequential frames. The proposed method was tested on the liver US tracking datasets used in the Medical Image Computing and Computer Assisted Interventions (MICCAI) 2015 challenges, where the landmarks were annotated by three experienced observers to obtain their mean positions. Five-fold cross-validation on the 24 given US sequences with ground truths shows that the mean tracking error for all landmarks is 0.65+/-0.56 mm, and the errors of all landmarks are within 2 mm. We further tested the proposed model on 69 landmarks from the testing dataset that has a similar image pattern to the training pattern, resulting in a mean tracking error of 0.94+/-0.83 mm. Our experimental results have demonstrated the feasibility and accuracy of our proposed method in tracking liver anatomic landmarks using US images, providing a potential solution for real-time liver tracking for active motion management during radiation therapy.

Related papers

• On the Localization of Ultrasound Image Slices within Point Distribution Models [84.27083443424408]
  Thyroid disorders are most commonly diagnosed using high-resolution Ultrasound (US) Longitudinal tracking is a pivotal diagnostic protocol for monitoring changes in pathological thyroid morphology. We present a framework for automated US image slice localization within a 3D shape representation.
  arXiv  Detail & Related papers  (2023-09-01T10:10:46Z)
• Multi-View Vertebra Localization and Identification from CT Images [57.56509107412658]
  We propose a multi-view vertebra localization and identification from CT images. We convert the 3D problem into a 2D localization and identification task on different views. Our method can learn the multi-view global information naturally.
  arXiv  Detail & Related papers  (2023-07-24T14:43:07Z)
• End-to-end Deformable Attention Graph Neural Network for Single-view Liver Mesh Reconstruction [2.285821277711784]
  We propose a novel end-to-end attention graph neural network model that generates in real-time a triangular shape of the liver. The proposed method achieves results with an average error of 3.06 +- 0.7 mm and Chamfer distance with L2 norm of 63.14 +- 27.28.
  arXiv  Detail & Related papers  (2023-03-13T19:15:49Z)
• Two-Stream Graph Convolutional Network for Intra-oral Scanner Image Segmentation [133.02190910009384]
  We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes. Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
  arXiv  Detail & Related papers  (2022-04-19T10:41:09Z)
• Multiple Sclerosis Lesions Segmentation using Attention-Based CNNs in FLAIR Images [0.2578242050187029]
  Multiple Sclerosis (MS) is an autoimmune, and demyelinating disease that leads to lesions in the central nervous system. Up to now a multitude of multimodality automatic biomedical approaches is used to segment lesions. Authors propose a method employing just one modality (FLAIR image) to segment MS lesions accurately.
  arXiv  Detail & Related papers  (2022-01-05T21:37:43Z)
• CNN Filter Learning from Drawn Markers for the Detection of Suggestive Signs of COVID-19 in CT Images [58.720142291102135]
  We propose a method that does not require either large annotated datasets or backpropagation to estimate the filters of a convolutional neural network (CNN) For a few CT images, the user draws markers at representative normal and abnormal regions. The method generates a feature extractor composed of a sequence of convolutional layers, whose kernels are specialized in enhancing regions similar to the marked ones.
  arXiv  Detail & Related papers  (2021-11-16T15:03:42Z)
• Multipath CNN with alpha matte inference for knee tissue segmentation from MRI [2.064612766965483]
  This paper presents a deep learning based automatic segmentation framework for knee tissue segmentation. A novel multipath CNN-based method is proposed, which consists of a decoder-based segmentation network in combination with a low rank tensor-reconstructed segmentation network. To further improve the segmentation from CNNs, trimap generation, which effectively utilizes superimposed regions, is proposed.
  arXiv  Detail & Related papers  (2021-09-29T07:48:47Z)
• Optimising Knee Injury Detection with Spatial Attention and Validating Localisation Ability [0.5772546394254112]
  This work employs a pre-trained, multi-view Convolutional Neural Network (CNN) with a spatial attention block to optimise knee injury detection. An open-source Magnetic Resonance Imaging (MRI) data set with image-level labels was leveraged for this analysis.
  arXiv  Detail & Related papers  (2021-08-18T13:24:17Z)
• Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction [57.74609918453932]
  Automatic blood vessel extraction from 3D medical images is crucial for vascular disease diagnoses. Existing methods may suffer from discontinuities of extracted vessels when segmenting such thin tubular structures from 3D images. We argue that preserving the continuity of extracted vessels requires to take into account the global geometry. We propose a hybrid representation learning approach to address this challenge.
  arXiv  Detail & Related papers  (2020-12-14T05:22:49Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Volumetric landmark detection with a multi-scale shift equivariant neural network [16.114319747246334]
  We propose a multi-scale, end-to-end deep learning method that achieves fast and memory-efficient landmark detection in 3D images. We evaluate our method for carotid artery bifurcations detection on 263 CT volumes and achieve a better than state-of-the-art accuracy with mean Euclidean distance error of 2.81mm.
  arXiv  Detail & Related papers  (2020-03-03T17:06:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.