A Deep Learning Approach for Motion Forecasting Using 4D OCT Data

• URL: http://arxiv.org/abs/2004.10121v2
• Date: Mon, 1 Jun 2020 10:53:43 GMT
• Title: A Deep Learning Approach for Motion Forecasting Using 4D OCT Data
• Authors: Marcel Bengs and Nils Gessert and Alexander Schlaefer
• Abstract summary: We propose 4D-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. Our best performing 4D method achieves motion forecasting with an overall average correlation of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.
• Score: 69.62333053044712
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Forecasting motion of a specific target object is a common problem for surgical interventions, e.g. for localization of a target region, guidance for surgical interventions, or motion compensation. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution. Recently, deep learning methods have shown promising performance for OCT-based motion estimation based on two volumetric images. We extend this approach and investigate whether using a time series of volumes enables motion forecasting. We propose 4D spatio-temporal deep learning for end-to-end motion forecasting and estimation using a stream of OCT volumes. We design and evaluate five different 3D and 4D deep learning methods using a tissue data set. Our best performing 4D method achieves motion forecasting with an overall average correlation coefficient of 97.41%, while also improving motion estimation performance by a factor of 2.5 compared to a previous 3D approach.

Related papers

• H4D: Human 4D Modeling by Learning Neural Compositional Representation [75.34798886466311]
  This work presents a novel framework that can effectively learn a compact and compositional representation for dynamic human. A simple yet effective linear motion model is proposed to provide a rough and regularized motion estimation. Experiments demonstrate our method is not only efficacy in recovering dynamic human with accurate motion and detailed geometry, but also amenable to various 4D human related tasks.
  arXiv  Detail & Related papers  (2022-03-02T17:10:49Z)
• Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images [16.759486905827433]
  We provide a novel motion estimation framework of Dense-Sparse-Dense (DSD), which comprises two stages. In the first stage, we process the raw dense image to extract sparse landmarks to represent the target organ anatomical topology. In the second stage, we derive the sparse motion displacement from the extracted sparse landmarks of two images of different time points.
  arXiv  Detail & Related papers  (2021-09-30T02:06:02Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)
• 4D Spatio-Temporal Convolutional Networks for Object Position Estimation in OCT Volumes [69.62333053044712]
  3D convolutional neural networks (CNNs) have shown promising performance for pose estimation of a marker object using single OCT images. We extend 3D CNNs to 4D-temporal CNNs to evaluate the impact of additional temporal information for marker object tracking.
  arXiv  Detail & Related papers  (2020-07-02T12:02:20Z)
• Deep learning with 4D spatio-temporal data representations for OCT-based force estimation [59.405210617831656]
  We extend the problem of deep learning-based force estimation to 4D volumetric-temporal data with streams of 3D OCT volumes. We show that using 4Dterm-temporal data outperforms all previously used data representations with a mean absolute error of 10.7mN.
  arXiv  Detail & Related papers  (2020-05-20T13:30:36Z)
• Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT Image Data [63.73263986460191]
  Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. We investigate whether using a temporal stream of OCT image volumes can improve deep learning-based motion estimation performance. Using 4D information for the model input improves performance while maintaining reasonable inference times.
  arXiv  Detail & Related papers  (2020-04-21T15:43:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.