Appearance Learning for Image-based Motion Estimation in Tomography

• URL: http://arxiv.org/abs/2006.10390v1
• Date: Thu, 18 Jun 2020 09:49:11 GMT
• Title: Appearance Learning for Image-based Motion Estimation in Tomography
• Abstract summary: In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
• Score: 60.980769164955454
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Geometric information within this process is usually depending on the system setting only, i. e., the scanner position or readout direction. Patient motion therefore corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object. To this end, we train a siamese triplet network to predict the reprojection error (RPE) for the complete acquisition as well as an approximate distribution of the RPE along the single views from the reconstructed volume in a multi-task learning approach. The RPE measures the motioninduced geometric deviations independent of the object based on virtual marker positions, which are available during training. We train our network using 27 patients and deploy a 21-4-2 split for training, validation and testing. In average, we achieve a residual mean RPE of 0.013mm with an inter-patient standard deviation of 0.022 mm. This is twice the accuracy compared to previously published results. In a motion estimation benchmark the proposed approach achieves superior results in comparison with two state-of-the-art measures in nine out of twelve experiments. The clinical applicability of the proposed method is demonstrated on a motion-affected clinical dataset.

Related papers

• Deformable State Estimation for Autonomous Surgical Tissue Retraction Under Partial Observability [1.376408511310322]
  We study state estimation for deformable tissue retraction, where only sparse observations of the tissue surface are available at decision time.<n>We propose a learned state estimator that reconstructs the full deformable mesh state from 40 noisy observations.
  arXiv  Detail & Related papers  (2026-07-15T06:07:57Z)
• Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts [56.74856091904914]
  We propose a unified framework combining parameter-informed contrast disentanglement with severity-aware adaptive correction.<n>ScanCLIP derives contrast embeddings from acquisition parameters to disentangle contrast style from anatomical content, yielding contrast-free features.<n>A Vision Transformer then estimates motion severity and routes features through a Mixture-of-Experts network, enabling targeted artifact correction.
  arXiv  Detail & Related papers  (2026-05-29T02:48:23Z)
• Assessment of the quantitative impact of occlusal positioning splints on temporomandibular joint conditions [0.0]
  A computational method for quantitative analysis of temporomandibular joint (TMJ) configuration is proposed and demonstrated.<n>The method models a positioning splint as a physical realization of a predefined rigid transformation of the mandible.<n>Splints corresponding to selected mandibular positions are designed and fabricated, and their positioning accuracy is evaluated.
  arXiv  Detail & Related papers  (2026-04-28T07:37:16Z)
• T-Gated Adapter: A Lightweight Temporal Adapter for Vision-Language Medical Segmentation [0.0]
  Medical image segmentation traditionally relies on fully supervised 3D architectures.<n>We propose a temporal adapter that addresses this by injecting adjacent-slice context directly into the model's visual token representations.<n>Our method achieves a mean Dice of 0.704 across 13 abdominal organs with a gain of +0.206 over the baseline VLM trained with no temporal context.
  arXiv  Detail & Related papers  (2026-04-09T12:27:50Z)
• Semantic Segmentation for Preoperative Planning in Transcatheter Aortic Valve Replacement [61.573750959726475]
  We consider medical guidelines for preoperative planning of the transcatheter aortic valve replacement (TAVR) and identify tasks that may be supported via semantic segmentation models.<n>We first derive fine-grained TAVR-relevant pseudo-labels from coarse-grained anatomical information, in order to train segmentation models and quantify how well they are able to find these structures in the scans.
  arXiv  Detail & Related papers  (2025-07-22T13:24:45Z)
• Improved Trajectory Reconstruction for Markerless Pose Estimation [0.0]
  Markerless pose estimation allows reconstructing human movement from multiple synchronized and calibrated views. We tested different keypoint detectors and reconstruction algorithms on markerless pose estimation accuracy. We found that using a top-down keypoint detector and reconstructing trajectories with an implicit function enabled accurate, smooth and anatomically plausible trajectories.
  arXiv  Detail & Related papers  (2023-03-04T13:16:02Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation [51.916106055115755]
  We propose a new CNN architecture that is pose and scale invariant thanks to the use of Spatial Transformer Network (STN) Our architecture is composed of three sequential modules that are estimated together during training. We test the proposed method in kidney and renal tumor segmentation on abdominal pediatric CT scanners.
  arXiv  Detail & Related papers  (2021-07-06T14:50:03Z)
• Learning to recover orientations from projections in single-particle cryo-EM [0.0]
  A major challenge in single-particle cryo-electron microscopy (cryo-EM) is that the orientations adopted by the 3D particles prior to imaging are unknown. We present a method to recover these orientations directly from the acquired set of 2D projections. Our approach consists of two steps: (i) the estimation of distances between pairs of projections, and (ii) the recovery of the orientation of each projection from these distances.
  arXiv  Detail & Related papers  (2021-04-13T14:31:37Z)
• Robustness Investigation on Deep Learning CT Reconstruction for Real-Time Dose Optimization [8.036721491921218]
  A preliminary CT reconstruction is necessary to estimate organ shapes for dose optimization. In this work, we investigate the performance of automated transform by manifold approximation (AUTOMAP) in such applications. We train the AUTOMAP model for image reconstruction from 2 projections or 4 projections directly. The test images reach an average root-mean-square error of 290 HU.
  arXiv  Detail & Related papers  (2020-12-07T10:55:54Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• Enhanced 3D Myocardial Strain Estimation from Multi-View 2D CMR Imaging [0.0]
  We propose an enhanced 3D myocardial strain estimation procedure, which combines complementary displacement information from multiple orientations of a single imaging modality (untagged CMR SSFP images) We register the sets of short-axis, four-chamber and two-chamber views via a 2D non-rigid registration algorithm implemented in a commercial software (Segment, Medviso) We then create a series of interpolating functions for the three directions of motion and use them to deform a tetrahedral mesh representation of a patient-specific left ventricle.
  arXiv  Detail & Related papers  (2020-09-25T22:47:50Z)
• Inertial Measurements for Motion Compensation in Weight-bearing Cone-beam CT of the Knee [6.7461735822055715]
  Involuntary motion during CT scans of the knee causes artifacts in the reconstructed volumes making them unusable for clinical diagnosis. We propose to attach an inertial measurement unit (IMU) to the leg of the subject in order to measure the motion during the scan and correct for it.
  arXiv  Detail & Related papers  (2020-07-09T09:26:27Z)
• A Novel Approach for Correcting Multiple Discrete Rigid In-Plane Motions Artefacts in MRI Scans [63.28835187934139]
  We propose a novel method for removing motion artefacts using a deep neural network with two input branches. The proposed method can be applied to artefacts generated by multiple movements of the patient.
  arXiv  Detail & Related papers  (2020-06-24T15:25:11Z)
• 4D Deep Learning for Multiple Sclerosis Lesion Activity Segmentation [49.32653090178743]
  We investigate whether extending this problem to full 4D deep learning using a history of MRI volumes can improve performance. We find that our proposed architecture outperforms previous approaches with a lesion-wise true positive rate of 0.84 at a lesion-wise false positive rate of 0.19.
  arXiv  Detail & Related papers  (2020-04-20T11:41:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.