GuidedRec: Guiding Ill-Posed Unsupervised Volumetric Recovery

• URL: http://arxiv.org/abs/2405.11977v1
• Date: Mon, 20 May 2024 12:13:22 GMT
• Title: GuidedRec: Guiding Ill-Posed Unsupervised Volumetric Recovery
• Authors: Alexandre Cafaro, Amaury Leroy, Guillaume Beldjoudi, Pauline Maury, Charlotte Robert, Eric Deutsch, Vincent Grégoire, Vincent Lepetit, Nikos Paragios,
• Abstract summary: We show how to use a generative model of the volume structures to constrain the deformation and obtain a correct estimate. We evaluate our approach on a challenging dataset and show it outperforms state-of-the-art methods.
• Score: 47.758461573050006
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce a novel unsupervised approach to reconstructing a 3D volume from only two planar projections that exploits a previous\-ly-captured 3D volume of the patient. Such volume is readily available in many important medical procedures and previous methods already used such a volume. Earlier methods that work by deforming this volume to match the projections typically fail when the number of projections is very low as the alignment becomes underconstrained. We show how to use a generative model of the volume structures to constrain the deformation and obtain a correct estimate. Moreover, our method is not bounded to a specific sensor calibration and can be applied to new calibrations without retraining. We evaluate our approach on a challenging dataset and show it outperforms state-of-the-art methods. As a result, our method could be used in treatment scenarios such as surgery and radiotherapy while drastically reducing patient radiation exposure.

Related papers

• Learning Treatment Representations for Downstream Instrumental Variable Regression [18.14729078900216]
  We propose a novel approach to construct treatment representations by explicitly incorporating instrumental variables during the representation learning process.<n>Our approach provides a framework for handling high-dimensional endogenous variables with limited instruments.
  arXiv  Detail & Related papers  (2025-06-02T19:41:23Z)
• Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy [3.1186464715409983]
  We introduce a novel fine-tuning strategy for the Depth Anything Model. We integrate it with an intrinsic-based unsupervised monocular depth estimation framework. Our results on the SCARED dataset show that our method achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-09-12T03:04:43Z)
• Aortic root landmark localization with optimal transport loss for heatmap regression [0.0]
  We propose a highly accurate one-step landmark localization method from even coarse images. We apply the proposed method to the 3D CT image dataset collected at Sendai Kousei Hospital.
  arXiv  Detail & Related papers  (2024-07-06T02:01:48Z)
• Regularized DeepIV with Model Selection [72.17508967124081]
  Regularized DeepIV (RDIV) regression can converge to the least-norm IV solution. Our method matches the current state-of-the-art convergence rate.
  arXiv  Detail & Related papers  (2024-03-07T05:38:56Z)
• Position Regression for Unsupervised Anomaly Detection [0.8999666725996974]
  We propose a novel anomaly detection approach based on coordinate regression. Our method estimates the position of patches within a volume, and is trained only on data of healthy subjects. We show that our method requires less memory than comparable approaches that involve image reconstruction.
  arXiv  Detail & Related papers  (2023-01-19T13:22:11Z)
• Simulator-Based Self-Supervision for Learned 3D Tomography Reconstruction [34.93595625809309]
  Prior machine learning approaches require reference reconstructions computed by another algorithm for training. We train our model in a fully self-supervised manner using only noisy 2D X-ray data. Our results show significantly higher visual fidelity and better PSNR over techniques that rely on existing reconstructions.
  arXiv  Detail & Related papers  (2022-12-14T13:21:37Z)
• Solving Inverse Problems in Medical Imaging with Score-Based Generative Models [87.48867245544106]
  Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) Existing solutions based on machine learning typically train a model to directly map measurements to medical images. We propose a fully unsupervised technique for inverse problem solving, leveraging the recently introduced score-based generative models.
  arXiv  Detail & Related papers  (2021-11-15T05:41:12Z)
• Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction [61.62191904755521]
  3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan. Existing deep learning based methods only focus on the basic cases of skill sequences. We propose a novel approach to sensorless freehand 3D US reconstruction considering the complex skill sequences.
  arXiv  Detail & Related papers  (2021-07-31T16:06:50Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• Simultaneous Estimation of X-ray Back-Scatter and Forward-Scatter using Multi-Task Learning [59.17383024536595]
  Back-scatter significantly contributes to patient (skin) dose during complicated interventions. Forward-scattered radiation reduces contrast in projection images and introduces artifacts in 3-D reconstructions. We propose a novel approach combining conventional techniques with learning-based methods to simultaneously estimate the forward-scatter reaching the detector.
  arXiv  Detail & Related papers  (2020-07-08T10:47:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.