PinPoint: Monocular Needle Pose Estimation for Robotic Suturing via Stein Variational Newton and Geometric Residuals

• URL: http://arxiv.org/abs/2603.23365v1
• Date: Tue, 24 Mar 2026 15:59:28 GMT
• Title: PinPoint: Monocular Needle Pose Estimation for Robotic Suturing via Stein Variational Newton and Geometric Residuals
• Abstract summary: PinPoint is a probabilistic variational inference framework for estimation of surgical needle 3D position and orientation.<n>On real needle-tracking sequences, PinPoint reduces mean translational error by 80% (down to 1.00 mm) and rotational error by 78% (down to 13.80)<n>On induced-rotation sequences, where monocular ambiguity is most severe, PinPoint maintains a bimodal posterior 84% of the time.
• Score: 3.1332682125418074
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reliable estimation of surgical needle 3D position and orientation is essential for autonomous robotic suturing, yet existing methods operate almost exclusively under stereoscopic vision. In monocular endoscopic settings, common in transendoscopic and intraluminal procedures, depth ambiguity and rotational symmetry render needle pose estimation inherently ill-posed, producing a multimodal distribution over feasible configurations, rather than a single, well-grounded estimate. We present PinPoint, a probabilistic variational inference framework that treats this ambiguity directly, maintaining a distribution of pose hypotheses rather than suppressing it. PinPoint combines monocular image observations with robot-grasp constraints through analytical geometric likelihoods with closed-form Jacobians. This framework enables efficient Gauss-Newton preconditioning in a Stein Variational Newton inference, where second-order particle transport deterministically moves particles toward high-probability regions while kernel-based repulsion preserves diversity in the multimodal structure. On real needle-tracking sequences, PinPoint reduces mean translational error by 80% (down to 1.00 mm) and rotational error by 78% (down to 13.80°) relative to a particle-filter baseline, with substantially better-calibrated uncertainty. On induced-rotation sequences, where monocular ambiguity is most severe, PinPoint maintains a bimodal posterior 84% of the time, almost three times the rate of the particle filter baseline, correctly preserving the alternative hypothesis rather than committing prematurely to one mode. Suturing experiments in ex vivo tissue demonstrate stable tracking through intermittent occlusion, with average errors during occlusion of 1.34 mm in translation and 19.18° in rotation, even when the needle is fully embedded.

Related papers

• Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach [0.0]
  Parkinson's disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control.<n> automated freezing-of-gait (FOG) detection supports the objective assessment of gait-related motor impairment.<n>Two common approaches are used for FOG prediction: (i) analysing video recordings of the patient's movements and (ii) analysing data collected using inertial measurement unit (IMU) wearable sensors attached to the patient's lower limbs.<n>Video-based approaches may suffer detection errors during continuous turning-in-place tasks because the lower limbs undergo substantial geometric self-occlusion, degrading pose-estimation accuracy.
  arXiv  Detail & Related papers  (2026-09-09T07:29:13Z)
• Beyond Control Points: Arcsecond Relative-Motion Estimation of Vision Measurement Platforms With Incomplete or Absent Control Fields [43.43572961146893]
  We develop a control-adaptive differential framework that estimates platform motion directly from image displacements and known 3D points.<n>We derive the rotation observability condition, a leakage bound for unmodeled translation and nonrigid point motion, and the single-point axial-prior bias law.
  arXiv  Detail & Related papers  (2026-08-14T03:41:30Z)
• Collider Spin Tomography with Missing Neutrinos [23.51923401381968]
  We formulate the visible measurement under kinematic ambiguities arising from invisible particles as a coarse-grained positive-operator-valued measure on the production spin density matrix.<n>We show that information loss is governed by the null space of the resulting visible-data map, not by the number of kinematic solutions.
  arXiv  Detail & Related papers  (2026-07-30T15:18:12Z)
• Distributionally Faithful Imputation via Positive Semi-Definite Kernel Density Estimation [55.47411235954028]
  We recast imputation under missing completely at random as density estimation from masked observations.<n>We obtain a convex empirical risk problem with closed form marginals, solvable by a Newton interior point method.<n>The resulting PSD Impute model yields both single and multiple imputations from the same fitted density.
  arXiv  Detail & Related papers  (2026-07-08T15:51:05Z)
• Multirate characterization of relaxation mechanisms for two nonequivalent nuclear spins 1/2 in a liquid using maximally entangled pseudo-pure quantum states [41.99844472131922]
  Multirate characterization of spin responses in nuclear magnetic resonance (NMR) is a promising approach to fingerprinting complex molecules.<n>We present experimental and theoretical investigations simultaneously accessing 8 relaxation rates describing the density matrix of two adjacent nonequivalent nuclear spins.
  arXiv  Detail & Related papers  (2026-04-29T21:42:37Z)
• Towards Scalable Probabilistic Human Motion Prediction with Gaussian Processes for Safe Human-Robot Collaboration [6.846949601451734]
  We propose a structured variational Gaussian Process (GP) framework for full-body human motion prediction.<n>Our model achieves up to 50 lower kernel density estimate negative log-likelihood (KDE NLL) than strong baselines.<n>Despite its probabilistic formulation, our model requires only 0.24-0.35 M parameters, roughly eight times fewer than comparable approaches.
  arXiv  Detail & Related papers  (2026-03-07T08:11:46Z)
• Fluoroscopy-Constrained Magnetic Robot Control via Zernike-Based Field Modeling and Nonlinear MPC [4.093982213892736]
  Magnetic actuation enables surgical robots to navigate complex anatomical pathways while reducing tissue trauma and improving surgical precision.<n>This paper presents a control framework that remains accurate and stable under such conditions by combining a nonlinear model predictive control framework.<n> Experimental validation is conducted with two magnetic robots in a 3D-printed fluid workspace and a spine phantom replicating drug delivery in the epidural space.
  arXiv  Detail & Related papers  (2026-02-17T04:50:18Z)
• Convolutional Surrogate for 3D Discrete Fracture-Matrix Tensor Upscaling [0.0]
  We develop a surrogate model that predicts the equivalent hydraulic conductivity tensor Keq from a voxelized 3D domain.<n>Three surrogates are trained on data generated by DFM simulations, each corresponding to a different fracture-to-matrix conductivity contrast.<n>The trained models achieve high accuracy, with normalized root-mean-square errors below 0.22 across most test cases.
  arXiv  Detail & Related papers  (2026-01-19T23:53:58Z)
• A Concept of Two-Point Propagation Field of a Single Photon: A Way to Picometer X-ray Displacement Sensing and Nanometer Resolution 3D X-ray Micro-Tomography [0.0]
  Two-point propagation field (TPPF) is functional derivative of single-photon detection probability.<n>Structure enables shot-noise-limited displacement sensing at 15 pm precision.
  arXiv  Detail & Related papers  (2025-12-19T18:10:45Z)
• Departures: Distributional Transport for Single-Cell Perturbation Prediction with Neural Schrödinger Bridges [51.83259180910313]
  A major bottleneck in gene function analysis is the unpaired nature of single-cell data.<n>We approximate Schrdinger Bridge (SB) to tackle unpaired single-cell perturbation data.<n>Our model effectively captures heterogeneous single-cell responses and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2025-11-17T08:27:13Z)
• Pose-Free 3D Quantitative Phase Imaging of Flowing Cellular Populations [11.956999773396054]
  We introduce OmniFHT, a pose-free 3D reconstruction framework for high- throughput tomographic imaging.<n>By jointly optimizing each cell's unknown rotational and volumetric structure, OmniFHT supports arbitrary cell geometries and multi-axis rotations.<n>Its continuous representation also allows accurate reconstruction from sparsely sampled projections.
  arXiv  Detail & Related papers  (2025-09-05T06:58:39Z)
• Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts [80.32933059529135]
  Test-Time Adaptation (TTA) methods have emerged to adapt to target distributions during inference.<n>We propose Dual Uncertainty Optimization (DUO), the first TTA framework designed to jointly minimize both uncertainties for robust M3OD.<n>In parallel, we design a semantic-aware normal field constraint that preserves geometric coherence in regions with clear semantic cues.
  arXiv  Detail & Related papers  (2025-08-28T07:09:21Z)
• NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation [53.25973084799954]
  We present NIKI (Neural Inverse Kinematics with Invertible Neural Network), which models bi-directional errors. NIKI can learn from both the forward and inverse processes with invertible networks.
  arXiv  Detail & Related papers  (2023-05-15T12:13:24Z)
• Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularization [73.04187954213471]
  We introduce a unified learning approach to simultaneously modeling the coarse- and fine-grained retrieval. The proposed method has achieved +4.03%, +3.38%, and +2.40% Recall@50 accuracy over a strong baseline.
  arXiv  Detail & Related papers  (2022-11-14T14:25:40Z)
• Orthogonal Matrix Retrieval with Spatial Consensus for 3D Unknown-View Tomography [58.60249163402822]
  Unknown-view tomography (UVT) reconstructs a 3D density map from its 2D projections at unknown, random orientations. The proposed OMR is more robust and performs significantly better than the previous state-of-the-art OMR approach.
  arXiv  Detail & Related papers  (2022-07-06T21:40:59Z)
• Robust Self-Supervised Learning of Deterministic Errors in Single-Plane (Monoplanar) and Dual-Plane (Biplanar) X-ray Fluoroscopy [2.7528170226206443]
  Fluoroscopic imaging that captures X-ray images at video framerates is advantageous for guiding catheter insertions by vascular surgeons and interventional radiologists. Visualizing the dynamical movements non-invasively allows complex surgical procedures to be performed with less trauma to the patient. This paper presents a robust self-calibration algorithm suitable for single-plane and dual-plane fluoroscopy.
  arXiv  Detail & Related papers  (2020-01-03T01:56:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.