Toward surface-based registration of a virtual preoperative cutting guide onto the mandible for reconstruction surgery

• URL: http://arxiv.org/abs/2608.06599v1
• Date: Thu, 06 Aug 2026 21:15:59 GMT
• Title: Toward surface-based registration of a virtual preoperative cutting guide onto the mandible for reconstruction surgery
• Abstract summary: Patient-specific cutting guides transfer a computed tomography (CT)-based plan to the operating room.<n> printed guides add cost and lead time, cannot adapt after fabrication, and may interrupt surgery if sterility is lost.<n>We investigate a markerless augmented reality (AR) alternative that registers a virtual cutting guide to the exposed mandible from surface geometry.
• Score: 8.636647142945273
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mandibular reconstruction restores facial continuity and oral function after segmental resection. Patient-specific cutting guides transfer a computed tomography (CT)-based plan to the operating room with three-dimensional information, but printed guides add cost and lead time, cannot adapt after fabrication, and may interrupt surgery if sterility is lost. We investigate a markerless augmented reality (AR) alternative that registers a virtual cutting guide to the exposed mandible from surface geometry. The method extends surface-based registration for the transoral setting, where teeth form the most distinctive visible surface. After camera calibration, a HoloLens 2 time-of-flight camera captures a partial intraoperative point cloud. The user supplies a rough head-based alignment only to crop the region of interest. A teeth-weighted global stage computes correspondences and solves a truncated least-squares rigid alignment. An asymmetric point-to-plane iterative closest point (ICP) stage refines the complete CT mandible against the partial depth cloud target. The guide-to-mandible transform places the guide in the HoloLens world frame, while pose updates and interpolation follow target motion. We define a blinded phantom protocol with 30 target registration error (TRE) points under full, intermediate, and teeth-only exposure, plus a motion-to-display latency test. Our median TRE is 4.05, 6.10, and 7.10 mm respectively, and median latency is 0.805 s. These values support the feasibility of using AR to replace physical prints. The workflow removes mounted fiducials and manual landmark selection and provides a testable path toward transoral cutting guidance.

Related papers

• A Lightweight Fiducial-Based Pipeline for 3D Hyperspectral Mapping of ex-vivo Lumpectomy Specimens [5.019796206315394]
  We present a fully automated, calibration-free pipeline that produces a 3D hyperspectral point cloud of an ex-vivo lumpectomy specimen.<n>The pipeline achieves a median 3D registration error below 1mm and a 2D reprojection error below 0.02 mm, with a total per-specimen processing time under 4 minutes on accelerated hardware.
  arXiv  Detail & Related papers  (2026-06-12T15:11:50Z)
• Deep learning based Non-Rigid Volume-to-Surface Registration for Brain Shift compensation Using Point Cloud [1.631115063641726]
  Soft-tissue deformation is a major limitation in image-guided neurosurgery.<n>Existing compensation methods rely on intra-operative MRI, CT, or ultrasound.<n>We propose a deep learning-based framework for non-rigid volume-to-surface registration.
  arXiv  Detail & Related papers  (2026-04-19T11:35:07Z)
• Preoperative-to-intraoperative Liver Registration for Laparoscopic Surgery via Latent-Grounded Correspondence Constraints [51.7011449975586]
  Land-Reg is a deformable registration framework that learns latent-grounded 2D-3D landmark correspondences.<n>For rigid registration, Land-Reg embraces a Cross-modal Latent Alignment module.<n>An Uncertainty-enhanced Overlap Landmark Detector with similarity matching is proposed to robustly estimate explicit 2D-3D landmark correspondences.
  arXiv  Detail & Related papers  (2026-03-02T10:44:03Z)
• Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resection [50.388465935739376]
  Liver registration by overlaying preoperative 3D models onto intraoperative 2D frames can assist surgeons in perceiving the spatial anatomy of the liver clearly for a higher surgical success rate.<n>Existing registration methods rely heavily on anatomical landmark-based, which encounter two major limitations.<n>We propose a landmark-free preoperative-to-intraoperative registration framework utilizing effective self-supervised learning.
  arXiv  Detail & Related papers  (2025-04-21T14:55:57Z)
• Intraoperative 2D/3D Image Registration via Differentiable X-ray Rendering [5.617649111108429]
  We present DiffPose, a self-supervised approach that leverages patient-specific simulation and differentiable physics-based rendering to achieve accurate 2D/3D registration without relying on manually labeled data. DiffPose achieves sub-millimeter accuracy across surgical datasets at intraoperative speeds, improving upon existing unsupervised methods by an order of magnitude and even outperforming supervised baselines.
  arXiv  Detail & Related papers  (2023-12-11T13:05:54Z)
• X-Ray to CT Rigid Registration Using Scene Coordinate Regression [1.1687067206676627]
  This paper proposes a fully automatic registration method that is robust to extreme viewpoints. It is based on a fully convolutional neural network (CNN) that regresses the overlapping coordinates for a given X-ray image. The proposed method achieved an average mean target registration error (mTRE) of 3.79 mm in the 50th percentile of the simulated test dataset and projected mTRE of 9.65 mm in the 50th percentile of real fluoroscopic images for pelvis registration.
  arXiv  Detail & Related papers  (2023-11-25T17:48:46Z)
• Coordinate Transformer: Achieving Single-stage Multi-person Mesh Recovery from Videos [91.44553585470688]
  Multi-person 3D mesh recovery from videos is a critical first step towards automatic perception of group behavior in virtual reality, physical therapy and beyond. We propose the Coordinate transFormer (CoordFormer) that directly models multi-person spatial-temporal relations and simultaneously performs multi-mesh recovery in an end-to-end manner. Experiments on the 3DPW dataset demonstrate that CoordFormer significantly improves the state-of-the-art, outperforming the previously best results by 4.2%, 8.8% and 4.7% according to the MPJPE, PAMPJPE, and PVE metrics, respectively.
  arXiv  Detail & Related papers  (2023-08-20T18:23:07Z)
• Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery [52.63271687382495]
  We present an approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner. A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models. An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system.
  arXiv  Detail & Related papers  (2023-08-05T16:26:41Z)
• A Spatiotemporal Model for Precise and Efficient Fully-automatic 3D Motion Correction in OCT [10.550562752812894]
  OCT instruments image by-scanning a focused light spot across the retina, acquiring cross-sectional images to generate data. Patient eye motion during the acquisition poses unique challenges: non-rigid, distorted distortions occur, leading to gaps in data. We present a new distortion model and a corresponding fully-automatic, reference-free optimization strategy for computational robustness.
  arXiv  Detail & Related papers  (2022-09-15T11:48:53Z)
• Deep Negative Volume Segmentation [60.44793799306154]
  We propose a new angle to the 3D segmentation task: segment empty spaces between all the tissues surrounding the object. Our approach is an end-to-end pipeline that comprises a V-Net for bone segmentation. We validate the idea on the CT scans in a 50-patient dataset, annotated by experts in maxillofacial medicine.
  arXiv  Detail & Related papers  (2020-06-22T16:55:23Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.