Marker-free deformable registration and fusion for augmented reality-guided positive margin localization during tumor resection surgery

• URL: http://arxiv.org/abs/2607.13343v1
• Date: Wed, 15 Jul 2026 00:06:52 GMT
• Title: Marker-free deformable registration and fusion for augmented reality-guided positive margin localization during tumor resection surgery
• Abstract summary: Positive margins in head and neck oncologic surgery require mapping specimen-side pathology findings to the patient resection bed.<n>This is challenging because pathologists identify the positive margin on slices of the resected, deformed specimen.<n>We present a marker-free augmented reality (AR) workflow for mapping a margin label from a three-dimensional specimen scan to the resection bed.
• Score: 6.413736566165252
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Positive margins in head and neck oncologic surgery require mapping specimen-side pathology findings to the patient resection bed. This is challenging because pathologists identify the positive margin on slices of the resected, deformed specimen, while surgeons must relocate the corresponding site on the resection bed using only verbal descriptions and no visual guidance. We present a marker-free augmented reality (AR) workflow for mapping a margin label from a three-dimensional specimen scan to the resection bed. The method combines contour-constrained deformation, residual alignment to a depth scan, surface-based fusion to a head-mounted display, and target projection onto the reconstructed bed. Bead-suture correspondences estimate specimen deformation, whereas patient-to-display fusion does not require external fiducial markers. Following formative experiments, five residents and surgeons performed cadaveric cheek and scalp re-resection tasks under verbal guidance, verbal guidance with specimen examination, and AR guidance. Deformation target errors were $7.63 \pm 3.74$ mm for the cheek and $3.72 \pm 1.02$ mm for the scalp; residual specimen-to-bed distances were $2.43 \pm 2.15$ mm and $2.19 \pm 1.06$ mm, respectively. Fusion error did not differ significantly between marker-free and marker-based methods on either cadaver; overall marker-free fusion error was $2.15 \pm 0.87$ mm. End-to-end margin localization error decreased from $21.40 \pm 3.84$ mm with verbal guidance and $16.09 \pm 4.30$ mm with specimen examination to $6.19 \pm 1.79$ mm with AR guidance ($p < 0.001$). Online fusion required $5.23 \pm 0.34$ s. These results demonstrate effective marker-free AR guidance for positive-margin localization and support more precise tumor resection.

Related papers

• Text-Guided Refinement of Multi-sequence Glioma Subregion Segmentation with a Vision-Language Foundation Model [5.368430154049423]
  3D vision-language foundation model can perform instruction-guided refinement of glioma subregion segmentations.<n> sensitivity to correct, blank, and contradictory prompts suggests text-dependent contour editing rather than nonspecific post-processing.
  arXiv  Detail & Related papers  (2026-08-05T20:17:02Z)
• Contour-Constrained Deformable Registration with Parameter Characterization for Head and Neck Surgical Guidance [1.77256810223988]
  We present a biomechanics-driven deformable registration framework that corrects post-resection tissue deformation to provide intraoperative guidance.<n>Across nine specimens from skin, buccal mucosa, and tongue sites, the overall mean target registration error was $11.11 pm 4.07$ mm using rigid registration.<n>The proposed contour-constrained deformable registration further reduced the error to $5.62 pm 2.28$ mm, a 49.41% reduction relative to rigid registration.
  arXiv  Detail & Related papers  (2026-06-18T04:07:26Z)
• All-in-One Augmented Reality Guided Head and Neck Tumor Resection [6.038527309965889]
  We present an all-in-one augmented reality (AR) system that relocalizes positive margins from a resected specimen to the resection bed.<n>In a silicone phantom study with six medical trainees, markerless registration achieved target registration errors comparable to a marker-based baseline.
  arXiv  Detail & Related papers  (2026-03-31T09:38:52Z)
• Hide-and-Seek Attribution: Weakly Supervised Segmentation of Vertebral Metastases in CT [68.09387763135236]
  We introduce a weakly supervised method trained solely on vertebra-level healthy/malignant labels, without any lesion masks.<n>We achieve strong blastic/lytic performance despite no mask supervision.
  arXiv  Detail & Related papers  (2025-12-07T14:03:28Z)
• Dealing with Segmentation Errors in Needle Reconstruction for MRI-Guided Brachytherapy [0.0]
  We propose adaptations to existing post-processing techniques aimed at dealing with segmentation errors and improving the reconstruction accuracy.<n> Experiments on a prostate cancer dataset, based on MRI scans annotated by medical professionals, demonstrate that our proposed adaptations can help to effectively manage segmentation errors.
  arXiv  Detail & Related papers  (2025-07-25T02:35:04Z)
• Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery [52.63271687382495]
  We present an approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner. A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models. An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system.
  arXiv  Detail & Related papers  (2023-08-05T16:26:41Z)
• Thoracic Cartilage Ultrasound-CT Registration using Dense Skeleton Graph [49.11220791279602]
  It is challenging to accurately map planned paths from a generic atlas to individual patients, particularly for thoracic applications. A graph-based non-rigid registration is proposed to enable transferring planned paths from the atlas to the current setup.
  arXiv  Detail & Related papers  (2023-07-07T18:57:21Z)
• Automated cross-sectional view selection in CT angiography of aortic dissections with uncertainty awareness and retrospective clinical annotations [11.415942647070796]
  We show how manual annotations routinely collected in a clinic can be efficiently used to ease this task. Ill-posed but repetitive imaging tasks can be eased or automated by leveraging imperfect, retrospective clinical annotations.
  arXiv  Detail & Related papers  (2021-11-22T15:11:36Z)
• Controlling False Positive/Negative Rates for Deep-Learning-Based Prostate Cancer Detection on Multiparametric MR images [58.85481248101611]
  We propose a novel PCa detection network that incorporates a lesion-level cost-sensitive loss and an additional slice-level loss based on a lesion-to-slice mapping function. Our experiments based on 290 clinical patients concludes that 1) The lesion-level FNR was effectively reduced from 0.19 to 0.10 and the lesion-level FPR was reduced from 1.03 to 0.66 by changing the lesion-level cost.
  arXiv  Detail & Related papers  (2021-06-04T09:51:27Z)
• A Convolutional Approach to Vertebrae Detection and Labelling in Whole Spine MRI [70.04389979779195]
  We propose a novel convolutional method for the detection and identification of vertebrae in whole spine MRIs. This involves using a learnt vector field to group detected vertebrae corners together into individual vertebral bodies. We demonstrate the clinical applicability of this method, using it for automated scoliosis detection in both lumbar and whole spine MR scans.
  arXiv  Detail & Related papers  (2020-07-06T09:37:12Z)
• Vertebra-Focused Landmark Detection for Scoliosis Assessment [54.24477530836629]
  We propose a novel vertebra-focused landmark detection method. Our model first localizes the vertebra centers, based on which it then traces the four corner landmarks of the vertebra through the learned corner offset. Results demonstrate the merits of our method in both Cobb angle measurement and landmark detection on low-contrast and ambiguous X-ray images.
  arXiv  Detail & Related papers  (2020-01-09T19:17:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.