Occupancy Network-Guided Autonomous Robotic Partial Nephrectomy
- URL: http://arxiv.org/abs/2609.16186v1
- Date: Mon, 14 Sep 2026 18:20:02 GMT
- Title: Occupancy Network-Guided Autonomous Robotic Partial Nephrectomy
- Abstract summary: We introduce the first vision-guided autonomous system capable of performing complete tumor resections for partial nephrectomy.<n>Our system integrates conditional occupancy networks, trained entirely in a physics-based simulation, that infer full 3-D anatomy from single-view partial point clouds.<n>In patient-derived hydrogel phantoms under an open partial nephrectomy setting, the robot performed eight consecutive autonomous tumor resections.
- Score: 4.845781375613018
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Autonomous soft-tissue cancer surgery has been limited to interventions on organ surfaces, because current systems cannot perceive and adapt to anatomy once it deforms or is cut. We introduce the first vision-guided autonomous system capable of performing complete tumor resections for partial nephrectomy. Our system integrates conditional occupancy networks, trained entirely in a physics-based simulation, that infer full 3-D anatomy (tumor, margin tissue, and kidney) from single-view partial point clouds. These occupancy networks maintain intraoperative tracking even as tissue is cut and deformed, enabling adaptive planning and execution. The surgical platform combines a depth camera for capturing surface point clouds, dual robotic arms for electrosurgical cutting and vacuum-based tissue manipulation, and an autonomous control strategy for tumor resection. In patient-derived hydrogel phantoms under an open partial nephrectomy setting, the robot performed eight consecutive autonomous tumor resections comprising 77 electrosurgical cuts, with all cuts achieving negative surgical margins and 1.61 $\pm$ 0.48 mm mean absolute margin error. This work demonstrates, for the first time, a foundation for supervised autonomous closed-loop, imaging-driven, margin-negative tumor removal in phantoms.
Related papers
- AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation [58.56402940400457]
3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis.<n>We introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions.<n>AnaDiffusion produces both explicit part assets and a globally coherent volume, enabling controllable part editing.
arXiv Detail & Related papers (2026-08-24T09:16:42Z) - SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound [60.64817443833982]
We present SAMe, a semantic anatomy mapping engine that provides robotic ultrasound with an explicit anatomical prior layer.<n> SAMe addresses scan initiation as a target-to-anatomy-to-action process.<n>It instantiates a patient-specific anatomical representation for the grounded targets from a single external body image.
arXiv Detail & Related papers (2026-04-28T13:44:09Z) - Brain-WM: Brain Glioblastoma World Model [56.45393372490125]
We present Brain-WM, a pioneering GBM world model that unifies next-step treatment prediction and future MRI generation.<n>Brain-WM encodes latent dynamics into a shared latent space for joint autoregressive treatment prediction and flow-based future MRI generation.<n>Ultimately, Brain-WM offers a robust clinical sandbox for optimizing patient healthcare.
arXiv Detail & Related papers (2026-03-08T09:54:08Z) - Weakly-supervised Mamba-Based Mastoidectomy Shape Prediction for Cochlear Implant Surgery Using 3D T-Distribution Loss [4.777201894011511]
We propose a weakly-supervised Mamba-based framework to predict accurate mastoidectomy regions directly from preoperative CT scans.<n>Our approach utilizes a 3D T-Distribution loss function inspired by the Student-t distribution, which effectively handles the complex geometric variability inherent in mastoidectomy shapes.<n>The proposed method is extensively evaluated against state-of-the-art approaches, demonstrating superior performance in predicting accurate and clinically relevant mastoidectomy regions.
arXiv Detail & Related papers (2025-05-23T20:53:03Z) - From Monocular Vision to Autonomous Action: Guiding Tumor Resection via 3D Reconstruction [8.485401463053098]
We propose a 3D mapping pipeline that uses only RGB images to create segmented point clouds of the target anatomy.<n>In several metrics, including post-procedure tissue model evaluation, our pipeline performs comparably to RGB-D cameras.<n>This study is a step toward the complete autonomy of surgical robots.
arXiv Detail & Related papers (2025-03-20T15:57:18Z) - Autonomous Vision-Guided Resection of Central Airway Obstruction [0.0]
Existing tracheal tumor resection methods often lack the precision required for effective airway clearance.<n>We present a vision-guided, autonomous approach for palliative resection of tracheal tumors.
arXiv Detail & Related papers (2025-02-25T19:11:11Z) - Tracking Tumors under Deformation from Partial Point Clouds using Occupancy Networks [5.6568953226458145]
We introduce a occupancy network-based method for the localization of tumors within kidney phantoms undergoing deformations at interactive speeds.
We validate our method by introducing a 3D hydrogel kidney phantom embedded with exophytic and endophytic renal tumors.
Our findings indicate that the proposed method can localize tumors in moderately deforming kidneys with a margin of 6mm to 10mm, while providing essential volumetric 3D information at over 60Hz.
arXiv Detail & Related papers (2024-11-04T21:15:17Z) - Self-supervised Mamba-based Mastoidectomy Shape Prediction for Cochlear Implant Surgery [3.626734411913593]
We propose a novel Mamba-based method to synthesize the mastoidectomy volume using only preoperative Computed Tomography (CT) scans.<n>Our approach introduces a self-supervised learning framework designed to predict the mastoidectomy shape and reconstruct a 3D post-mastoidectomy surface.<n>Our method achieves a mean Dice score of 0.70 in estimating mastoidectomy regions, demonstrating its effectiveness for accurate and efficient surgical preoperative planning.
arXiv Detail & Related papers (2024-07-22T16:47:29Z) - Automatic registration with continuous pose updates for marker-less
surgical navigation in spine surgery [52.63271687382495]
We present an approach that automatically solves the registration problem for lumbar spinal fusion surgery in a radiation-free manner.
A deep neural network was trained to segment the lumbar spine and simultaneously predict its orientation, yielding an initial pose for preoperative models.
An intuitive surgical guidance is provided thanks to the integration into an augmented reality based navigation system.
arXiv Detail & Related papers (2023-08-05T16:26:41Z) - Robotic Navigation Autonomy for Subretinal Injection via Intelligent
Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
We propose a framework for autonomous robotic navigation for subretinal injection.
Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target.
Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
arXiv Detail & Related papers (2023-01-17T21:41:21Z) - Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of
Articulated Motion [48.52403516006036]
This paper proposes a vision-based approach allowing autonomous robotic US limb scanning.
To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories.
In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
arXiv Detail & Related papers (2022-08-10T15:39:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.