Fluoroscopy-Constrained Magnetic Robot Control via Zernike-Based Field Modeling and Nonlinear MPC

• URL: http://arxiv.org/abs/2602.15357v1
• Date: Tue, 17 Feb 2026 04:50:18 GMT
• Title: Fluoroscopy-Constrained Magnetic Robot Control via Zernike-Based Field Modeling and Nonlinear MPC
• Abstract summary: Magnetic actuation enables surgical robots to navigate complex anatomical pathways while reducing tissue trauma and improving surgical precision.<n>This paper presents a control framework that remains accurate and stable under such conditions by combining a nonlinear model predictive control framework.<n> Experimental validation is conducted with two magnetic robots in a 3D-printed fluid workspace and a spine phantom replicating drug delivery in the epidural space.
• Score: 4.093982213892736
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Magnetic actuation enables surgical robots to navigate complex anatomical pathways while reducing tissue trauma and improving surgical precision. However, clinical deployment is limited by the challenges of controlling such systems under fluoroscopic imaging, which provides low frame rate and noisy pose feedback. This paper presents a control framework that remains accurate and stable under such conditions by combining a nonlinear model predictive control (NMPC) framework that directly outputs coil currents, an analytically differentiable magnetic field model based on Zernike polynomials, and a Kalman filter to estimate the robot state. Experimental validation is conducted with two magnetic robots in a 3D-printed fluid workspace and a spine phantom replicating drug delivery in the epidural space. Results show the proposed control method remains highly accurate when feedback is downsampled to 3 Hz with added Gaussian noise (sigma = 2 mm), mimicking clinical fluoroscopy. In the spine phantom experiments, the proposed method successfully executed a drug delivery trajectory with a root mean square (RMS) position error of 1.18 mm while maintaining safe clearance from critical anatomical boundaries.

Related papers

• Human-Inspired Framework for Robotic Craniotomy: Integrating Multimodal Fusion and Adaptive Trajectory Adjustment [11.44210370034241]
  Manual craniotomy is a high-risk, skill-dependent procedure associated with surgeon fatigue and potential dural injury.<n>We propose a human-inspired closed-loop robotic craniotomy framework that intelligently integrates preoperative planning with intraoperative execution.<n>Experiments on bovine ribs show a breakthrough prediction accuracy of 97%, a detection latency of 0.048 +/- 0.097 s, and a maximum overshoot of 0.29 mm.
  arXiv  Detail & Related papers  (2026-07-23T08:46:42Z)
• Eversion-based robots can enable safe access,steering and endoscopic imaging within the spinal subarachnoid space [7.4000506819669845]
  We present a 2 mm diameter eversion-growing robotic platform that enables friction minimised extension and steering within the human spinal subarachnoid space.<n>The robot integrates a miniature endoscope for real time intrathecal visualisation and advances by pressure driven tip eversion.<n>In an intact human cadaver, the system achieved 150 mm of controlled intrathecal extension with concurrent fluoroscopic and endoscopic visualisation.
  arXiv  Detail & Related papers  (2026-07-21T16:46:00Z)
• Robotic Ultrasound Makes CBCT Alive [40.80821441492365]
  Intraoperative Cone Beam Computed Tomography (CBCT) provides a reliable 3D anatomical context essential for interventional planning.<n>We propose a deformation-aware CBCT updating framework that leverages robotic ultrasound as a dynamic proxy to infer tissue motion and update static CBCT slices in real time.<n>Results demonstrate real-time end-to-end CBCT slice updating and physically plausible deformation estimation, enabling dynamic refinement of static CBCT guidance during robotic ultrasound-assisted interventions.
  arXiv  Detail & Related papers  (2026-03-10T20:37:24Z)
• SurgCalib: Gaussian Splatting-Based Hand-Eye Calibration for Robot-Assisted Minimally Invasive Surgery [14.264710991558124]
  We present a Gaussian Splatting-based framework for hand-eye calibration of the da Vinci surgical robot.<n>In a vision-guided robotic system, accurate estimation of the rigid transformation between the robot base and the camera frame is essential for reliable closed-loop control.
  arXiv  Detail & Related papers  (2026-03-09T22:17:02Z)
• CT-Enabled Patient-Specific Simulation and Contact-Aware Robotic Planning for Cochlear Implantation [41.386729124620366]
  Robotic cochlear-implant insertion requires precise prediction and regulation of contact forces to minimize intracochlear trauma.<n>This paper presents a unified CT-to-simulation pipeline for contact-aware insertion planning and validation.
  arXiv  Detail & Related papers  (2026-03-05T16:13:59Z)
• Modeling and Control of a Pneumatic Soft Robotic Catheter Using Neural Koopman Operators [3.2642164905437503]
  We propose a neural network-enhanced Koopman operator framework for advancing soft robotic catheter systems.<n>Motivated by the need to minimize radiation exposure during X-ray fluoroscopy in cardiac ablation, we investigate open-loop control strategies.<n>Our approach achieves average errors of 2.1 +- 0.4 mm in position and 4.9 +- 0.6 degrees in orientation.
  arXiv  Detail & Related papers  (2026-03-04T14:36:22Z)
• Pitch Angle Control of a Magnetically Actuated Capsule Robot with Nonlinear FEA-based MPC and EKF Multisensory Fusion [0.3694429692322632]
  This paper presents a model-based framework for magnetic pitch control of an ingestible capsule robot actuated by a four-coil electromagnetic array.<n>Experiments on a compliant stomach-inspired surface demonstrate robust pitch reorientation from both horizontal and upright configurations.<n>These results establish finite-element-informed MPC with sensor fusion as a scalable strategy for pitch regulation, controlled docking, and future multi-degree-of-freedom capsule locomotion.
  arXiv  Detail & Related papers  (2026-02-11T07:59:52Z)
• Helical Tendon-Driven Continuum Robot with Programmable Follow-the-Leader Operation [0.11242503819703255]
  The ExoNav is a steerable robotic tool designed to facilitate precise navigation to the ventral and lateral epidural space.<n>Based on the helical shape of the ExoNav upon actuation, it is capable of performing follow-the-leader (FTL) motion.<n>The proposed simulation has the capability to calculate optimum tendon tensions to follow the desired FTL paths.
  arXiv  Detail & Related papers  (2026-01-19T16:03:56Z)
• Non-Intrusive Parametrized-Background Data-Weak Reconstruction of Cardiac Displacement Fields from Sparse MRI-like Observations [0.0]
  We apply the non-intrusive Parametrized Data-Weak (PBDW) approach to 3D cardiac displacement reconstruction from limited MRI-like observations.<n>Our implementation requires only solution snapshots -- no governing equations, assembly routines, or solver access.<n>We demonstrate the effectiveness of the method through validation on a 3D left ventricular model with simulated scar tissue.
  arXiv  Detail & Related papers  (2025-09-18T11:10:24Z)
• The Brain Resection Multimodal Image Registration (ReMIND2Reg) 2025 Challenge [42.51640997446028]
  The ReMIND2Reg 2025 Challenge provides the largest public benchmark for this task, built upon the ReMIND dataset.<n>It offers 99 training cases, 5 validation cases, and 10 private test cases comprising paired 3D ceT1 MRI, T2 MRI, and post-resection 3D iUS volumes.<n>Data are provided without annotations for training, while validation and test performance are evaluated on manually annotated anatomical landmarks.
  arXiv  Detail & Related papers  (2025-08-13T09:31:06Z)
• EndoControlMag: Robust Endoscopic Vascular Motion Magnification with Periodic Reference Resetting and Hierarchical Tissue-aware Dual-Mask Control [10.426745597034204]
  We introduce EndoControlMag, a training-free framework with mask-conditioned vascular motion magnification tailored to endoscopic environments.<n>Our approach features two key modules: a Periodic Reference Resetting scheme that divides videos into short overlapping clips with dynamically updated reference frames to prevent error accumulation.<n>We evaluate EndoControlMag on our EndoVMM24 dataset spanning four different surgery types and various challenging scenarios.
  arXiv  Detail & Related papers  (2025-07-21T06:47:44Z)
• AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers [75.20925220246689]
  endovascular surgeries are performed using the golden standard of Fluoroscopy, which uses ionising radiation to visualise catheters and vasculature. This work proposes a solution using an adaptation of a state-of-the-art machine learning transformer architecture to detect and segment catheters in axial interventional Ultrasound image sequences.
  arXiv  Detail & Related papers  (2023-09-25T19:34:12Z)
• Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion [48.52403516006036]
  This paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
  arXiv  Detail & Related papers  (2022-08-10T15:39:20Z)
• StRegA: Unsupervised Anomaly Detection in Brain MRIs using a Compact Context-encoding Variational Autoencoder [48.2010192865749]
  Unsupervised anomaly detection (UAD) can learn a data distribution from an unlabelled dataset of healthy subjects and then be applied to detect out of distribution samples. This research proposes a compact version of the "context-encoding" VAE (ceVAE) model, combined with pre and post-processing steps, creating a UAD pipeline (StRegA) The proposed pipeline achieved a Dice score of 0.642$pm$0.101 while detecting tumours in T2w images of the BraTS dataset and 0.859$pm$0.112 while detecting artificially induced anomalies.
  arXiv  Detail & Related papers  (2022-01-31T14:27:35Z)
• SCPM-Net: An Anchor-free 3D Lung Nodule Detection Network using Sphere Representation and Center Points Matching [47.79483848496141]
  We propose a 3D sphere representation-based center-points matching detection network (SCPM-Net) It is anchor-free and automatically predicts the position, radius, and offset of nodules without the manual design of nodule/anchor parameters. We show that our proposed SCPM-Net framework achieves superior performance compared with existing used anchor-based and anchor-free methods for lung nodule detection.
  arXiv  Detail & Related papers  (2021-04-12T05:51:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.