Neural Collision Detection for Multi-arm Laparoscopy Surgical Robots Through Learning-from-Simulation
- URL: http://arxiv.org/abs/2601.15459v1
- Date: Wed, 21 Jan 2026 20:54:35 GMT
- Title: Neural Collision Detection for Multi-arm Laparoscopy Surgical Robots Through Learning-from-Simulation
- Abstract summary: This study presents an integrated framework for enhancing the safety and operational efficiency of robotic arms in laparoscopic surgery.<n>An analytical model was developed to estimate the minimum distances between robotic arms based on their joint configurations.<n>A deep neural network model was trained with joint actuators of robot arms and relative positions as inputs, achieving a mean absolute error of 282.2 mm and an R-squared value of 0.85.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This study presents an integrated framework for enhancing the safety and operational efficiency of robotic arms in laparoscopic surgery by addressing key challenges in collision detection and minimum distance estimation. By combining analytical modeling, real-time simulation, and machine learning, the framework offers a robust solution for ensuring safe robotic operations. An analytical model was developed to estimate the minimum distances between robotic arms based on their joint configurations, offering precise theoretical calculations that serve as both a validation tool and a benchmark. To complement this, a 3D simulation environment was created to model two 7-DOF Kinova robotic arms, generating a diverse dataset of configurations for collision detection and distance estimation. Using these insights, a deep neural network model was trained with joint actuators of robot arms and relative positions as inputs, achieving a mean absolute error of 282.2 mm and an R-squared value of 0.85. The close alignment between predicted and actual distances highlights the network's accuracy and its ability to generalize spatial relationships. This work demonstrates the effectiveness of combining analytical precision with machine learning algorithms to enhance the precision and reliability of robotic systems.
Related papers
- RC-NF: Robot-Conditioned Normalizing Flow for Real-Time Anomaly Detection in Robotic Manipulation [68.7948300643741]
We propose Robot-Conditioned Normalizing Flow (RC-NF), a real-time monitoring model for robotic anomaly detection and intervention.<n>RC-NF decouples the processing of task-aware robot and object states within the normalizing flow.<n>It achieves state-of-the-art performance across all anomaly types compared to previous methods in monitoring robotic tasks.
arXiv Detail & Related papers (2026-03-11T10:14:37Z) - Shape Control of a Planar Hyper-Redundant Robot via Hybrid Kinematics-Informed and Learning-based Approach [42.55947704321053]
Hyper-redundant robots offer high dexterity, making them good at operating in confined and unstructured environments.<n>To extend the reachable workspace, we built a multi-segment flexible rack actuated planar robot.<n>We propose a hybrid kinematics-informed and learning-based shape control method, named SpatioCoupledNet.
arXiv Detail & Related papers (2026-03-11T04:35:06Z) - D-REX: Differentiable Real-to-Sim-to-Real Engine for Learning Dexterous Grasping [66.22412592525369]
We introduce a real-to-sim-to-real engine that leverages the Gaussian Splat representations to build a differentiable engine.<n>We show that our engine achieves accurate and robust performance in mass identification across various object geometries and mass values.<n>Those optimized mass values facilitate force-aware policy learning, achieving superior and high performance in object grasping.
arXiv Detail & Related papers (2026-03-01T15:32:04Z) - Pro-HOI: Perceptive Root-guided Humanoid-Object Interaction [57.252599851031505]
We introduce Perceptive Root-guided Humanoid-Object Interaction, Pro-HOI.<n>Pro-HOI is a generalizable framework for robust humanoid loco-manipulation.<n> Empirical validation on a Unitree G1 robot demonstrates that Pro-HOI significantly outperforms baselines in generalization and robustness.
arXiv Detail & Related papers (2026-03-01T14:19:59Z) - Data-Driven Dynamic Parameter Learning of manipulator robots [0.8679862302950613]
We propose a Transformer-based approach for dynamic parameter estimation.<n>The dataset consists of 8,192 robots with varied inertial and frictional properties.<n>Our model effectively captures both temporal and spatial dependencies.
arXiv Detail & Related papers (2025-12-09T16:15:58Z) - URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model [76.08429266631823]
We propose an end-to-end automatic reconstruction framework based on a 3D multimodal large language model (MLLM)<n>URDF-Anything utilizes an autoregressive prediction framework based on point-cloud and text multimodal input to jointly optimize geometric segmentation and kinematic parameter prediction.<n> Experiments on both simulated and real-world datasets demonstrate that our method significantly outperforms existing approaches.
arXiv Detail & Related papers (2025-11-02T13:45:51Z) - Efficient Surgical Robotic Instrument Pose Reconstruction in Real World Conditions Using Unified Feature Detection [21.460727996614704]
MIS robots have long kinematic chains and partial visibility of their degrees of freedom in the camera.<n>We propose a novel framework that unifies the detection of geometric primitives through a shared encoding.<n>This architecture detects both keypoints and edges in a single inference and is trained on large-scale synthetic data with projective labeling.
arXiv Detail & Related papers (2025-10-03T22:03:28Z) - Generating and Customizing Robotic Arm Trajectories using Neural Networks [0.0]
We introduce a neural network approach for generating and customizing the trajectory of a robotic arm.<n>Our approach successfully generates precise trajectories that could be customized in their shape and adapted to different settings.
arXiv Detail & Related papers (2025-06-25T09:05:58Z) - A Predictive Approach for Enhancing Accuracy in Remote Robotic Surgery Using Informer Model [0.0]
This paper presents a prediction model based on the Transformer-based Informer framework for accurate and efficient position estimation.<n>A comparison with models such as TCN, RNN, and LSTM demonstrates the Informer framework's superior performance in handling position prediction.
arXiv Detail & Related papers (2025-01-24T17:57:00Z) - Real-to-Sim: Predicting Residual Errors of Robotic Systems with Sparse
Data using a Learning-based Unscented Kalman Filter [65.93205328894608]
We learn the residual errors between a dynamic and/or simulator model and the real robot.
We show that with the learned residual errors, we can further close the reality gap between dynamic models, simulations, and actual hardware.
arXiv Detail & Related papers (2022-09-07T15:15:12Z) - Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator.
A cost-sensitive active learning approach is used to select optimal joint configurations.
The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
arXiv Detail & Related papers (2021-01-26T16:01:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.