Optical Computation-in-Communication enables low-latency, high-fidelity perception in telesurgery
- URL: http://arxiv.org/abs/2510.14058v1
- Date: Wed, 15 Oct 2025 19:54:11 GMT
- Title: Optical Computation-in-Communication enables low-latency, high-fidelity perception in telesurgery
- Authors: Rui Yang, Jiaming Hu, Jian-Qing Zheng, Yue-Zhen Lu, Jian-Wei Cui, Qun Ren, Yi-Jie Yu, John Edward Wu, Zhao-Yu Wang, Xiao-Li Lin, Dandan Zhang, Mingchu Tang, Christos Masouros, Huiyun Liu, Chin-Pang Liu,
- Abstract summary: Optical Computation-in-Communication (OCiC) framework reduces end-to-end latency significantly by performing AI inference concurrently with optical communication.<n>OCiC integrates Optical Remote Computing Units directly into the optical communication pathway, with each ORCU experimentally achieving up to 69 tera-operations per second per channel.<n>When scaled globally, OCiC transforms long-haul fibre infrastructure into a distributed photonic AI fabric with exascale potential.
- Score: 31.415400862116204
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Artificial intelligence (AI) holds significant promise for enhancing intraoperative perception and decision-making in telesurgery, where physical separation impairs sensory feedback and control. Despite advances in medical AI and surgical robotics, conventional electronic AI architectures remain fundamentally constrained by the compounded latency from serial processing of inference and communication. This limitation is especially critical in latency-sensitive procedures such as endovascular interventions, where delays over 200 ms can compromise real-time AI reliability and patient safety. Here, we introduce an Optical Computation-in-Communication (OCiC) framework that reduces end-to-end latency significantly by performing AI inference concurrently with optical communication. OCiC integrates Optical Remote Computing Units (ORCUs) directly into the optical communication pathway, with each ORCU experimentally achieving up to 69 tera-operations per second per channel through spectrally efficient two-dimensional photonic convolution. The system maintains ultrahigh inference fidelity within 0.1% of CPU/GPU baselines on classification and coronary angiography segmentation, while intrinsically mitigating cumulative error propagation, a longstanding barrier to deep optical network scalability. We validated the robustness of OCiC through outdoor dark fibre deployments, confirming consistent and stable performance across varying environmental conditions. When scaled globally, OCiC transforms long-haul fibre infrastructure into a distributed photonic AI fabric with exascale potential, enabling reliable, low-latency telesurgery across distances up to 10,000 km and opening a new optical frontier for distributed medical intelligence.
Related papers
- Integrated Ring-based Quantum Key Distribution with Weak Measurement Enhanced Fiber-Optic Sensing Disturbance Magnitude and Location [11.501410734393367]
Sagnac-loop integrated system (SLIS) combines ring-based quantum key distribution (QKD) with fiber-based weak measurement (WM) enhanced sensing and disturbance localization capabilities.<n>Over a 30 km Sagnac loop channel, the SLIS achieves a raw key generation rate of 22.4 kbps with stable operation and clear scalability toward network expansion.
arXiv Detail & Related papers (2025-12-22T02:22:38Z) - Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
arXiv Detail & Related papers (2025-09-11T23:12:55Z) - Towards Digital Twins for Optimal Radioembolization [0.4893896929103368]
Radioembolization is a localized liver cancer treatment that delivers radioactive microspheres to tumors via a catheter inserted in the hepatic arterial tree.<n> optimization is challenging due to complex hepatic artery anatomy, variable blood flow, and uncertainty in microsphere transport.<n>This work outlines a framework for a liver radioembolization digital twin using high-fidelity computational fluid dynamics (CFD) and/or recent physics-informed machine learning approaches.
arXiv Detail & Related papers (2025-08-30T00:30:42Z) - Beyond Terabit/s Integrated Neuromorphic Photonic Processor for DSP-Free Optical Interconnects [1.9685853627153866]
Multi-scale AI training and inference demand uniform, ultra-low latency, and energy-efficient links.<n>We present an integrated neuromorphic optical signal processor (OSP) that achieves DSP-free, all-optical, real-time processing.<n>This research provides a highly scalable, energy-efficient, and high-speed solution, paving the way for next-generation AI infrastructure.
arXiv Detail & Related papers (2025-04-21T11:56:36Z) - MELON: Multimodal Mixture-of-Experts with Spectral-Temporal Fusion for Long-Term Mobility Estimation in Critical Care [1.5237145555729716]
We introduce MELON, a novel framework designed to predict 12-hour mobility status in the critical care setting.<n>We trained and evaluated the MELON model on the multimodal dataset of 126 patients recruited from nine Intensive Care Units at the University of Florida Health Shands Hospital main campus in Gainesville, Florida.<n>Results showed that MELON outperforms conventional approaches for 12-hour mobility status estimation.
arXiv Detail & Related papers (2025-03-10T19:47:46Z) - Integration of Communication and Computational Imaging [49.2442836992307]
We propose a novel framework that integrates communication and computational imaging (ICCI) for remote perception.
ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks.
An 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved.
arXiv Detail & Related papers (2024-10-25T09:19:59Z) - CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers [66.15847237150909]
We introduce a self-supervised deep learning architecture to segment catheters in longitudinal ultrasound images.
The network architecture builds upon AiAReSeg, a segmentation transformer built with the Attention in Attention mechanism.
We validated our model on a test dataset, consisting of unseen synthetic data and images collected from silicon aorta phantoms.
arXiv Detail & Related papers (2024-03-21T15:13:36Z) - Leveraging Frequency Domain Learning in 3D Vessel Segmentation [50.54833091336862]
In this study, we leverage Fourier domain learning as a substitute for multi-scale convolutional kernels in 3D hierarchical segmentation models.
We show that our novel network achieves remarkable dice performance (84.37% on ASACA500 and 80.32% on ImageCAS) in tubular vessel segmentation tasks.
arXiv Detail & Related papers (2024-01-11T19:07:58Z) - Robotic Navigation Autonomy for Subretinal Injection via Intelligent
Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
We propose a framework for autonomous robotic navigation for subretinal injection.
Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target.
Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
arXiv Detail & Related papers (2023-01-17T21:41:21Z) - Interferobot: aligning an optical interferometer by a reinforcement
learning agent [118.43526477102573]
We train an RL agent to align a Mach-Zehnder interferometer, based on images of fringes acquired by a monocular camera.
The agent is trained in a simulated environment, without any hand-coded features or a priori information about the physics.
Thanks to a set of domain randomizations simulating uncertainties in physical measurements, the agent successfully aligns this interferometer without any fine tuning.
arXiv Detail & Related papers (2020-06-03T13:10:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.