CONVERGE: A Multi-Agent Vision-Radio Architecture for xApps

• URL: http://arxiv.org/abs/2508.04556v1
• Date: Wed, 06 Aug 2025 15:40:52 GMT
• Title: CONVERGE: A Multi-Agent Vision-Radio Architecture for xApps
• Authors: Filipe B. Teixeira, Carolina Simões, Paulo Fidalgo, Wagner Pedrosa, André Coelho, Manuel Ricardo, Luis M. Pessoa,
• Abstract summary: This paper proposes a novel architecture for delivering real-time radio and video sensing information to O-RAN xApps through a multi-agent approach.<n> Experimental results show that the delay of sensing information remains under 1,ms and that an xApp can successfully use radio and video sensing information to control the 5G/6G RAN in real-time.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Telecommunications and computer vision have evolved independently. With the emergence of high-frequency wireless links operating mostly in line-of-sight, visual data can help predict the channel dynamics by detecting obstacles and help overcoming them through beamforming or handover techniques. This paper proposes a novel architecture for delivering real-time radio and video sensing information to O-RAN xApps through a multi-agent approach, and introduces a new video function capable of generating blockage information for xApps, enabling Integrated Sensing and Communications. Experimental results show that the delay of sensing information remains under 1\,ms and that an xApp can successfully use radio and video sensing information to control the 5G/6G RAN in real-time.

Related papers

• MGCR-Net:Multimodal Graph-Conditioned Vision-Language Reconstruction Network for Remote Sensing Change Detection [55.702662643521265]
  We propose the multimodal graph-conditioned vision-language reconstruction network (MGCR-Net) to explore the semantic interaction capabilities of multimodal data.<n> Experimental results on four public datasets demonstrate that MGCR achieves superior performance compared to mainstream CD methods.
  arXiv  Detail & Related papers  (2025-08-03T02:50:08Z)
• AI/ML Life Cycle Management for Interoperable AI Native RAN [50.61227317567369]
  Artificial intelligence (AI) and machine learning (ML) models are rapidly permeating the 5G Radio Access Network (RAN)<n>These developments lay the foundation for AI-native transceivers as a key enabler for 6G.
  arXiv  Detail & Related papers  (2025-07-24T16:04:59Z)
• Spatial Channel State Information Prediction with Generative AI: Towards Holographic Communication and Digital Radio Twin [23.09171064957228]
  6G promises to deliver faster and more reliable wireless connections via cutting-edge radio technologies. Traditional management methods are mainly reactive, usually based on feedback from users to adapt to the dynamic wireless channel. Advances in hardware and neural networks make it possible to predict such spatial-CSI using precise environmental information. We propose a new framework, digital radio twin, which takes advantages from both the digital world and deterministic control over radio waves.
  arXiv  Detail & Related papers  (2024-01-16T00:29:05Z)
• Sionna RT: Differentiable Ray Tracing for Radio Propagation Modeling [65.17711407805756]
  Sionna is a GPU-accelerated open-source library for link-level simulations based on. Since release v0.14 it integrates a differentiable ray tracer (RT) for the simulation of radio wave propagation.
  arXiv  Detail & Related papers  (2023-03-20T13:40:11Z)
• Look, Radiate, and Learn: Self-Supervised Localisation via Radio-Visual Correspondence [1.6219158909792257]
  Next generation cellular networks will implement radio sensing functions alongside customary communications. We present MaxRay: a synthetic radio-visual dataset and benchmark that facilitate precise target localisation in radio. We use such self-supervised coordinates to train a radio localiser network.
  arXiv  Detail & Related papers  (2022-06-13T19:08:36Z)
• Human Silhouette and Skeleton Video Synthesis through Wi-Fi signals [24.313281453214614]
  This paper presents a novel two-branch generative neural network that effectively maps radio data into visual features. Once trained, the proposed method synthesizes human silhouette and skeleton videos using exclusively Wi-Fi signals.
  arXiv  Detail & Related papers  (2022-03-11T11:40:34Z)
• Self-Supervised Radio-Visual Representation Learning for 6G Sensing [1.9766522384767227]
  In future 6G cellular networks, a joint communication and sensing protocol will allow the network to perceive the environment. We propose to combine radio and vision to automatically learn a radio-only sensing model with minimal human intervention.
  arXiv  Detail & Related papers  (2021-11-01T12:23:47Z)
• Integrating Sensing and Communication in Cellular Networks via NR Sidelink [7.42576783544779]
  We discuss a common issue related to sidelink-based RF-sensing, which is its angle and rotation dependence. We propose a graph based encoder to capture propose-temporal features of the data and four approaches for multi-angle learning.
  arXiv  Detail & Related papers  (2021-09-15T12:41:31Z)
• Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networks [208.15591625749272]
  We present a perception-action-communication loop design using Vision-based Graph Aggregation and Inference (VGAI) Our framework is implemented by a cascade of a convolutional and a graph neural network (CNN / GNN), addressing agent-level visual perception and feature learning. We demonstrate that VGAI yields performance comparable to or better than other decentralized controllers.
  arXiv  Detail & Related papers  (2021-06-24T23:57:21Z)
• A Tutorial on Ultra-Reliable and Low-Latency Communications in 6G: Integrating Domain Knowledge into Deep Learning [115.75967665222635]
  Ultra-reliable and low-latency communications (URLLC) will be central for the development of various emerging mission-critical applications. Deep learning algorithms have been considered as promising ways of developing enabling technologies for URLLC in future 6G networks. This tutorial illustrates how domain knowledge can be integrated into different kinds of deep learning algorithms for URLLC.
  arXiv  Detail & Related papers  (2020-09-13T14:53:01Z)
• A Big Data Enabled Channel Model for 5G Wireless Communication Systems [71.93009775340234]
  This paper investigates various applications of big data analytics, especially machine learning algorithms in wireless communications and channel modeling. We propose a big data and machine learning enabled wireless channel model framework. The proposed channel model is based on artificial neural networks (ANNs), including feed-forward neural network (FNN) and radial basis function neural network (RBF-NN)
  arXiv  Detail & Related papers  (2020-02-28T05:56:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.