Vision-Aided Radio: User Identity Match in Radio and Video Domains Using Machine Learning

• URL: http://arxiv.org/abs/2010.07219v3
• Date: Mon, 14 Dec 2020 20:47:52 GMT
• Title: Vision-Aided Radio: User Identity Match in Radio and Video Domains Using Machine Learning
• Authors: Vinicius M. de Pinho, Marcello L. R. de Campos, Luis Uzeda Garcia and Dalia Popescu
• Abstract summary: 5G is designed to be an essential enabler and a leading infrastructure provider in the communication technology industry. The use of deep learning and computer vision tools has the means to increase the environmental awareness of the network. We propose a framework to match the information from both visual and radio domains.
• Score: 3.0204520109309847
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: 5G is designed to be an essential enabler and a leading infrastructure provider in the communication technology industry by supporting the demand for the growing data traffic and a variety of services with distinct requirements. The use of deep learning and computer vision tools has the means to increase the environmental awareness of the network with information from visual data. Information extracted via computer vision tools such as user position, movement direction, and speed can be promptly available for the network. However, the network must have a mechanism to match the identity of a user in both visual and radio systems. This mechanism is absent in the present literature. Therefore, we propose a framework to match the information from both visual and radio domains. This is an essential step to practical applications of computer vision tools in communications. We detail the proposed framework training and deployment phases for a presented setup. We carried out practical experiments using data collected in different types of environments. The work compares the use of Deep Neural Network and Random Forest classifiers and shows that the former performed better across all experiments, achieving classification accuracy greater than 99%.

Related papers

• Enhancing Graph Representation of the Environment through Local and Cloud Computation [2.9465623430708905]
  We propose a graph-based representation that provides a semantic representation of robot environments from multiple sources. To acquire information from the environment, the framework combines classical computer vision tools with modern computer vision cloud services. The proposed approach allows us to handle also small objects and integrate them into the semantic representation of the environment.
  arXiv  Detail & Related papers  (2023-09-22T08:05:32Z)
• Machine Learning for QoS Prediction in Vehicular Communication: Challenges and Solution Approaches [46.52224306624461]
  We consider maximum throughput prediction enhancing, for example, streaming or high-definition mapping applications. We highlight how confidence can be built on machine learning technologies by better understanding the underlying characteristics of the collected data. We use explainable AI to show that machine learning can learn underlying principles of wireless networks without being explicitly programmed.
  arXiv  Detail & Related papers  (2023-02-23T12:29:20Z)
• A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspective [71.03621840455754]
  Graph Neural Networks (GNNs) have gained momentum in graph representation learning. graph Transformers embed a graph structure into the Transformer architecture to overcome the limitations of local neighborhood aggregation. This paper presents a comprehensive review of GNNs and graph Transformers in computer vision from a task-oriented perspective.
  arXiv  Detail & Related papers  (2022-09-27T08:10:14Z)
• Optical flow-based branch segmentation for complex orchard environments [73.11023209243326]
  We train a neural network system in simulation only using simulated RGB data and optical flow. This resulting neural network is able to perform foreground segmentation of branches in a busy orchard environment without additional real-world training or using any special setup or equipment beyond a standard camera. Our results show that our system is highly accurate and, when compared to a network using manually labeled RGBD data, achieves significantly more consistent and robust performance across environments that differ from the training set.
  arXiv  Detail & Related papers  (2022-02-26T03:38:20Z)
• OG-SGG: Ontology-Guided Scene Graph Generation. A Case Study in Transfer Learning for Telepresence Robotics [124.08684545010664]
  Scene graph generation from images is a task of great interest to applications such as robotics. We propose an initial approximation to a framework called Ontology-Guided Scene Graph Generation (OG-SGG)
  arXiv  Detail & Related papers  (2022-02-21T13:23:15Z)
• Self-Supervised Radio-Visual Representation Learning for 6G Sensing [1.9766522384767227]
  In future 6G cellular networks, a joint communication and sensing protocol will allow the network to perceive the environment. We propose to combine radio and vision to automatically learn a radio-only sensing model with minimal human intervention.
  arXiv  Detail & Related papers  (2021-11-01T12:23:47Z)
• In-Network Learning: Distributed Training and Inference in Networks [10.635097939284753]
  We develop a learning algorithm and an architecture that make use of multiple data streams and processing units. In particular, the analysis reveals how inference propagates and fuses across a network.
  arXiv  Detail & Related papers  (2021-07-07T18:35:08Z)
• Scalable Perception-Action-Communication Loops with Convolutional and Graph Neural Networks [208.15591625749272]
  We present a perception-action-communication loop design using Vision-based Graph Aggregation and Inference (VGAI) Our framework is implemented by a cascade of a convolutional and a graph neural network (CNN / GNN), addressing agent-level visual perception and feature learning. We demonstrate that VGAI yields performance comparable to or better than other decentralized controllers.
  arXiv  Detail & Related papers  (2021-06-24T23:57:21Z)
• Federated Learning: A Signal Processing Perspective [144.63726413692876]
  Federated learning is an emerging machine learning paradigm for training models across multiple edge devices holding local datasets, without explicitly exchanging the data. This article provides a unified systematic framework for federated learning in a manner that encapsulates and highlights the main challenges that are natural to treat using signal processing tools.
  arXiv  Detail & Related papers  (2021-03-31T15:14:39Z)
• How Researchers Use Diagrams in Communicating Neural Network Systems [5.064404027153093]
  This paper reports on a study into the use of neural network system diagrams. We find high diversity of usage, perception and preference in both creation and interpretation of diagrams. Considering the interview data alongside existing guidance, we propose guidelines aiming to improve the way in which neural network system diagrams are constructed.
  arXiv  Detail & Related papers  (2020-08-28T10:21:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.