Machine Learning on Camera Images for Fast mmWave Beamforming

• URL: http://arxiv.org/abs/2102.07337v1
• Date: Mon, 15 Feb 2021 04:38:00 GMT
• Title: Machine Learning on Camera Images for Fast mmWave Beamforming
• Abstract summary: Current 802.11ad WiFi and emerging 5G cellular standards spend up to several milliseconds exploring different sector combinations to identify the beam pair with the highest SNR. We propose a machine learning (ML) approach with two sequential convolutional neural networks (CNN) that uses out-of-band information. We experimentally validate this intriguing concept for indoor settings using the NI 60GHz mmwave transceiver.
• Score: 7.89556780984955
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Perfect alignment in chosen beam sectors at both transmit- and receive-nodes is required for beamforming in mmWave bands. Current 802.11ad WiFi and emerging 5G cellular standards spend up to several milliseconds exploring different sector combinations to identify the beam pair with the highest SNR. In this paper, we propose a machine learning (ML) approach with two sequential convolutional neural networks (CNN) that uses out-of-band information, in the form of camera images, to (i) rapidly identify the locations of the transmitter and receiver nodes, and then (ii) return the optimal beam pair. We experimentally validate this intriguing concept for indoor settings using the NI 60GHz mmwave transceiver. Our results reveal that our ML approach reduces beamforming related exploration time by 93% under different ambient lighting conditions, with an error of less than 1% compared to the time-intensive deterministic method defined by the current standards.

Related papers

• Computer vision-based neural networks for radioisotope identification in urban environments [0.0]
  Algorithm development for radioisotope identification in mobile urban search scenarios face significant challenges.<n>We present a machine learning-based approach to this problem that converts list-mode gamma-ray data into two-dimensional waterfall spectrograms.<n>We evaluate three architectures, a multilayer perceptron (MLP), convolutional neural network (CNN), and vision transformer (ViT) on the Radiological Anomaly Detection and Identification (RADAI) benchmark dataset.
  arXiv  Detail & Related papers  (2026-06-30T23:35:51Z)
• Diffusion Image Generation with Explicit Modeling of Data Manifold Geometry [64.61931485161833]
  Image generative models aim to sample data points from the underlying data manifold.<n>We propose the Data Manifold-aware Image diffusioN moDel (MIND)<n>MIND integrates discrete patch tokenization into the score function of a continuous diffusion model.
  arXiv  Detail & Related papers  (2026-05-25T08:43:14Z)
• Look Once, Beam Twice: Camera-Primed Real-Time Double-Directional mmWave Beam Management for Vehicular Connectivity [4.279449367355336]
  Millimeter-wave (mmWave) promise multi-gigabit connectivity for vehicle-to-everything (V2X) networks.<n> Reliable V2X connectivity requires fast, double-directional beam alignment.<n>This paper presents VIsion-based BEamforming(VIBE), a hybrid model-based, closed-loop, learning architecture for real-time mmWave beam management.
  arXiv  Detail & Related papers  (2026-05-06T16:07:26Z)
• A 10 Megahertz Spatial Light Modulator [4.469758751844986]
  We introduce a new class of spatial light modulator that provides both 2D pixel geometry and high speed.<n>The device operates by encoding spatial information in frequency bins via a broadband optical phase modulator, and decoding them via a high-resolution 2D spectrometer.<n>We demonstrate site-resolved optical pulsing with a 44(1)ns rise time, corresponding to frame rates exceeding 10 million frames per second.
  arXiv  Detail & Related papers  (2026-01-13T19:00:00Z)
• Picosecond Wireless Synchronization with Entangled Photons via Grid-Based Quantum Coverage in Indoor Optical Systems [12.035454349591085]
  We propose a novel entanglement-assisted synchronization framework for indoor optical wireless systems based on grid-based beam steering.<n>A two-stage synchronization algorithm is developed to address the inherent sparsity and randomness of photon detection.<n>Results show that finer grid configurations and optimal photon-pair rates significantly reduce synchronization error.
  arXiv  Detail & Related papers  (2025-10-23T17:49:46Z)
• Multi-Modality Sensing in mmWave Beamforming for Connected Vehicles Using Deep Learning [2.2879063461015425]
  This paper presents a deep learning-based solution for utilizing the multi-modality sensing data for predicting optimal beams having sufficient mmWave received powers. The results show that it can achieve up to 98.19% accuracies while predicting top-13 beams.
  arXiv  Detail & Related papers  (2025-04-08T16:18:00Z)
• Multi-photon enhanced resolution for Superconducting Nanowire Single-Photon Detector-based Time-of-Flight lidar systems [0.0]
  We report a lidar system based on waveguide-integrated SNSPDs that excels in temporal accuracy, which translates into high range resolution. For single-shot measurements, we find resolution in the millimeter regime, resulting from the jitter of the time-of-flight signal of 21$,$ps for low photon numbers. For multi-shot measurements we find sub-millimeter range-accuracy of 0.75$,$mm and reveal additional surface information of scanned objects.
  arXiv  Detail & Related papers  (2025-03-19T15:47:16Z)
• bit2bit: 1-bit quanta video reconstruction via self-supervised photon prediction [57.199618102578576]
  We propose bit2bit, a new method for reconstructing high-quality image stacks at original resolution from sparse binary quantatemporal image data. Inspired by recent work on Poisson denoising, we developed an algorithm that creates a dense image sequence from sparse binary photon data. We present a novel dataset containing a wide range of real SPAD high-speed videos under various challenging imaging conditions.
  arXiv  Detail & Related papers  (2024-10-30T17:30:35Z)
• Deep Learning and Image Super-Resolution-Guided Beam and Power Allocation for mmWave Networks [80.37827344656048]
  We develop a deep learning (DL)-guided hybrid beam and power allocation approach for millimeter-wave (mmWave) networks. We exploit the synergy of supervised learning and super-resolution technology to enable low-overhead beam- and power allocation.
  arXiv  Detail & Related papers  (2023-05-08T05:40:54Z)
• Fast Beam Alignment via Pure Exploration in Multi-armed Bandits [91.11360914335384]
  We develop a bandit-based fast BA algorithm to reduce BA latency for millimeter-wave (mmWave) communications. Our algorithm is named Two-Phase Heteroscedastic Track-and-Stop (2PHT&S)
  arXiv  Detail & Related papers  (2022-10-23T05:57:39Z)
• Deep Learning Based Hybrid Precoding in Dual-Band Communication Systems [34.03893373401685]
  We propose a deep learning-based method that uses spatial and temporal information extracted from the sub-6GHz band to predict/track beams in the millimeter-wave (mmWave) band. We consider a dual-band communication system operating in both the sub-6GHz and mmWave bands.
  arXiv  Detail & Related papers  (2021-07-16T12:10:32Z)
• Non-line-of-sight imaging with picosecond temporal resolution [13.81942907279106]
  Non-line-of-sight (NLOS) imaging enables monitoring around corners and is promising for diverse applications. We construct an up-conversion single-photon detector with a high temporal resolution of 1.4 ps and a low noise count rate of 5 counts per second (cps) Our system can provide a 180 mum axial resolution and a 2 mm lateral resolution, which is more than one order of magnitude better than that in previous experiments.
  arXiv  Detail & Related papers  (2021-06-30T03:55:45Z)
• A Novel Look at LIDAR-aided Data-driven mmWave Beam Selection [24.711393214172148]
  We propose a lightweight neural network (NN) architecture along with the corresponding LIDAR preprocessing. Our NN-based beam selection scheme can achieve 79.9% throughput without any beam search overhead and 95% by searching among as few as 6 beams.
  arXiv  Detail & Related papers  (2021-04-29T18:07:31Z)
• Deep Unfolded Recovery of Sub-Nyquist Sampled Ultrasound Image [94.42139459221784]
  We propose a reconstruction method from sub-Nyquist samples in the time and spatial domain, that is based on unfolding the ISTA algorithm. Our method allows reducing the number of array elements, sampling rate, and computational time while ensuring high quality imaging performance.
  arXiv  Detail & Related papers  (2021-03-01T19:19:38Z)
• Deep Learning for Fast and Reliable Initial Access in AI-Driven 6G mmWave Networks [6.097649192976533]
  We present DeepIA, a framework for enabling fast and reliable initial access for AI-driven beyond 5G and 6G millimeter (mmWave) networks. DeepIA reduces the beam sweep time compared to a conventional exhaustive search-based IA process by utilizing only a subset of the available beams. We show that the beam prediction accuracy of DeepIA saturates with the number of beams used for IA and depends on the particular selection of the beams.
  arXiv  Detail & Related papers  (2021-01-06T02:59:49Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)
• Fast Generation and Detection of Spatial Modes of Light using an Acousto-Optic Modulator [62.997667081978825]
  spatial modes of light provide a high-dimensional space that can be used to encode both classical and quantum information. Current approaches for dynamically generating and measuring these modes are slow, due to the need to reconfigure a high-resolution phase mask. We experimentally realize this approach, using a double-pass AOM to generate one of five orbital angular momentum states. We are able to reconstruct arbitrary states in under 1 ms with an average fidelity of 96.9%.
  arXiv  Detail & Related papers  (2020-07-31T14:58:30Z)
• Single Image Brightening via Multi-Scale Exposure Fusion with Hybrid Learning [48.890709236564945]
  A small ISO and a small exposure time are usually used to capture an image in the back or low light conditions. In this paper, a single image brightening algorithm is introduced to brighten such an image. The proposed algorithm includes a unique hybrid learning framework to generate two virtual images with large exposure times.
  arXiv  Detail & Related papers  (2020-07-04T08:23:07Z)
• Beamforming Learning for mmWave Communication: Theory and Experimental Validation [23.17604790640996]
  We propose a beam design technique that reduces the search time and does not require CSI while guaranteeing a minimum beamforming gain. We evaluate the efficacy of the proposed scheme in terms of building the codebook and assessing its performance through real-life measurements.
  arXiv  Detail & Related papers  (2019-12-28T05:46:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.