NeRF2: Neural Radio-Frequency Radiance Fields

• URL: http://arxiv.org/abs/2305.06118v2
• Date: Thu, 12 Oct 2023 08:46:40 GMT
• Title: NeRF2: Neural Radio-Frequency Radiance Fields
• Authors: Xiaopeng Zhao, Zhenlin An, Qingrui Pan, Lei Yang
• Abstract summary: NeRF$textbf2$ represents a continuous volumetric scene function that makes sense of an RF signal's propagation. NeRF$textbf2$ can tell how/what signal is received at any position when it knows the position of a transmitter.
• Score: 11.09253326813424
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Although Maxwell discovered the physical laws of electromagnetic waves 160 years ago, how to precisely model the propagation of an RF signal in an electrically large and complex environment remains a long-standing problem. The difficulty is in the complex interactions between the RF signal and the obstacles (e.g., reflection, diffraction, etc.). Inspired by the great success of using a neural network to describe the optical field in computer vision, we propose a neural radio-frequency radiance field, NeRF$^\textbf{2}$, which represents a continuous volumetric scene function that makes sense of an RF signal's propagation. Particularly, after training with a few signal measurements, NeRF$^\textbf{2}$ can tell how/what signal is received at any position when it knows the position of a transmitter. As a physical-layer neural network, NeRF$^\textbf{2}$ can take advantage of the learned statistic model plus the physical model of ray tracing to generate a synthetic dataset that meets the training demands of application-layer artificial neural networks (ANNs). Thus, we can boost the performance of ANNs by the proposed turbo-learning, which mixes the true and synthetic datasets to intensify the training. Our experiment results show that turbo-learning can enhance performance with an approximate 50% increase. We also demonstrate the power of NeRF$^\textbf{2}$ in the field of indoor localization and 5G MIMO.

Related papers

• Deep Learning for Low-Latency, Quantum-Ready RF Sensing [2.5393702482222813]
  Recent work has shown the promise of applying deep learning to enhance software processing of radio frequency (RF) signals. In this paper, we describe our implementations of quantum-ready machine learning approaches for RF signal classification.
  arXiv  Detail & Related papers  (2024-04-27T17:22:12Z)
• Efficient View Synthesis with Neural Radiance Distribution Field [61.22920276806721]
  We propose a new representation called Neural Radiance Distribution Field (NeRDF) that targets efficient view synthesis in real-time. We use a small network similar to NeRF while preserving the rendering speed with a single network forwarding per pixel as in NeLF. Experiments show that our proposed method offers a better trade-off among speed, quality, and network size than existing methods.
  arXiv  Detail & Related papers  (2023-08-22T02:23:28Z)
• Multi-Space Neural Radiance Fields [74.46513422075438]
  Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects. We propose a multi-space neural radiance field (MS-NeRF) that represents the scene using a group of feature fields in parallel sub-spaces. Our approach significantly outperforms the existing single-space NeRF methods for rendering high-quality scenes.
  arXiv  Detail & Related papers  (2023-05-07T13:11:07Z)
• MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields [49.68916478541697]
  We develop a Memory-Efficient Incremental Learning algorithm for NeRF (MEIL-NeRF) MEIL-NeRF takes inspiration from NeRF itself in that a neural network can serve as a memory that provides the pixel RGB values, given rays as queries. As a result, MEIL-NeRF demonstrates constant memory consumption and competitive performance.
  arXiv  Detail & Related papers  (2022-12-16T08:04:56Z)
• Classification of multi-frequency RF signals by extreme learning, using magnetic tunnel junctions as neurons and synapses [46.000685134136525]
  We show that magnetic tunnel junctions can process RF inputs with multiple frequencies in parallel. Using a backpropagation-free method called extreme learning, we classify noisy images encoded by RF signals. These results are a key step for embedded radiofrequency artificial intelligence.
  arXiv  Detail & Related papers  (2022-11-02T14:09:42Z)
• RF Signal Classification with Synthetic Training Data and its Real-World Performance [0.0]
  This paper investigates the impact of different RF signal impairments modeled in synthetic training data with respect to the real-world performance. It achieves an accuracy of up to 95 % in real-world operation by using carefully designed synthetic training data only.
  arXiv  Detail & Related papers  (2022-06-26T20:47:33Z)
• R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis [76.07010495581535]
  Rendering a single pixel requires querying the Neural Radiance Field network hundreds of times. NeLF presents a more straightforward representation over NeRF in novel view. We show the key to successfully learning a deep NeLF network is to have sufficient data.
  arXiv  Detail & Related papers  (2022-03-31T17:57:05Z)
• Resonant tunnelling diode nano-optoelectronic spiking nodes for neuromorphic information processing [0.0]
  We introduce an optoelectronic artificial neuron capable of operating at ultrafast rates and with low energy consumption. The proposed system combines an excitable tunnelling diode (RTD) element with a nanoscale light source.
  arXiv  Detail & Related papers  (2021-07-14T14:11:04Z)
• Flexible Transmitter Network [84.90891046882213]
  Current neural networks are mostly built upon the MP model, which usually formulates the neuron as executing an activation function on the real-valued weighted aggregation of signals received from other neurons. We propose the Flexible Transmitter (FT) model, a novel bio-plausible neuron model with flexible synaptic plasticity. We present the Flexible Transmitter Network (FTNet), which is built on the most common fully-connected feed-forward architecture.
  arXiv  Detail & Related papers  (2020-04-08T06:55:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.