Physically Accurate Differentiable Inverse Rendering for Radio Frequency Digital Twin

• URL: http://arxiv.org/abs/2603.18026v1
• Date: Thu, 05 Mar 2026 23:59:15 GMT
• Title: Physically Accurate Differentiable Inverse Rendering for Radio Frequency Digital Twin
• Abstract summary: Digital twins, virtual simulated replicas of physical scenes, are transforming system design across industries.<n>RFDT resolves discontinuities with a physically grounded edge-diffraction transition function.
• Score: 48.52428157677096
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Digital twins, virtual simulated replicas of physical scenes, are transforming system design across industries. However, their potential in radio frequency (RF) systems has been limited by the non-differentiable nature of conventional RF simulators. The visibility of propagation paths causes severe discontinuities, and differentiable rendering techniques from computer graphics cannot easily transfer due to point-source antennas and dominant specular reflections. In this paper, we present RFDT, a physically based differentiable RF simulation framework that enables gradient-based interaction between virtual and physical worlds. RFDT resolves discontinuities with a physically grounded edge-diffraction transition function, and mitigates non-convexity from Fourier-domain processing through a signal domain transform surrogate. Our implementation demonstrates RFDT's ability to accurately reconstruct digital twins from real RF measurements. Moreover, RFDT can augment diverse downstream applications, such as test-time adaptation of machine learning-based RF sensing and physically constrained optimization of communication systems.

Related papers

• CORF-GS: Real-Time Wireless Radiance Field Reconstruction via Coupled Optical-RF Gaussian Splatting [65.63543177449922]
  CORF-GS is a real-time WRF reconstruction framework that processes sequential and radio frequency (RF) waves.<n>It constructs a unified Gaussian representation for optical and RF with shared geometry and modality-specific appearance.<n>It achieves state-of-the-art RF spectrum quality and reduces the reconstruction time by $6.4times$ compared with existing WRF methods.
  arXiv  Detail & Related papers  (2026-07-28T10:56:52Z)
• PF-Trans: Physics-Embedded Frequency-Aware Transformer for Spectral Reconstruction [9.122692658405116]
  We propose a Physics-embedded Frequency-aware Transformer (PF-Trans) for high-fidelity remote sensing spectral reconstruction.<n>PF-Trans achieves state-of-the-art performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of up to 48.50 dB on the GF-5 Shanghai dataset.
  arXiv  Detail & Related papers  (2026-06-09T03:34:34Z)
• Differentiable Ray Tracing with Gaussians for Unified Radio Propagation Simulation and View Synthesis [13.057153756597904]
  We introduce a framework enabling differentiable RF propagation simulation directly within visually reconstructed neural scenes.<n>We provide cross-modal evidence that neural reconstructions can serve as unified spatial representations for both electromagnetic propagation simulation and photorealistic view synthesis.
  arXiv  Detail & Related papers  (2026-05-08T14:19:28Z)
• Semantically Annotated Multimodal Dataset for RF Interpretation and Prediction [4.872063946977515]
  Current limitations in wireless modeling and radio frequency (RF)-based AI are driven by a lack of high-quality, measurement-based datasets that connect RF signals to their physical environments.<n>We propose a new class of multimodal datasets that combines RF measurements with auxiliary modalities like high-resolution cameras and lidar to bridge the gap between RF signals and their physical causes.
  arXiv  Detail & Related papers  (2026-04-01T22:18:01Z)
• Unlocking High-Fidelity Analog Joint Source-Channel Coding on Standard Digital Transceivers [54.82164616081277]
  D2AJSCC is a novel framework enabling high-fidelity analog J SCC deployment on standard digital PHYs.<n>Our system achieves near-ideal analog J SCC performance with graceful degradation across SNR conditions.<n>By enabling next-generation semantic transmission on legacy infrastructure without hardware modification, our framework promotes sustainable network evolution.
  arXiv  Detail & Related papers  (2026-03-10T01:42:23Z)
• ReVeal-MT: A Physics-Informed Neural Network for Multi-Transmitter Radio Environment Mapping [9.43653276377036]
  We propose emphReVeal-MT, a novel PINN which integrates the multi-source PDE residual into a neural network loss function.<n>ReVeal-MT is validated using real-world measurements from the ARA wireless living lab across rural and suburban environments.<n>Results show that ReVeal-MT achieves substantial accuracy gains in multi-transmitter scenarios.
  arXiv  Detail & Related papers  (2025-11-22T23:33:06Z)
• Scalable RF Simulation in Generative 4D Worlds [12.977761033016503]
  WaveVerse is a prompt-based, scalable framework that simulates realistic RF signals from generated indoor scenes with human motions.<n> Experiments demonstrate the effectiveness of our approach in conditioned human motion generation and highlight how phase coherence is applied to beamforming and respiration monitoring.
  arXiv  Detail & Related papers  (2025-08-16T23:02:14Z)
• Wavelet-Guided Dual-Frequency Encoding for Remote Sensing Change Detection [67.84730634802204]
  Change detection in remote sensing imagery plays a vital role in various engineering applications, such as natural disaster monitoring, urban expansion tracking, and infrastructure management.<n>Most existing methods still rely on spatial-domain modeling, where the limited diversity of feature representations hinders the detection of subtle change regions.<n>We observe that frequency-domain feature modeling particularly in the wavelet domain amplify fine-grained differences in frequency components, enhancing the perception of edge changes that are challenging to capture in the spatial domain.
  arXiv  Detail & Related papers  (2025-08-07T11:14:16Z)
• Rasterizing Wireless Radiance Field via Deformable 2D Gaussian Splatting [10.200300617390013]
  Modeling wireless radiance field (WRF) is fundamental to modern communication systems.<n>We propose SwiftWRF, a deformable 2D splatting framework that synthesizes WRF spectra at arbitrary positions.<n>Experiments on both real-world and synthetic indoor scenes demonstrate that SwiftWRF can reconstruct WRF up to 500x faster than existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-06-15T09:36:45Z)
• Closing the Visual Sim-to-Real Gap with Object-Composable NeRFs [59.12526668734703]
  We introduce Composable Object Volume NeRF (COV-NeRF), an object-composable NeRF model that is the centerpiece of a real-to-sim pipeline. COV-NeRF extracts objects from real images and composes them into new scenes, generating photorealistic renderings and many types of 2D and 3D supervision.
  arXiv  Detail & Related papers  (2024-03-07T00:00:02Z)
• Deep Learning-based MRI Reconstruction with Artificial Fourier Transform Network (AFTNet) [14.146848823672677]
  We introduce a unified complex-valued deep learning framework-Artificial Fourier Transform Network (AFTNet)<n>AFTNet can be readily used to solve image inverse problems in domain transformation.<n>We show that AFTNet achieves superior accelerated MRI reconstruction compared to existing approaches.
  arXiv  Detail & Related papers  (2023-12-18T02:50:45Z)
• Dynamic Mesh-Aware Radiance Fields [75.59025151369308]
  This paper designs a two-way coupling between mesh and NeRF during rendering and simulation. We show that a hybrid system approach outperforms alternatives in visual realism for mesh insertion.
  arXiv  Detail & Related papers  (2023-09-08T20:18:18Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.