RIS-Assisted 3D Spherical Splatting for Object Composition Visualization using Detection Transformers
- URL: http://arxiv.org/abs/2511.02573v2
- Date: Wed, 05 Nov 2025 07:03:30 GMT
- Title: RIS-Assisted 3D Spherical Splatting for Object Composition Visualization using Detection Transformers
- Abstract summary: This work introduces a PWE-driven RF framework for three-dimensional object reconstruction using material-aware spherical primitives.<n>Results confirm the framework's ability to approximate object geometries and classify material composition with an overall accuracy of 79.35%.
- Score: 25.84331932738724
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The pursuit of immersive and structurally aware multimedia experiences has intensified interest in sensing modalities that reconstruct objects beyond the limits of visible light. Conventional optical pipelines degrade under occlusion or low illumination, motivating the use of radio-frequency (RF) sensing, whose electromagnetic waves penetrate materials and encode both geometric and compositional information. Yet, uncontrolled multipath propagation restricts reconstruction accuracy. Recent advances in Programmable Wireless Environments (PWEs) mitigate this limitation by enabling software-defined manipulation of propagation through Reconfigurable Intelligent Surfaces (RISs), thereby providing controllable illumination diversity. Building on this capability, this work introduces a PWE-driven RF framework for three-dimensional object reconstruction using material-aware spherical primitives. The proposed approach combines RIS-enabled field synthesis with a Detection Transformer (DETR) that infers spatial and material parameters directly from extracted RF features. Simulation results confirm the framework's ability to approximate object geometries and classify material composition with an overall accuracy of 79.35%, marking an initial step toward programmable and physically grounded RF-based 3D object composition visualization.
Related papers
- PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
arXiv Detail & Related papers (2026-03-11T14:11:42Z) - ERGO: Excess-Risk-Guided Optimization for High-Fidelity Monocular 3D Gaussian Splatting [63.138778159026934]
We propose an adaptive optimization framework guided by excess risk decomposition, termed ERGO.<n> ERGO dynamically estimates the view-specific excess risk and adaptively adjust loss weights during optimization.<n>Experiments on the Google Scanned Objects dataset and the OmniObject3D dataset demonstrate the superiority of ERGO over existing state-of-the-art methods.
arXiv Detail & Related papers (2026-02-10T20:44:43Z) - Bridging Visual and Wireless Sensing: A Unified Radiation Field for 3D Radio Map Construction [14.26926951448715]
Next-generation wireless networks require high-fidelity environmental intelligence.<n>3D radio maps have emerged as a critical tool for this purpose.<n>We propose URF-GS, a unified radio-optical radiation field representation framework.
arXiv Detail & Related papers (2026-01-27T05:35:50Z) - SenseRay-3D: Generalizable and Physics-Informed Framework for End-to-End Indoor Propagation Modeling [35.27031919957894]
SenseRay-3D is an end-to-end framework that predicts 3D path-loss heatmaps directly from RGB-D scans.<n>A synthetic indoor propagation dataset is developed to serve as a standardized benchmark for future research.<n> SenseRay-3D achieves a mean absolute error of 4.27 dB on unseen environments and supports real-time inference at 217 ms per sample.
arXiv Detail & Related papers (2025-11-15T08:17:49Z) - Physics-Informed Neural Networks for MIMO Beam Map and Environment Reconstruction [67.65578956523403]
geometry-aware feature extraction from channel state information (CSI) emerges as a pivotal methodology to bridge physical-layer measurements with network intelligence.<n>This paper proposes to explore the received signal strength ( RSS) data, without explicit 3D environment knowledge, to jointly construct the radio beam map and environmental geometry.<n>A physics-informed deep learning framework that incorporates the reflective-zone-based geometry model is proposed to learn the blockage, reflection, and scattering components.
arXiv Detail & Related papers (2025-10-24T08:17:14Z) - ROGR: Relightable 3D Objects using Generative Relighting [71.35020300131261]
We introduce ROGR, a novel approach that reconstructs a relightable 3D model of an object captured from multiple views.<n>We train a lighting-conditioned Neural Radiance Field (NeRF) that outputs the object's appearance under any input environmental lighting.<n>We evaluate our approach on the established TensoIR and Stanford-ORB datasets, and showcase our approach on real-world object captures.
arXiv Detail & Related papers (2025-10-03T16:35:22Z) - Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
arXiv Detail & Related papers (2025-09-11T23:12:55Z) - MatDecompSDF: High-Fidelity 3D Shape and PBR Material Decomposition from Multi-View Images [20.219010684946888]
MatDecompSDF is a framework for recovering high-fidelity 3D shapes and decomposing their physically-based material properties from multi-view images.<n>Our method produces editable and relightable assets that can be seamlessly integrated into standard graphics pipelines.
arXiv Detail & Related papers (2025-07-07T08:22:32Z) - Structural Vibration Monitoring with Diffractive Optical Processors [10.912207470238338]
We present a diffractive vibration monitoring system, integrating a jointly optimized diffractive layer with a shallow neural network-based backend.<n>This architecture eliminates the need for dense sensor arrays or extensive data acquisition.<n>Our system achieves more than an order-of-magnitude improvement in accuracy over conventional optics.
arXiv Detail & Related papers (2025-06-03T19:06:04Z) - PBIR-NIE: Glossy Object Capture under Non-Distant Lighting [30.325872237020395]
Glossy objects present a significant challenge for 3D reconstruction from multi-view input images under natural lighting.
We introduce PBIR-NIE, an inverse rendering framework designed to holistically capture the geometry, material attributes, and surrounding illumination of such objects.
arXiv Detail & Related papers (2024-08-13T13:26:24Z) - OpenMaterial: A Large-scale Dataset of Complex Materials for 3D Reconstruction [55.052637670485716]
We introduce OpenMaterial, a large-scale semi-synthetic dataset for material-aware 3D reconstruction.<n>It comprises 1,001 objects spanning 295 distinct materials, including conductors, dielectrics, plastics, and their roughened variants, captured under 714 diverse lighting conditions.<n>It provides multi-view images, 3D shape models, camera poses, depth maps, and object masks, establishing the first extensive benchmark for evaluating 3D reconstruction on challenging materials.
arXiv Detail & Related papers (2024-06-13T07:46:17Z) - Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields [45.64333510966844]
Inverse rendering aims at recovering both geometry and materials of objects.
We propose a novel 5D Neural Plenoptic Function (NeP) based on NeRFs and ray tracing.
Our method can reconstruct high-fidelity geometry/materials of challenging glossy objects with complex lighting interactions from nearby objects.
arXiv Detail & Related papers (2024-03-24T16:34:47Z) - RRNet: Relational Reasoning Network with Parallel Multi-scale Attention
for Salient Object Detection in Optical Remote Sensing Images [82.1679766706423]
Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs.
We propose a relational reasoning network with parallel multi-scale attention for SOD in optical RSIs.
Our proposed RRNet outperforms the existing state-of-the-art SOD competitors both qualitatively and quantitatively.
arXiv Detail & Related papers (2021-10-27T07:18:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.