Efficient Physics-Based Learned Reconstruction Methods for Real-Time 3D
Near-Field MIMO Radar Imaging
- URL: http://arxiv.org/abs/2312.16959v1
- Date: Thu, 28 Dec 2023 11:05:36 GMT
- Title: Efficient Physics-Based Learned Reconstruction Methods for Real-Time 3D
Near-Field MIMO Radar Imaging
- Authors: Irfan Manisali, Okyanus Oral, Figen S. Oktem
- Abstract summary: Near-field multiple-input multiple-output (MIMO) radar imaging systems have recently gained significant attention.
In this paper, we develop novel non-iterative deep learning-based reconstruction methods for real-time near-field imaging.
The goal is to achieve high image quality with low computational cost at settings.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Near-field multiple-input multiple-output (MIMO) radar imaging systems have
recently gained significant attention. In this paper, we develop novel
non-iterative deep learning-based reconstruction methods for real-time
near-field MIMO imaging. The goal is to achieve high image quality with low
computational cost at compressive settings. The developed approaches have two
stages. In the first approach, physics-based initial stage performs adjoint
operation to back-project the measurements to the image-space, and deep neural
network (DNN)-based second stage converts the 3D backprojected measurements to
a magnitude-only reflectivity image. Since scene reflectivities often have
random phase, DNN processes directly the magnitude of the adjoint result. As
DNN, 3D U-Net is used to jointly exploit range and cross-range correlations. To
comparatively evaluate the significance of exploiting physics in a
learning-based approach, two additional approaches that replace the
physics-based first stage with fully connected layers are also developed as
purely learning-based methods. The performance is also analyzed by changing the
DNN architecture for the second stage to include complex-valued processing
(instead of magnitude-only processing), 2D convolution kernels (instead of 3D),
and ResNet architecture (instead of U-Net). Moreover, we develop a synthesizer
to generate large-scale dataset for training with 3D extended targets. We
illustrate the performance through experimental data and extensive simulations.
The results show the effectiveness of the developed physics-based learned
reconstruction approach in terms of both run-time and image quality at highly
compressive settings. Our source codes and dataset are made available at
GitHub.
Related papers
- Large Spatial Model: End-to-end Unposed Images to Semantic 3D [79.94479633598102]
Large Spatial Model (LSM) processes unposed RGB images directly into semantic radiance fields.
LSM simultaneously estimates geometry, appearance, and semantics in a single feed-forward operation.
It can generate versatile label maps by interacting with language at novel viewpoints.
arXiv Detail & Related papers (2024-10-24T17:54:42Z) - SeMLaPS: Real-time Semantic Mapping with Latent Prior Networks and
Quasi-Planar Segmentation [53.83313235792596]
We present a new methodology for real-time semantic mapping from RGB-D sequences.
It combines a 2D neural network and a 3D network based on a SLAM system with 3D occupancy mapping.
Our system achieves state-of-the-art semantic mapping quality within 2D-3D networks-based systems.
arXiv Detail & Related papers (2023-06-28T22:36:44Z) - Unfolding Framework with Prior of Convolution-Transformer Mixture and
Uncertainty Estimation for Video Snapshot Compressive Imaging [7.601695814245209]
We consider the problem of video snapshot compressive imaging (SCI), where sequential high-speed frames are modulated by different masks and captured by a single measurement.
By combining optimization algorithms and neural networks, deep unfolding networks (DUNs) score tremendous achievements in solving inverse problems.
arXiv Detail & Related papers (2023-06-20T06:25:48Z) - GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction.
These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization.
We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
arXiv Detail & Related papers (2022-07-18T06:01:29Z) - Simple and Effective Synthesis of Indoor 3D Scenes [78.95697556834536]
We study the problem of immersive 3D indoor scenes from one or more images.
Our aim is to generate high-resolution images and videos from novel viewpoints.
We propose an image-to-image GAN that maps directly from reprojections of incomplete point clouds to full high-resolution RGB-D images.
arXiv Detail & Related papers (2022-04-06T17:54:46Z) - Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive
Imaging [6.289143409131908]
Snapshot imaging (SCI) aims to record three-dimensional signals via a two-dimensional camera.
We present a novel dense deep unfolding network (DUN) with 3D-CNN prior for SCI.
In order to promote network adaption, we propose a dense feature map compressive (DFMA) module.
arXiv Detail & Related papers (2021-09-14T09:42:42Z) - Physics Validation of Novel Convolutional 2D Architectures for Speeding
Up High Energy Physics Simulations [0.0]
We apply Geneversarative Adrial Networks (GANs), a deep learning technique, to replace the calorimeter detector simulations.
We develop new two-dimensional convolutional networks to solve the same 3D image generation problem faster.
Our results demonstrate a high physics accuracy and further consolidate the use of GANs for fast detector simulations.
arXiv Detail & Related papers (2021-05-19T07:24:23Z) - Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks [87.50632573601283]
We present a novel method for multi-view depth estimation from a single video.
Our method achieves temporally coherent depth estimation results by using a novel Epipolar Spatio-Temporal (EST) transformer.
To reduce the computational cost, inspired by recent Mixture-of-Experts models, we design a compact hybrid network.
arXiv Detail & Related papers (2020-11-26T04:04:21Z) - Fed-Sim: Federated Simulation for Medical Imaging [131.56325440976207]
We introduce a physics-driven generative approach that consists of two learnable neural modules.
We show that our data synthesis framework improves the downstream segmentation performance on several datasets.
arXiv Detail & Related papers (2020-09-01T19:17:46Z) - Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning [0.7664249650622356]
We introduce 3D-CDI-NN, a deep convolutional neural network and differential programming framework trained to predict 3D structure and strain.
Our networks are designed to be "physics-aware" in multiple aspects.
Our integrated machine learning and differential programming solution is broadly applicable across inverse problems in other application areas.
arXiv Detail & Related papers (2020-06-16T18:35:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.