Differentiable SAR Renderer and SAR Target Reconstruction

• URL: http://arxiv.org/abs/2205.07099v1
• Date: Sat, 14 May 2022 17:24:32 GMT
• Title: Differentiable SAR Renderer and SAR Target Reconstruction
• Authors: Shilei Fu, Feng Xu
• Abstract summary: A differentiable SAR (DSR) is developed which reformulates the mapping and projection of SAR imaging mechanism. A 3D inverse target reconstruction algorithm from SAR images is devised.
• Score: 7.840247953745616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Forward modeling of wave scattering and radar imaging mechanisms is the key to information extraction from synthetic aperture radar (SAR) images. Like inverse graphics in optical domain, an inherently-integrated forward-inverse approach would be promising for SAR advanced information retrieval and target reconstruction. This paper presents such an attempt to the inverse graphics for SAR imagery. A differentiable SAR renderer (DSR) is developed which reformulates the mapping and projection algorithm of SAR imaging mechanism in the differentiable form of probability maps. First-order gradients of the proposed DSR are then analytically derived which can be back-propagated from rendered image/silhouette to the target geometry and scattering attributes. A 3D inverse target reconstruction algorithm from SAR images is devised. Several simulation and reconstruction experiments are conducted, including targets with and without background, using both synthesized data or real measured inverse SAR (ISAR) data by ground radar. Results demonstrate the efficacy of the proposed DSR and its inverse approach.

Related papers

• Electrooptical Image Synthesis from SAR Imagery Using Generative Adversarial Networks [0.0]
  This research contributes to the field of remote sensing by bridging the gap between SAR and EO imagery. The results show significant improvements in interpretability, making SAR data more accessible for analysts familiar with EO imagery. Our research contributes to the field of remote sensing by bridging the gap between SAR and EO imagery, offering a novel tool for enhanced data interpretation.
  arXiv  Detail & Related papers  (2024-09-07T14:31:46Z)
• Deep Learning Based Speckle Filtering for Polarimetric SAR Images. Application to Sentinel-1 [51.404644401997736]
  We propose a complete framework to remove speckle in polarimetric SAR images using a convolutional neural network. Experiments show that the proposed approach offers exceptional results in both speckle reduction and resolution preservation.
  arXiv  Detail & Related papers  (2024-08-28T10:07:17Z)
• SAR-AE-SFP: SAR Imagery Adversarial Example in Real Physics domain with Target Scattering Feature Parameters [2.3930545422544856]
  Current adversarial example generation methods for SAR imagery operate in the 2D digital domain, known as image adversarial examples. This paper proposes SAR-AE-SFP-Attack, a method to generate real physics adversarial examples by altering the scattering feature parameters of target objects. Experimental results show that SAR-AE-SFP Attack significantly improves attack efficiency on CNN-based models and Transformer-based models.
  arXiv  Detail & Related papers  (2024-03-02T13:52:28Z)
• Learning Surface Scattering Parameters From SAR Images Using Differentiable Ray Tracing [8.19502673278742]
  This paper proposes a surface microwave rendering model that comprehensively considers both Specular and Diffuse contributions. A differentiable ray tracing (DRT) engine based on SAR images was constructed for CSVBSDF surface scattering parameter learning. The effectiveness of this approach has been validated through simulations and comparisons with real SAR images.
  arXiv  Detail & Related papers  (2024-01-02T12:09:06Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multi-View Representation [7.907504142396784]
  This study combines SAR imaging mechanisms with neural networks to propose a novel NeRF model for SAR image generation. SAR-NeRF is constructed to learn the distribution of attenuation coefficients and scattering intensities of voxels. It is found that SAR-NeRF augumented dataset can significantly improve SAR target classification performance under few-shot learning setup.
  arXiv  Detail & Related papers  (2023-07-11T07:37:56Z)
• Near-filed SAR Image Restoration with Deep Learning Inverse Technique: A Preliminary Study [5.489791364472879]
  Near-field synthetic aperture radar (SAR) provides a high-resolution image of a target's scattering distribution-hot spots. Meanwhile, imaging result suffers inevitable degradation from sidelobes, clutters, and noises. To restore the image, current methods make simplified assumptions; for example, the point spread function (PSF) is spatially consistent, the target consists of sparse point scatters, etc. We reformulate the degradation model into a spatially variable complex-convolution model, where the near-field SAR's system response is considered. A model-based deep learning network is designed to restore the
  arXiv  Detail & Related papers  (2022-11-28T01:28:33Z)
• SAR Despeckling using a Denoising Diffusion Probabilistic Model [52.25981472415249]
  The presence of speckle degrades the image quality and adversely affects the performance of SAR image understanding applications. We introduce SAR-DDPM, a denoising diffusion probabilistic model for SAR despeckling. The proposed method achieves significant improvements in both quantitative and qualitative results over the state-of-the-art despeckling methods.
  arXiv  Detail & Related papers  (2022-06-09T14:00:26Z)
• Transformer-based SAR Image Despeckling [53.99620005035804]
  We introduce a transformer-based network for SAR image despeckling. The proposed despeckling network comprises of a transformer-based encoder which allows the network to learn global dependencies between different image regions. Experiments show that the proposed method achieves significant improvements over traditional and convolutional neural network-based despeckling methods.
  arXiv  Detail & Related papers  (2022-01-23T20:09:01Z)
• Structure-Preserving Image Super-Resolution [94.16949589128296]
  Structures matter in single image super-resolution (SISR) Recent studies have promoted the development of SISR by recovering photo-realistic images. However, there are still undesired structural distortions in the recovered images.
  arXiv  Detail & Related papers  (2021-09-26T08:48:27Z)
• Structure-Preserving Super Resolution with Gradient Guidance [87.79271975960764]
  Structures matter in single image super resolution (SISR) Recent studies benefiting from generative adversarial network (GAN) have promoted the development of SISR. However, there are always undesired structural distortions in the recovered images.
  arXiv  Detail & Related papers  (2020-03-29T17:26:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.