Simulating Nighttime Visible Satellite Imagery of Tropical Cyclones Using Conditional Generative Adversarial Networks

• URL: http://arxiv.org/abs/2401.11679v1
• Date: Mon, 22 Jan 2024 03:44:35 GMT
• Title: Simulating Nighttime Visible Satellite Imagery of Tropical Cyclones Using Conditional Generative Adversarial Networks
• Authors: Jinghuai Yao, Puyuan Du, Yucheng Zhao, and Yubo Wang
• Abstract summary: This study presents a Conditional Generative Adversarial Networks (CGAN) model that generates highly accurate nighttime visible reflectance. The model was trained and validated using target area observations of the Advanced Himawari Imager (AHI) in the daytime. This study also presents the first nighttime model validation using the Day/Night Band (DNB) of the Visible/Infrared Imager Radiometer Suite (VIIRS)
• Score: 10.76837828367292
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visible (VIS) imagery of satellites has various important applications in meteorology, including monitoring Tropical Cyclones (TCs). However, it is unavailable at night because of the lack of sunlight. This study presents a Conditional Generative Adversarial Networks (CGAN) model that generates highly accurate nighttime visible reflectance using infrared (IR) bands and sunlight direction parameters as input. The model was trained and validated using target area observations of the Advanced Himawari Imager (AHI) in the daytime. This study also presents the first nighttime model validation using the Day/Night Band (DNB) of the Visible/Infrared Imager Radiometer Suite (VIIRS). The daytime statistical results of the Structural Similarity Index Measure (SSIM), Peak Signal-to-Noise Ratio (PSNR), Root Mean Square Error (RMSE), Correlation Coefficient (CC), and Bias are 0.885, 28.3, 0.0428, 0.984, and -0.0016 respectively, completely surpassing the model performance of previous studies. The nighttime statistical results of SSIM, PSNR, RMSE, and CC are 0.821, 24.4, 0.0643, and 0.969 respectively, which are slightly negatively impacted by the parallax between satellites. We performed full-disk model validation which proves our model could also be readily applied in the tropical ocean without TCs in the northern hemisphere. This model contributes to the nighttime monitoring of meteorological phenomena by providing accurate AI-generated visible imagery with adjustable virtual sunlight directions.

Related papers

• Estimating Atmospheric Variables from Digital Typhoon Satellite Images via Conditional Denoising Diffusion Models [0.0]
  This study explores the application of diffusion models in the field of typhoons. The focus of this study is taken to be Taiwan, an area very vulnerable to typhoons.
  arXiv  Detail & Related papers  (2024-09-12T11:42:40Z)
• Enhancing Robustness of Human Detection Algorithms in Maritime SAR through Augmented Aerial Images to Simulate Weather Conditions [1.660242118349614]
  This paper aims to improve the model's accuracy of human detection in maritime SAR by evaluating a robust datasets containing various elevations and geological locations. We observed that models trained on augmented datasets outperformed their non-augmented counterparts in which the human recall scores ranged from 0.891 to 0.911 with an improvement rate of 3.4% on the YOLOv5l model.
  arXiv  Detail & Related papers  (2024-08-25T08:23:06Z)
• Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection [67.40407388422514]
  We design a conceptual fine-grained causal model named TBN Granger Causality. Second, we propose an end-to-end deep generative model called TacSas, which discovers TBN Granger Causality in a generative manner. We test TacSas on climate benchmark ERA5 for climate forecasting and the extreme weather benchmark of NOAA for extreme weather alerts.
  arXiv  Detail & Related papers  (2024-08-08T06:47:21Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• PRISM: Probabilistic Real-Time Inference in Spatial World Models [52.878769723544615]
  PRISM is a method for real-time filtering in a probabilistic generative model of agent motion and visual perception. The proposed solution runs at 10Hz real-time and is similarly accurate to state-of-the-art SLAM in small to medium-sized indoor environments.
  arXiv  Detail & Related papers  (2022-12-06T13:59:06Z)
• DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting [11.334341754942917]
  We develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FourCastNet (FCN) This is akin to bias correction and post-processing of numerical weather prediction (NWP) We call this network the Deep-Learning-Corrector-Remapper (DLCR)
  arXiv  Detail & Related papers  (2022-10-21T23:04:44Z)
• Vision in adverse weather: Augmentation using CycleGANs with various object detectors for robust perception in autonomous racing [70.16043883381677]
  In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres. In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions. We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
  arXiv  Detail & Related papers  (2022-01-10T10:02:40Z)
• Creating synthetic meteorology satellite visible light images during night based on GAN method [0.0]
  We propose a method based on deep learning to create synthetic satellite visible light images during night. Specifically, we train a Generative Adversarial Networks (GAN) model to generate visible light images. Experiments based on ECMWF NWP products and FY-4A meteorology satellite visible light and infrared channels date show that the proposed methods can be effective.
  arXiv  Detail & Related papers  (2021-07-21T16:05:26Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• Real-time Tropical Cyclone Intensity Estimation by Handling Temporally Heterogeneous Satellite Data [33.528810128372704]
  We propose a novel framework that combines generative adversarial network (GAN) with convolutional neural networks (CNN) Experimental results demonstrate that the hybrid GAN-CNN framework achieves comparable precision to the state-of-the-art models.
  arXiv  Detail & Related papers  (2020-10-28T13:40:07Z)
• Conditional Variational Image Deraining [158.76814157115223]
  Conditional Variational Image Deraining (CVID) network for better deraining performance. We propose a spatial density estimation (SDE) module to estimate a rain density map for each image. Experiments on synthesized and real-world datasets show that the proposed CVID network achieves much better performance than previous deterministic methods on image deraining.
  arXiv  Detail & Related papers  (2020-04-23T11:51:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.