Simulating Nighttime Visible Satellite Imagery of Tropical Cyclones
Using Conditional Generative Adversarial Networks
- URL: http://arxiv.org/abs/2401.11679v1
- Date: Mon, 22 Jan 2024 03:44:35 GMT
- Title: Simulating Nighttime Visible Satellite Imagery of Tropical Cyclones
Using Conditional Generative Adversarial Networks
- Authors: Jinghuai Yao, Puyuan Du, Yucheng Zhao, and Yubo Wang
- Abstract summary: This study presents a Conditional Generative Adversarial Networks (CGAN) model that generates highly accurate nighttime visible reflectance.
The model was trained and validated using target area observations of the Advanced Himawari Imager (AHI) in the daytime.
This study also presents the first nighttime model validation using the Day/Night Band (DNB) of the Visible/Infrared Imager Radiometer Suite (VIIRS)
- Score: 10.76837828367292
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Visible (VIS) imagery of satellites has various important applications in
meteorology, including monitoring Tropical Cyclones (TCs). However, it is
unavailable at night because of the lack of sunlight. This study presents a
Conditional Generative Adversarial Networks (CGAN) model that generates highly
accurate nighttime visible reflectance using infrared (IR) bands and sunlight
direction parameters as input. The model was trained and validated using target
area observations of the Advanced Himawari Imager (AHI) in the daytime. This
study also presents the first nighttime model validation using the Day/Night
Band (DNB) of the Visible/Infrared Imager Radiometer Suite (VIIRS). The daytime
statistical results of the Structural Similarity Index Measure (SSIM), Peak
Signal-to-Noise Ratio (PSNR), Root Mean Square Error (RMSE), Correlation
Coefficient (CC), and Bias are 0.885, 28.3, 0.0428, 0.984, and -0.0016
respectively, completely surpassing the model performance of previous studies.
The nighttime statistical results of SSIM, PSNR, RMSE, and CC are 0.821, 24.4,
0.0643, and 0.969 respectively, which are slightly negatively impacted by the
parallax between satellites. We performed full-disk model validation which
proves our model could also be readily applied in the tropical ocean without
TCs in the northern hemisphere. This model contributes to the nighttime
monitoring of meteorological phenomena by providing accurate AI-generated
visible imagery with adjustable virtual sunlight directions.
Related papers
- Residual Diffusion Modeling for Km-scale Atmospheric Downscaling [51.061954281398116]
A cost-effective downscaling model is trained from a high-resolution 2-km weather model over Taiwan.
textitCorrDiff exhibits skillful RMSE and CRPS and faithfully recovers spectra and distributions even for extremes.
Downscaling global forecasts successfully retains many of these benefits, foreshadowing the potential of end-to-end, global-to-km-scales machine learning weather predictions.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Hierarchical-level rain image generative model based on GAN [4.956959291938016]
hierarchical-level rain image generative model, rain conditional CycleGAN, is constructed.
Different rain intensities are introduced as labels in conditional GAN.
Model structure is optimized and the training strategy is adjusted to alleviate the problem of mode collapse.
arXiv Detail & Related papers (2023-09-06T12:59:52Z) - NeRF applied to satellite imagery for surface reconstruction [5.027411102165872]
We present Surf-NeRF, a modified implementation of the recently introduced Shadow Neural Radiance Field (S-NeRF) model.
This method is able to synthesize novel views from a sparse set of satellite images of a scene, while accounting for the variation in lighting present in the pictures.
The trained model can also be used to accurately estimate the surface elevation of the scene, which is often a desirable quantity for satellite observation applications.
arXiv Detail & Related papers (2023-04-09T01:37:13Z) - PRISM: Probabilistic Real-Time Inference in Spatial World Models [52.878769723544615]
PRISM is a method for real-time filtering in a probabilistic generative model of agent motion and visual perception.
The proposed solution runs at 10Hz real-time and is similarly accurate to state-of-the-art SLAM in small to medium-sized indoor environments.
arXiv Detail & Related papers (2022-12-06T13:59:06Z) - DL-Corrector-Remapper: A grid-free bias-correction deep learning
methodology for data-driven high-resolution global weather forecasting [11.334341754942917]
We develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FourCastNet (FCN)
This is akin to bias correction and post-processing of numerical weather prediction (NWP)
We call this network the Deep-Learning-Corrector-Remapper (DLCR)
arXiv Detail & Related papers (2022-10-21T23:04:44Z) - Vision in adverse weather: Augmentation using CycleGANs with various
object detectors for robust perception in autonomous racing [70.16043883381677]
In autonomous racing, the weather can change abruptly, causing significant degradation in perception, resulting in ineffective manoeuvres.
In order to improve detection in adverse weather, deep-learning-based models typically require extensive datasets captured in such conditions.
We introduce an approach of using synthesised adverse condition datasets in autonomous racing (generated using CycleGAN) to improve the performance of four out of five state-of-the-art detectors.
arXiv Detail & Related papers (2022-01-10T10:02:40Z) - A Multi-Stage model based on YOLOv3 for defect detection in PV panels
based on IR and Visible Imaging by Unmanned Aerial Vehicle [65.99880594435643]
We propose a novel model to detect panel defects on aerial images captured by unmanned aerial vehicle.
The model combines detections of panels and defects to refine its accuracy.
The proposed model has been validated on two big PV plants in the south of Italy.
arXiv Detail & Related papers (2021-11-23T08:04:32Z) - Creating synthetic meteorology satellite visible light images during
night based on GAN method [0.0]
We propose a method based on deep learning to create synthetic satellite visible light images during night.
Specifically, we train a Generative Adversarial Networks (GAN) model to generate visible light images.
Experiments based on ECMWF NWP products and FY-4A meteorology satellite visible light and infrared channels date show that the proposed methods can be effective.
arXiv Detail & Related papers (2021-07-21T16:05:26Z) - Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of
Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars.
They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
arXiv Detail & Related papers (2021-07-14T21:10:47Z) - Real-time Tropical Cyclone Intensity Estimation by Handling Temporally
Heterogeneous Satellite Data [33.528810128372704]
We propose a novel framework that combines generative adversarial network (GAN) with convolutional neural networks (CNN)
Experimental results demonstrate that the hybrid GAN-CNN framework achieves comparable precision to the state-of-the-art models.
arXiv Detail & Related papers (2020-10-28T13:40:07Z) - Conditional Variational Image Deraining [158.76814157115223]
Conditional Variational Image Deraining (CVID) network for better deraining performance.
We propose a spatial density estimation (SDE) module to estimate a rain density map for each image.
Experiments on synthesized and real-world datasets show that the proposed CVID network achieves much better performance than previous deterministic methods on image deraining.
arXiv Detail & Related papers (2020-04-23T11:51:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.