A 3D super-resolution of wind fields via physics-informed pixel-wise
self-attention generative adversarial network
- URL: http://arxiv.org/abs/2312.13212v1
- Date: Wed, 20 Dec 2023 17:28:21 GMT
- Title: A 3D super-resolution of wind fields via physics-informed pixel-wise
self-attention generative adversarial network
- Authors: Takuya Kurihana, Kyongmin Yeo, Daniela Szwarcman, Bruce Elmegreen,
Karthik Mukkavilli, Johannes Schmude, Levente Klein
- Abstract summary: complexity of computation in resolving high-resolution wind fields left simulations impractical to test different time lengths and model configurations.
This study presents a preliminary development of a physics-informed super-resolution (SR) generative adversarial network (GAN)
GAN super-resolves the three-dimensional (3D) low-resolution wind fields by upscaling x9 times.
- Score: 0.01649298969786889
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: To mitigate global warming, greenhouse gas sources need to be resolved at a
high spatial resolution and monitored in time to ensure the reduction and
ultimately elimination of the pollution source. However, the complexity of
computation in resolving high-resolution wind fields left the simulations
impractical to test different time lengths and model configurations. This study
presents a preliminary development of a physics-informed super-resolution (SR)
generative adversarial network (GAN) that super-resolves the three-dimensional
(3D) low-resolution wind fields by upscaling x9 times. We develop a pixel-wise
self-attention (PWA) module that learns 3D weather dynamics via a
self-attention computation followed by a 2D convolution. We also employ a loss
term that regularizes the self-attention map during pretraining, capturing the
vertical convection process from input wind data. The new PWA SR-GAN shows the
high-fidelity super-resolved 3D wind data, learns a wind structure at the
high-frequency domain, and reduces the computational cost of a high-resolution
wind simulation by x89.7 times.
Related papers
- SuperNeRF-GAN: A Universal 3D-Consistent Super-Resolution Framework for Efficient and Enhanced 3D-Aware Image Synthesis [59.73403876485574]
We propose SuperNeRF-GAN, a universal framework for 3D-consistent super-resolution.
A key highlight of SuperNeRF-GAN is its seamless integration with NeRF-based 3D-aware image synthesis methods.
Experimental results demonstrate the superior efficiency, 3D-consistency, and quality of our approach.
arXiv Detail & Related papers (2025-01-12T10:31:33Z) - A Staged Deep Learning Approach to Spatial Refinement in 3D Temporal Atmospheric Transport [0.0]
We introduce the Dual-Stage Temporal Three-dimensional Super-resolution (DST3D-UNet-SR) model for plume dispersion prediction.
It is composed of two sequential modules: the temporal module (TM), which predicts the transient evolution of a plume in complex terrain from low-resolution temporal data, and the spatial refinement module (SRM), which subsequently enhances the spatial resolution of the predictions.
arXiv Detail & Related papers (2024-12-14T19:43:48Z) - CESAR: A Convolutional Echo State AutoencodeR for High-Resolution Wind Forecasting [0.0]
Wind energy, especially high resolution, calls for the development of nonlinear statistical models.
This work introduces a Convolutional Echo State AutoencodeRCESAR network-based model.
We show how CESAR is able to provide improved forecasting of wind speed and power for proposed building sites by up to 17%.
arXiv Detail & Related papers (2024-12-13T21:41:59Z) - FOF-X: Towards Real-time Detailed Human Reconstruction from a Single Image [68.84221452621674]
We introduce FOF-X for real-time reconstruction of detailed human geometry from a single image.
FOF-X avoids the performance degradation caused by texture and lighting.
We enhance the inter-conversion algorithms between FOF and mesh representations with a Laplacian constraint and an automaton-based discontinuity matcher.
arXiv Detail & Related papers (2024-12-08T14:46:29Z) - Interpolation-Free Deep Learning for Meteorological Downscaling on Unaligned Grids Across Multiple Domains with Application to Wind Power [0.0]
Wind energy production is set to accelerate, and reliable wind probabilistic forecasts are essential to ensure its efficient use.
Since numerical weather prediction models are computationally expensive, probabilistic forecasts are produced at resolutions too coarse to capture all mesoscale wind behaviors.
Statistical downscaling presents a viable solution with lower computational costs by learning a mapping from low-resolution (LR) variables to high-resolution (HR) meteorological variables.
arXiv Detail & Related papers (2024-10-04T22:04:40Z) - Super-Resolution works for coastal simulations [6.263499279406057]
High-resolution simulations are necessary to advance understanding of many processes, specifically, to predict flooding from tsunamis and storm surges.
We propose a Deep Network for Super-resolution enhancement to efficiently learn high-resolution numerical solutions.
Our method shows superior super-resolution quality and fast computation compared to the state-of-the-art methods.
arXiv Detail & Related papers (2024-08-29T14:16:13Z) - StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D [88.66678730537777]
We present StableDreamer, a methodology incorporating three advances.
First, we formalize the equivalence of the SDS generative prior and a simple supervised L2 reconstruction loss.
Second, our analysis shows that while image-space diffusion contributes to geometric precision, latent-space diffusion is crucial for vivid color rendition.
arXiv Detail & Related papers (2023-12-02T02:27:58Z) - Enhancing wind field resolution in complex terrain through a knowledge-driven machine learning approach [0.0]
We show that a neural network-based model can reconstruct fully resolved 3D velocity fields from a coarser scale while respecting the local terrain.
We also demonstrate that using appropriate cost function based on domain knowledge, we can alleviate the use of adversarial training.
arXiv Detail & Related papers (2023-09-18T21:41:04Z) - Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal
Transformer [112.12271800369741]
Wind power is attracting increasing attention around the world due to its renewable, pollution-free, and other advantages.
Accurate wind power forecasting (WPF) can effectively reduce power fluctuations in power system operations.
Existing methods are mainly designed for short-term predictions and lack effective spatial-temporal feature augmentation.
arXiv Detail & Related papers (2023-05-30T04:03:15Z) - NeRF-GAN Distillation for Efficient 3D-Aware Generation with
Convolutions [97.27105725738016]
integration of Neural Radiance Fields (NeRFs) and generative models, such as Generative Adversarial Networks (GANs) has transformed 3D-aware generation from single-view images.
We propose a simple and effective method, based on re-using the well-disentangled latent space of a pre-trained NeRF-GAN in a pose-conditioned convolutional network to directly generate 3D-consistent images corresponding to the underlying 3D representations.
arXiv Detail & Related papers (2023-03-22T18:59:48Z) - 3D wind field profiles from hyperspectral sounders: revisiting
optic-flow from a meteorological perspective [0.0]
We present an efficient optic flow algorithm for the extraction of vertically resolved 3D atmospheric motion vector (AMV) data measures by Forecast sounders.
We show that the proposed recursion is superior to state-of-the-art optical flow algorithms in the real atmospheric sounding inter-II observations.
arXiv Detail & Related papers (2023-03-09T10:14:25Z) - SST: Real-time End-to-end Monocular 3D Reconstruction via Sparse
Spatial-Temporal Guidance [71.3027345302485]
Real-time monocular 3D reconstruction is a challenging problem that remains unsolved.
We propose an end-to-end 3D reconstruction network SST, which utilizes Sparse estimated points from visual SLAM system.
SST outperforms all state-of-the-art competitors, whilst keeping a high inference speed at 59 FPS.
arXiv Detail & Related papers (2022-12-13T12:17:13Z) - Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A
New Physics-Inspired Transformer Model [82.23276183684001]
We propose a physics-inspired transformer model for imaging through atmospheric turbulence.
The proposed network utilizes the power of transformer blocks to jointly extract a dynamical turbulence distortion map.
We present two new real-world turbulence datasets that allow for evaluation with both classical objective metrics and a new task-driven metric using text recognition accuracy.
arXiv Detail & Related papers (2022-07-20T17:09:16Z) - 3D Scattering Tomography by Deep Learning with Architecture Tailored to
Cloud Fields [12.139158398361866]
We present 3DeepCT, a deep neural network for computed tomography, which performs 3D reconstruction of scattering volumes from multi-view images.
We show that 3DeepCT outperforms physics-based inverse scattering methods in term of accuracy as well as offering a significant orders of magnitude improvement in computational time.
arXiv Detail & Related papers (2020-12-10T20:31:44Z) - Pseudo-LiDAR Point Cloud Interpolation Based on 3D Motion Representation
and Spatial Supervision [68.35777836993212]
We propose a Pseudo-LiDAR point cloud network to generate temporally and spatially high-quality point cloud sequences.
By exploiting the scene flow between point clouds, the proposed network is able to learn a more accurate representation of the 3D spatial motion relationship.
arXiv Detail & Related papers (2020-06-20T03:11:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.