ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEs

• URL: http://arxiv.org/abs/2404.10024v1
• Date: Mon, 15 Apr 2024 06:38:21 GMT
• Title: ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEs
• Authors: Yogesh Verma, Markus Heinonen, Vikas Garg,
• Abstract summary: We present ClimODE, a continuous-time process that implements key principle of statistical mechanics. ClimODE models precise weather evolution with value-conserving dynamics, learning global weather transport as a neural flow. Our approach outperforms existing data-driven methods in global, regional forecasting with an order of magnitude smaller parameterization.
• Score: 14.095897879222676
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Climate and weather prediction traditionally relies on complex numerical simulations of atmospheric physics. Deep learning approaches, such as transformers, have recently challenged the simulation paradigm with complex network forecasts. However, they often act as data-driven black-box models that neglect the underlying physics and lack uncertainty quantification. We address these limitations with ClimODE, a spatiotemporal continuous-time process that implements a key principle of advection from statistical mechanics, namely, weather changes due to a spatial movement of quantities over time. ClimODE models precise weather evolution with value-conserving dynamics, learning global weather transport as a neural flow, which also enables estimating the uncertainty in predictions. Our approach outperforms existing data-driven methods in global and regional forecasting with an order of magnitude smaller parameterization, establishing a new state of the art.

Related papers

• Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting [20.135470301151727]
  We present WeatherODE, a novel one-stage, physics-driven ordinary differential equation (ODE) model designed to enhance weather forecasting accuracy. By leveraging wave equation theory and integrating a time-dependent source model, WeatherODE effectively addresses the challenges associated with time-discretization error and dynamic atmospheric processes. WeatherODE demonstrates superior performance in both global and regional weather forecasting tasks, outperforming recent state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-10-09T05:41:24Z)
• Efficient Localized Adaptation of Neural Weather Forecasting: A Case Study in the MENA Region [62.09891513612252]
  We focus on limited-area modeling and train our model specifically for localized region-level downstream tasks. We consider the MENA region due to its unique climatic challenges, where accurate localized weather forecasting is crucial for managing water resources, agriculture and mitigating the impacts of extreme weather events. Our study aims to validate the effectiveness of integrating parameter-efficient fine-tuning (PEFT) methodologies, specifically Low-Rank Adaptation (LoRA) and its variants, to enhance forecast accuracy, as well as training speed, computational resource utilization, and memory efficiency in weather and climate modeling for specific regions.
  arXiv  Detail & Related papers  (2024-09-11T19:31:56Z)
• Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling [55.13352174687475]
  This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which Generalizes weather forecasts to Finer-grained Temporal scales. Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale. We introduce a lead time-aware training framework to promote the generalization of the model at different lead times.
  arXiv  Detail & Related papers  (2024-05-22T16:21:02Z)
• STC-ViT: Spatio Temporal Continuous Vision Transformer for Weather Forecasting [0.0]
  We present STC-ViT, a Spatio-Temporal Continuous Transformer Vision for weather forecasting. STC-ViT incorporates the continuous time Neural ODE layers with multi-head attention mechanism to learn the continuous weather evolution over time. We evaluate STC-ViT against operational Numerical Weather Prediction (NWP) model and several deep learning based weather forecasting models.
  arXiv  Detail & Related papers  (2024-02-28T01:15:30Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Learning Robust Precipitation Forecaster by Temporal Frame Interpolation [65.5045412005064]
  We develop a robust precipitation forecasting model that demonstrates resilience against spatial-temporal discrepancies. Our approach has led to significant improvements in forecasting precision, culminating in our model securing textit1st place in the transfer learning leaderboard of the textitWeather4cast'23 competition.
  arXiv  Detail & Related papers  (2023-11-30T08:22:08Z)
• ClimaX: A foundation model for weather and climate [51.208269971019504]
  ClimaX is a deep learning model for weather and climate science. It can be pre-trained with a self-supervised learning objective on climate datasets. It can be fine-tuned to address a breadth of climate and weather tasks.
  arXiv  Detail & Related papers  (2023-01-24T23:19:01Z)
• Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks [8.086653045816151]
  Current operational forecasting models are based on physics and use supercomputers to simulate the atmosphere. An emerging class of weather models based on neural networks represents a paradigm shift in weather forecasting. We present a neural network that is capable of large-scale precipitation forecasting up to twelve hours ahead.
  arXiv  Detail & Related papers  (2021-11-14T22:53:04Z)
• TRU-NET: A Deep Learning Approach to High Resolution Prediction of Rainfall [21.399707529966474]
  We present TRU-NET, an encoder-decoder model featuring a novel 2D cross attention mechanism between contiguous convolutional-recurrent layers. We use a conditional-continuous loss function to capture the zero-skewed %extreme event patterns of rainfall. Experiments show that our model consistently attains lower RMSE and MAE scores than a DL model prevalent in short term precipitation prediction.
  arXiv  Detail & Related papers  (2020-08-20T17:27:59Z)
• Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere [7.918783985810551]
  We present a significantly-improved data-driven global weather forecasting framework using a deep convolutional neural network (CNN) New developments in this framework include an offline volume-conservative mapping to a cubed-sphere grid. Our model is able to learn to forecast complex surface temperature patterns from few input atmospheric state variables.
  arXiv  Detail & Related papers  (2020-03-15T19:57:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.