Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data

• URL: http://arxiv.org/abs/2301.09152v2
• Date: Sat, 27 May 2023 09:11:48 GMT
• Title: Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data
• Authors: Shengchao Chen, Guodong Long, Tao Shen, Jing Jiang
• Abstract summary: To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. This paper develops a foundation model across regions of understanding complex meteorological data and providing weather forecasting. A novel prompt learning mechanism has been adopted to satisfy low-resourced sensors' communication and computational constraints.
• Score: 37.549578998407675
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries and regions, inevitably causing multivariate heterogeneity and data exposure, become the main barrier. This paper develops a foundation model across regions capable of understanding complex meteorological data and providing weather forecasting. To relieve the data exposure concern across regions, a novel federated learning approach has been proposed to collaboratively learn a brand-new spatio-temporal Transformer-based foundation model across participants with heterogeneous meteorological data. Moreover, a novel prompt learning mechanism has been adopted to satisfy low-resourced sensors' communication and computational constraints. The effectiveness of the proposed method has been demonstrated on classical weather forecasting tasks using three meteorological datasets with multivariate time series.

Related papers

• ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Models [13.740208247043258]
  We propose ClimateLLM, a foundation model for weather forecasting. It captures temporal dependencies via a cross-temporal and cross-spatial collaborative framework. It integrates frequency decomposition with Large Language Models to strengthen spatial and temporal modeling.
  arXiv  Detail & Related papers  (2025-02-16T09:57:50Z)
• A Generative Framework for Probabilistic, Spatiotemporally Coherent Downscaling of Climate Simulation [23.504915709396204]
  We present a novel generative framework that uses a score-based diffusion model trained on high-resolution reanalysis data to capture the statistical properties of local weather dynamics. We demonstrate that the model generates spatially and temporally coherent weather dynamics that align with global climate output.
  arXiv  Detail & Related papers  (2024-12-19T19:47:35Z)
• Tackling Data Heterogeneity in Federated Time Series Forecasting [61.021413959988216]
  Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Most existing methods rely on a centralized training paradigm, where large amounts of data are collected from distributed devices to a central cloud server. We propose a novel framework, Fed-TREND, to address data heterogeneity by generating informative synthetic data as auxiliary knowledge carriers.
  arXiv  Detail & Related papers  (2024-11-24T04:56:45Z)
• MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [68.69647625472464]
  Downscaling, a crucial task in meteorological forecasting, enables the reconstruction of high-resolution meteorological states for target regions. Previous downscaling methods lacked tailored designs for meteorology and encountered structural limitations. We propose a novel model called MambaDS, which enhances the utilization of multivariable correlations and topography information.
  arXiv  Detail & Related papers  (2024-08-20T13:45:49Z)
• SFANet: Spatial-Frequency Attention Network for Weather Forecasting [54.470205739015434]
  Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. Traditional methods often struggle to capture the complex dynamics of meteorological systems. We propose a novel framework designed to address these challenges and enhance the accuracy of weather prediction.
  arXiv  Detail & Related papers  (2024-05-29T08:00:15Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• A Distributed Approach to Meteorological Predictions: Addressing Data Imbalance in Precipitation Prediction Models through Federated Learning and GANs [0.0]
  classification of weather data involves categorizing meteorological phenomena into classes, thereby facilitating nuanced analyses and precise predictions. It's imperative that classification algorithms proficiently navigate challenges such as data imbalances. Data augmentation techniques can improve the model's accuracy in classifying rare but critical weather events.
  arXiv  Detail & Related papers  (2023-10-19T21:28:20Z)
• Spatiotemporal modeling of European paleoclimate using doubly sparse Gaussian processes [61.31361524229248]
  We build on recent scale sparsetemporal GPs to reduce the computational burden. We successfully employ such a doubly sparse GP to construct a probabilistic model of paleoclimate.
  arXiv  Detail & Related papers  (2022-11-15T14:15:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.