A Distributed Approach to Meteorological Predictions: Addressing Data Imbalance in Precipitation Prediction Models through Federated Learning and GANs

• URL: http://arxiv.org/abs/2310.13161v1
• Date: Thu, 19 Oct 2023 21:28:20 GMT
• Title: A Distributed Approach to Meteorological Predictions: Addressing Data Imbalance in Precipitation Prediction Models through Federated Learning and GANs
• Authors: Elaheh Jafarigol, Theodore Trafalis
• Abstract summary: classification of weather data involves categorizing meteorological phenomena into classes, thereby facilitating nuanced analyses and precise predictions. It's imperative that classification algorithms proficiently navigate challenges such as data imbalances. Data augmentation techniques can improve the model's accuracy in classifying rare but critical weather events.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The classification of weather data involves categorizing meteorological phenomena into classes, thereby facilitating nuanced analyses and precise predictions for various sectors such as agriculture, aviation, and disaster management. This involves utilizing machine learning models to analyze large, multidimensional weather datasets for patterns and trends. These datasets may include variables such as temperature, humidity, wind speed, and pressure, contributing to meteorological conditions. Furthermore, it's imperative that classification algorithms proficiently navigate challenges such as data imbalances, where certain weather events (e.g., storms or extreme temperatures) might be underrepresented. This empirical study explores data augmentation methods to address imbalanced classes in tabular weather data in centralized and federated settings. Employing data augmentation techniques such as the Synthetic Minority Over-sampling Technique or Generative Adversarial Networks can improve the model's accuracy in classifying rare but critical weather events. Moreover, with advancements in federated learning, machine learning models can be trained across decentralized databases, ensuring privacy and data integrity while mitigating the need for centralized data storage and processing. Thus, the classification of weather data stands as a critical bridge, linking raw meteorological data to actionable insights, enhancing our capacity to anticipate and prepare for diverse weather conditions.

Related papers

• Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling [55.13352174687475]
  This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which Generalizes weather forecasts to Finer-grained Temporal scales. Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale. We introduce a lead time-aware training framework to promote the generalization of the model at different lead times.
  arXiv  Detail & Related papers  (2024-05-22T16:21:02Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation [67.20588721130623]
  We develop an AI-based cyclic weather forecasting system, FengWu-4DVar. FengWu-4DVar can incorporate observational data into the data-driven weather forecasting model. Experiments on the simulated observational dataset demonstrate that FengWu-4DVar is capable of generating reasonable analysis fields.
  arXiv  Detail & Related papers  (2023-12-16T02:07:56Z)
• Digital Typhoon: Long-term Satellite Image Dataset for the Spatio-Temporal Modeling of Tropical Cyclones [0.907599024697789]
  This paper presents the official release of the longest typhoon satellite image dataset for 40+ years. It is aimed at benchmarking machine learning models for long-term-temporal data. The dataset is publicly available at http://agora.nii.ac.jp/digital-typhoon/.
  arXiv  Detail & Related papers  (2023-11-05T14:22:13Z)
• ClimaX: A foundation model for weather and climate [51.208269971019504]
  ClimaX is a deep learning model for weather and climate science. It can be pre-trained with a self-supervised learning objective on climate datasets. It can be fine-tuned to address a breadth of climate and weather tasks.
  arXiv  Detail & Related papers  (2023-01-24T23:19:01Z)
• Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Data [37.549578998407675]
  To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. This paper develops a foundation model across regions of understanding complex meteorological data and providing weather forecasting. A novel prompt learning mechanism has been adopted to satisfy low-resourced sensors' communication and computational constraints.
  arXiv  Detail & Related papers  (2023-01-22T16:47:05Z)
• Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
  We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs) We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future. Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
  arXiv  Detail & Related papers  (2022-02-10T11:37:00Z)
• Identifying Distributional Differences in Convective Evolution Prior to Rapid Intensification in Tropical Cyclones [4.925967492198013]
  Tropical cyclone (TC) intensity forecasts are issued by human forecasters every 6 hours. Within these time constraints, it can be challenging to draw insight from such data. Here we leverage powerful AI prediction algorithms and classical statistical inference to identify patterns in the evolution of TC structure leading up to the rapid intensification of a storm.
  arXiv  Detail & Related papers  (2021-09-24T15:33:29Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)
• RainBench: Towards Global Precipitation Forecasting from Satellite Imagery [6.462260770989231]
  Extreme precipitation events routinely ravage economies and livelihoods around the developing world. Data-driven deep learning approaches could widen the access to accurate multi-day forecasts. There is currently no benchmark dataset dedicated to the study of global precipitation forecasts.
  arXiv  Detail & Related papers  (2020-12-17T15:35:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.