Early Prediction of Geomagnetic Storms by Machine Learning Algorithms

• URL: http://arxiv.org/abs/2401.10290v1
• Date: Wed, 17 Jan 2024 05:17:40 GMT
• Title: Early Prediction of Geomagnetic Storms by Machine Learning Algorithms
• Authors: Iris Yan
• Abstract summary: Geomagnetic storms (GS) occur when solar winds disrupt Earth's magnetosphere. Estimate of direct economic impacts of a large scale GS exceeds $40 billion a day in the US. This work aims to predict all types of GS reliably and as early as possible using big data and machine learning algorithms.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Geomagnetic storms (GS) occur when solar winds disrupt Earth's magnetosphere. GS can cause severe damages to satellites, power grids, and communication infrastructures. Estimate of direct economic impacts of a large scale GS exceeds $40 billion a day in the US. Early prediction is critical in preventing and minimizing the hazards. However, current methods either predict several hours ahead but fail to identify all types of GS, or make predictions within short time, e.g., one hour ahead of the occurrence. This work aims to predict all types of geomagnetic storms reliably and as early as possible using big data and machine learning algorithms. By fusing big data collected from multiple ground stations in the world on different aspects of solar measurements and using Random Forests regression with feature selection and downsampling on minor geomagnetic storm instances (which carry majority of the data), we are able to achieve an accuracy of 82.55% on data collected in 2021 when making early predictions three hours in advance. Given that important predictive features such as historic Kp indices are measured every 3 hours and their importance decay quickly with the amount of time in advance, an early prediction of 3 hours ahead of time is believed to be close to the practical limit.

Related papers

• Spatio-Temporal Conformal Prediction for Power Outage Data [7.006561750578409]
  We analyze extensive quarter-hourly outage data and develop a graph conformal prediction method. We demonstrate the effectiveness of this method through extensive numerical experiments in several states affected by extreme weather events.
  arXiv  Detail & Related papers  (2024-11-26T04:34:38Z)
• Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection [67.40407388422514]
  We design a conceptual fine-grained causal model named TBN Granger Causality. Second, we propose an end-to-end deep generative model called TacSas, which discovers TBN Granger Causality in a generative manner. We test TacSas on climate benchmark ERA5 for climate forecasting and the extreme weather benchmark of NOAA for extreme weather alerts.
  arXiv  Detail & Related papers  (2024-08-08T06:47:21Z)
• Prediction of Space Weather Events through Analysis of Active Region Magnetograms using Convolutional Neural Network [0.0]
  Harmful space weather events can trigger atmospheric changes that result in physical and economic damages on a global scale. This study aims to leverage machine learning techniques to predict instances of space weather (solar flares, coronal mass ejections, geomagnetic storms) based on active region magnetograms of the Sun. By inputting the magnetograms into a convolutional neural network (CNN) trained from this dataset, it can serve to predict whether a space weather event will occur, and what type of event it will be.
  arXiv  Detail & Related papers  (2024-05-04T03:04:51Z)
• Back to the Future: GNN-based NO$_2$ Forecasting via Future Covariates [49.93577170464313]
  We deal with air quality observations in a city-wide network of ground monitoring stations. We propose a conditioning block that embeds past and future covariates into the current observations. We find that conditioning on future weather information has a greater impact than considering past traffic conditions.
  arXiv  Detail & Related papers  (2024-04-08T09:13:16Z)
• Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
  High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach. Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
  arXiv  Detail & Related papers  (2023-09-12T13:28:06Z)
• GraphCast: Learning skillful medium-range global weather forecasting [107.40054095223779]
  We introduce a machine learning-based method called "GraphCast", which can be trained directly from reanalysis data. It predicts hundreds of weather variables, over 10 days at 0.25 degree resolution globally, in under one minute. We show that GraphCast significantly outperforms the most accurate operational deterministic systems on 90% of 1380 verification targets.
  arXiv  Detail & Related papers  (2022-12-24T18:15:39Z)
• Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast [91.9372563527801]
  We present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy. Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast and large-member ensemble forecast in real-time.
  arXiv  Detail & Related papers  (2022-11-03T17:19:43Z)
• A Machine Learning and Computer Vision Approach to Geomagnetic Storm Forecasting [2.0499240875882]
  Geomagnetic storms are disturbances of Earth's magnetosphere caused by masses of charged particles being emitted from the Sun. Current prediction methods at NOAA are limited in that they depend on expensive solar wind spacecraft and a global-scale magnetometer sensor network. We introduce a novel machine learning and computer vision approach to accurately forecast geomagnetic storms without the need of such costly physical measurements.
  arXiv  Detail & Related papers  (2022-04-04T15:38:33Z)
• Simultaneously forecasting global geomagnetic activity using Recurrent Networks [0.3867363075280544]
  We present a sequence-to-sequence learning approach to the problem of forecasting global space weather conditions at an hourly resolution. We demonstrate an improvement over the best currently known predictor of geomagnetic storms, and an improvement over a persistence baseline several hours in advance.
  arXiv  Detail & Related papers  (2020-10-13T15:48:20Z)
• Machine learning as a flaring storm warning machine: Was a warning machine for the September 2017 solar flaring storm possible? [0.0]
  We show that machine learning could be utilized in a way to send timely warnings about the most violent and most unexpected flaring event of the last decade. We also show that the combination of sparsity-enhancing machine learning and feature ranking could allow the identification of the prominent role that energy played as an Active Region property in the forecasting process.
  arXiv  Detail & Related papers  (2020-07-05T19:03:54Z)
• A generative adversarial network approach to (ensemble) weather prediction [91.3755431537592]
  We use a conditional deep convolutional generative adversarial network to predict the geopotential height of the 500 hPa pressure level, the two-meter temperature and the total precipitation for the next 24 hours over Europe. The proposed models are trained on 4 years of ERA5 reanalysis data from 2015-2018 with the goal to predict the associated meteorological fields in 2019.
  arXiv  Detail & Related papers  (2020-06-13T20:53:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.