A Foundation Model for the Earth System
- URL: http://arxiv.org/abs/2405.13063v3
- Date: Thu, 21 Nov 2024 20:14:58 GMT
- Title: A Foundation Model for the Earth System
- Authors: Cristian Bodnar, Wessel P. Bruinsma, Ana Lucic, Megan Stanley, Anna Vaughan, Johannes Brandstetter, Patrick Garvan, Maik Riechert, Jonathan A. Weyn, Haiyu Dong, Jayesh K. Gupta, Kit Thambiratnam, Alexander T. Archibald, Chun-Chieh Wu, Elizabeth Heider, Max Welling, Richard E. Turner, Paris Perdikaris,
- Abstract summary: We introduce Aurora, a large-scale foundation model for the Earth system trained on over a million hours of diverse data.
Aurora outperforms operational forecasts for air quality, ocean waves, tropical cyclone tracks, and high-resolution weather forecasting at orders of magnitude smaller computational expense than dedicated existing systems.
- Score: 82.73624748093333
- License:
- Abstract: Reliable forecasts of the Earth system are crucial for human progress and safety from natural disasters. Artificial intelligence offers substantial potential to improve prediction accuracy and computational efficiency in this field, however this remains underexplored in many domains. Here we introduce Aurora, a large-scale foundation model for the Earth system trained on over a million hours of diverse data. Aurora outperforms operational forecasts for air quality, ocean waves, tropical cyclone tracks, and high-resolution weather forecasting at orders of magnitude smaller computational expense than dedicated existing systems. With the ability to fine-tune Aurora to diverse application domains at only modest computational cost, Aurora represents significant progress in making actionable Earth system predictions accessible to anyone.
Related papers
- Predicting the energetic proton flux with a machine learning regression algorithm [0.0]
We present a machine learning regression algorithm which is able to forecast the energetic proton flux up to 1 hour ahead.
This approach could be helpful to improve monitoring systems of the radiation risk in both deep space and near-Earth environments.
arXiv Detail & Related papers (2024-06-18T15:54:50Z) - FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather
Forecasting [56.73502043159699]
This work presents FengWu-GHR, the first data-driven global weather forecasting model running at the 0.09$circ$ horizontal resolution.
It introduces a novel approach that opens the door for operating ML-based high-resolution forecasts by inheriting prior knowledge from a low-resolution model.
The hindcast of weather prediction in 2022 indicates that FengWu-GHR is superior to the IFS-HRES.
arXiv Detail & Related papers (2024-01-28T13:23:25Z) - WindSeer: Real-time volumetric wind prediction over complex terrain
aboard a small UAV [29.345342470012724]
We train a neural network, WindSeer, using only synthetic data from computational fluid dynamics simulations.
WindSeer can generate accurate predictions at different resolutions and domain sizes on previously unseen topography without retraining.
We demonstrate that the model successfully predicts historical wind data collected by weather stations and wind measured onboard drones.
arXiv Detail & Related papers (2024-01-18T12:46:26Z) - Towards an end-to-end artificial intelligence driven global weather forecasting system [57.5191940978886]
We present an AI-based data assimilation model, i.e., Adas, for global weather variables.
We demonstrate that Adas can assimilate global observations to produce high-quality analysis, enabling the system operate stably for long term.
We are the first to apply the methods to real-world scenarios, which is more challenging and has considerable practical application potential.
arXiv Detail & Related papers (2023-12-18T09:05:28Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance.
We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach.
Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
arXiv Detail & Related papers (2023-09-12T13:28:06Z) - Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global
Weather Forecast [91.9372563527801]
We present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast.
For the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy.
Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast and large-member ensemble forecast in real-time.
arXiv Detail & Related papers (2022-11-03T17:19:43Z) - Deep Learning for Rain Fade Prediction in Satellite Communications [6.619650459583444]
Line of sight satellite systems, unmanned aerial vehicles, high-altitude platforms, and microwave links are extremely susceptible to rain.
Rain fade forecasting for these systems is critical because it allows the system to switch between ground gateways proactively before a rain fade event to maintain seamless service.
Deep learning architecture is proposed that forecasts future rain fade using satellite and radar imagery data as well as link power measurements.
arXiv Detail & Related papers (2021-10-02T00:43:02Z) - Simultaneously forecasting global geomagnetic activity using Recurrent
Networks [0.3867363075280544]
We present a sequence-to-sequence learning approach to the problem of forecasting global space weather conditions at an hourly resolution.
We demonstrate an improvement over the best currently known predictor of geomagnetic storms, and an improvement over a persistence baseline several hours in advance.
arXiv Detail & Related papers (2020-10-13T15:48:20Z) - A Framework for Designing and Evaluating Solar Flare Forecasting Systems [0.0]
Solar flares are the most significant events that can affect the Earth's atmosphere.
This paper proposes a framework to design, train, and evaluate flare prediction systems.
arXiv Detail & Related papers (2020-05-05T21:05:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.