On the Opportunities of (Re)-Exploring Atmospheric Science by Foundation Models: A Case Study

• URL: http://arxiv.org/abs/2407.17842v1
• Date: Thu, 25 Jul 2024 07:57:34 GMT
• Title: On the Opportunities of (Re)-Exploring Atmospheric Science by Foundation Models: A Case Study
• Authors: Lujia Zhang, Hanzhe Cui, Yurong Song, Chenyue Li, Binhang Yuan, Mengqian Lu,
• Abstract summary: Most state-of-the-art AI applications in atmospheric science are based on classic deep learning approaches. This report explores how the state-of-the-art foundation model, i.e., GPT-4o, performs various atmospheric scientific tasks.
• Score: 2.672038860046272
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Most state-of-the-art AI applications in atmospheric science are based on classic deep learning approaches. However, such approaches cannot automatically integrate multiple complicated procedures to construct an intelligent agent, since each functionality is enabled by a separate model learned from independent climate datasets. The emergence of foundation models, especially multimodal foundation models, with their ability to process heterogeneous input data and execute complex tasks, offers a substantial opportunity to overcome this challenge. In this report, we want to explore a central question - how the state-of-the-art foundation model, i.e., GPT-4o, performs various atmospheric scientific tasks. Toward this end, we conduct a case study by categorizing the tasks into four main classes, including climate data processing, physical diagnosis, forecast and prediction, and adaptation and mitigation. For each task, we comprehensively evaluate the GPT-4o's performance along with a concrete discussion. We hope that this report may shed new light on future AI applications and research in atmospheric science.

Related papers

• Foundation Models for Remote Sensing and Earth Observation: A Survey [101.77425018347557]
  This survey systematically reviews the emerging field of Remote Sensing Foundation Models (RSFMs) It begins with an outline of their motivation and background, followed by an introduction of their foundational concepts. We benchmark these models against publicly available datasets, discuss existing challenges, and propose future research directions.
  arXiv  Detail & Related papers  (2024-10-22T01:08:21Z)
• A Foundation Model for the Solar Dynamics Observatory [2.63089646549647]
  SDO-FM is a foundation model using data from NASA's Solar Dynamics Observatory (SDO) spacecraft. This paper marks release of our pretrained models and embedding datasets, available to the community on Hugging Face and sdofm.org.
  arXiv  Detail & Related papers  (2024-10-03T14:36:32Z)
• FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation [67.20588721130623]
  We develop an AI-based cyclic weather forecasting system, FengWu-4DVar. FengWu-4DVar can incorporate observational data into the data-driven weather forecasting model. Experiments on the simulated observational dataset demonstrate that FengWu-4DVar is capable of generating reasonable analysis fields.
  arXiv  Detail & Related papers  (2023-12-16T02:07:56Z)
• Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey [39.08108001903514]
  We offer an exhaustive, timely overview of state-of-the-art AI methodologies specifically engineered for weather and climate data. Our primary coverage encompasses four critical aspects: types of weather and climate data, principal model, model scopes and applications, and datasets for weather and climate.
  arXiv  Detail & Related papers  (2023-12-05T01:10:54Z)
• Causal machine learning for single-cell genomics [94.28105176231739]
  We discuss the application of machine learning techniques to single-cell genomics and their challenges. We first present the model that underlies most of current causal approaches to single-cell biology. We then identify open problems in the application of causal approaches to single-cell data.
  arXiv  Detail & Related papers  (2023-10-23T13:35:24Z)
• When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System [6.445323648941926]
  Geoscience foundation models (GFMs) are a paradigm-shifting solution, integrating extensive cross-disciplinary data to enhance the simulation and understanding of Earth system dynamics. The unique strengths of GFMs include flexible task specification, diverse input-output capabilities, and multi-modal knowledge representation. This review offers a comprehensive overview of emerging geoscientific research paradigms, emphasizing the untapped opportunities at the intersection of advanced AI techniques and geoscience.
  arXiv  Detail & Related papers  (2023-09-13T08:44:09Z)
• Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems [268.585904751315]
  New area of research known as AI for science (AI4Science) Areas aim at understanding the physical world from subatomic (wavefunctions and electron density), atomic (molecules, proteins, materials, and interactions), to macro (fluids, climate, and subsurface) scales. Key common challenge is how to capture physics first principles, especially symmetries, in natural systems by deep learning methods.
  arXiv  Detail & Related papers  (2023-07-17T12:14:14Z)
• Perspectives on AI Architectures and Co-design for Earth System Predictability [3.844947514183043]
  A total of 17 technical sessions were held in this AI4ESP workshop series. This paper discusses the topic of the AI Architectures and Co-design' session and associated outcomes.
  arXiv  Detail & Related papers  (2023-04-07T17:36:24Z)
• Climate Intervention Analysis using AI Model Guided by Statistical Physics Principles [6.824166358727082]
  We propose a novel solution by utilizing a principle from statistical physics known as the Fluctuation-Dissipation Theorem (FDT) By leveraging, we are able to extract information encoded in a large dataset produced by Earth System Models. Our model, AiBEDO, is capable of capturing the complex, multi-timescale effects of radiation perturbations on global and regional surface climate.
  arXiv  Detail & Related papers  (2023-02-07T05:09:10Z)
• Simulation Intelligence: Towards a New Generation of Scientific Methods [81.75565391122751]
  "Nine Motifs of Simulation Intelligence" is a roadmap for the development and integration of the essential algorithms necessary for a merger of scientific computing, scientific simulation, and artificial intelligence. We argue the motifs of simulation intelligence are interconnected and interdependent, much like the components within the layers of an operating system. We believe coordinated efforts between motifs offers immense opportunity to accelerate scientific discovery.
  arXiv  Detail & Related papers  (2021-12-06T18:45:31Z)
• OPEn: An Open-ended Physics Environment for Learning Without a Task [132.6062618135179]
  We will study if models of the world learned in an open-ended physics environment, without any specific tasks, can be reused for downstream physics reasoning tasks. We build a benchmark Open-ended Physics ENvironment (OPEn) and also design several tasks to test learning representations in this environment explicitly. We find that an agent using unsupervised contrastive learning for representation learning, and impact-driven learning for exploration, achieved the best results.
  arXiv  Detail & Related papers  (2021-10-13T17:48:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.