Foundation Models for Environmental Science: A Survey of Emerging Frontiers

• URL: http://arxiv.org/abs/2504.04280v1
• Date: Sat, 05 Apr 2025 20:56:38 GMT
• Title: Foundation Models for Environmental Science: A Survey of Emerging Frontiers
• Authors: Runlong Yu, Shengyu Chen, Yiqun Xie, Huaxiu Yao, Jared Willard, Xiaowei Jia,
• Abstract summary: This survey presents a comprehensive overview of foundation applications in environmental science.<n>It highlights advancements in common environmental use cases including forward prediction, data generation, data assimilation, downscaling, inverse modeling, model ensembling, and decision-making across domains.<n>We aim to promote interdisciplinary collaboration that accelerates advancements in machine learning for driving discovery in addressing critical environmental challenges.
• Score: 27.773985216421394
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently complex and interconnected processes and are further constrained by limited observational data in many environmental applications. Foundation models, which leverages large-scale pre-training and universal representations of complex and heterogeneous data, offer transformative opportunities for capturing spatiotemporal dynamics and dependencies in environmental processes, and facilitate adaptation to a broad range of applications. This survey presents a comprehensive overview of foundation model applications in environmental science, highlighting advancements in common environmental use cases including forward prediction, data generation, data assimilation, downscaling, inverse modeling, model ensembling, and decision-making across domains. We also detail the process of developing these models, covering data collection, architecture design, training, tuning, and evaluation. Through discussions on these emerging methods as well as their future opportunities, we aim to promote interdisciplinary collaboration that accelerates advancements in machine learning for driving scientific discovery in addressing critical environmental challenges.

Related papers

• On the workflow, opportunities and challenges of developing foundation model in geophysics [9.358947092397052]
  This paper systematically explores the entire process of developing foundation models in conjunction with geophysical data. Considering the diversity, complexity, and physical consistency constraints of geophysical data, we discuss targeted solutions. We discuss how to leverage the transfer learning capabilities of foundation models to reduce reliance on labeled data, enhance computational efficiency, and incorporate physical constraints into model training.
  arXiv  Detail & Related papers  (2025-04-24T09:08:24Z)
• A Survey of Foundation Models for Environmental Science [16.426772639157704]
  Foundation models offer transformative opportunities by integrating diverse data sources.<n>We aim to foster interdisciplinary collaboration and advance the integration of cutting-edge machine learning for sustainable solutions in environmental science.
  arXiv  Detail & Related papers  (2025-03-05T03:33:31Z)
• Trajectory World Models for Heterogeneous Environments [67.27233466954814]
  Heterogeneity in sensors and actuators across environments poses a significant challenge to building large-scale pre-trained world models.<n>We introduce UniTraj, a unified dataset comprising over one million trajectories from 80 environments, designed to scale data while preserving critical diversity.<n>We propose TrajWorld, a novel architecture capable of flexibly handling varying sensor and actuator information and capturing environment dynamics in-context.
  arXiv  Detail & Related papers  (2025-02-03T13:59:08Z)
• A Survey of World Models for Autonomous Driving [63.33363128964687]
  Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling. This paper systematically reviews recent advances in world models for autonomous driving.
  arXiv  Detail & Related papers  (2025-01-20T04:00:02Z)
• Predictive Pattern Recognition Techniques Towards Spatiotemporal Representation of Plant Growth in Simulated and Controlled Environments: A Comprehensive Review [0.0]
  This review explores state-of-the-art predictive pattern recognition techniques.<n>We focus on the probabilistic modeling of plant traits and the integration of dynamic environmental interactions.<n>Key topics include regressions and neural network-based representation models for the task of forecasting.
  arXiv  Detail & Related papers  (2024-12-13T20:22:35Z)
• Foundation Models for Remote Sensing and Earth Observation: A Survey [101.77425018347557]
  This survey systematically reviews the emerging field of Remote Sensing Foundation Models (RSFMs) It begins with an outline of their motivation and background, followed by an introduction of their foundational concepts. We benchmark these models against publicly available datasets, discuss existing challenges, and propose future research directions.
  arXiv  Detail & Related papers  (2024-10-22T01:08:21Z)
• Research on the Spatial Data Intelligent Foundation Model [70.47828328840912]
  This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status, and trends of spatial data intelligent large models. The report systematically elucidates the key technologies of spatial data intelligent large models and their applications in urban environments, aerospace remote sensing, geography, transportation, and other scenarios.
  arXiv  Detail & Related papers  (2024-05-30T06:21:34Z)
• Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology using Large Language Models -- A Case in Optimizing Intermodal Freight Transportation [1.6230958216521798]
  This study investigates the potential of leveraging the pre-trained Large Language Models (LLMs) By adopting ChatGPT API as the reasoning core, we outline an integrated workflow that encompasses natural language processing, methontology-based prompt tuning, and transformers. The outcomes of our methodology are knowledge graphs in widely adopted ontology languages (e.g., OWL, RDF, SPARQL)
  arXiv  Detail & Related papers  (2024-05-29T16:40:31Z)
• Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond [101.15395503285804]
  General world models represent a crucial pathway toward achieving Artificial General Intelligence (AGI) In this survey, we embark on a comprehensive exploration of the latest advancements in world models. We examine challenges and limitations of world models, and discuss their potential future directions.
  arXiv  Detail & Related papers  (2024-05-06T14:37:07Z)
• Challenges in data-based geospatial modeling for environmental research and practice [19.316860936437823]
  Data-based geospatial modelling using machine learning (ML) has gained popularity in environmental research. This survey reviews common nuances in geospatial modelling, such as imbalanced data, spatial autocorrelation, prediction errors, model generalisation, domain specificity, and uncertainty estimation.
  arXiv  Detail & Related papers  (2023-11-18T12:30:49Z)
• FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems [28.166089112650926]
  FREE maps available environmental data into a text space and then converts the traditional predictive modeling task in environmental science to a semantic recognition problem. When used for long-term prediction, FREE has the flexibility to incorporate newly collected observations to enhance future prediction. Free is evaluated in the context of two societally important real-world applications, predicting stream water temperature in the Delaware River Basin and predicting annual corn yield in Illinois and Iowa.
  arXiv  Detail & Related papers  (2023-11-17T00:53:09Z)
• Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning [12.76337275628074]
  In this work, we propose a variational dynamic model based on the conditional variational inference to model the multimodality andgenerativeity. We derive an upper bound of the negative log-likelihood of the environmental transition and use such an upper bound as the intrinsic reward for exploration. Our method outperforms several state-of-the-art environment model-based exploration approaches.
  arXiv  Detail & Related papers  (2020-10-17T09:54:51Z)
• Using satellite imagery to understand and promote sustainable development [87.72561825617062]
  We synthesize the growing literature that uses satellite imagery to understand sustainable development outcomes. We quantify the paucity of ground data on key human-related outcomes and the growing abundance and resolution of satellite imagery. We review recent machine learning approaches to model-building in the context of scarce and noisy training data.
  arXiv  Detail & Related papers  (2020-09-23T05:20:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.