FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems

• URL: http://arxiv.org/abs/2311.10255v5
• Date: Fri, 10 Oct 2025 15:38:06 GMT
• Title: FREE: The Foundational Semantic Recognition for Modeling Environmental Ecosystems
• Authors: Shiyuan Luo, Juntong Ni, Shengyu Chen, Runlong Yu, Yiqun Xie, Licheng Liu, Zhenong Jin, Huaxiu Yao, Xiaowei Jia,
• Abstract summary: We introduce a framework, FREE, that enables the use of varying features and available information to train a universal model.<n>The core idea is to map available environmental data into a text space and then convert the traditional predictive modeling task in environmental science to a semantic recognition problem.<n>Our evaluation on two societally important real-world applications, stream water temperature prediction and crop yield prediction, demonstrates the superiority of FREE over multiple baselines.
• Score: 56.0640340392818
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modeling environmental ecosystems is critical for the sustainability of our planet, but is extremely challenging due to the complex underlying processes driven by interactions amongst a large number of physical variables. As many variables are difficult to measure at large scales, existing works often utilize a combination of observable features and locally available measurements or modeled values as input to build models for a specific study region and time period. This raises a fundamental question in advancing the modeling of environmental ecosystems: how to build a general framework for modeling the complex relationships among diverse environmental variables over space and time? In this paper, we introduce a framework, FREE, that enables the use of varying features and available information to train a universal model. The core idea is to map available environmental data into a text space and then convert the traditional predictive modeling task in environmental science to a semantic recognition problem. Our evaluation on two societally important real-world applications, stream water temperature prediction and crop yield prediction, demonstrates the superiority of FREE over multiple baselines, even in data-sparse scenarios.

Related papers

• Context-Aware Multimodal Representation Learning for Spatio-Temporally Explicit Environmental Modelling [3.3984815208531014]
  We propose a representation learning framework that integrates different modalities into unified space at high-temporal resolution.<n>Our approach produces a latent space at native 10 m resolution and the temporal frequency of cloud-free Sentinel-2 data.<n>This enables the model to capture complementary remote sensing data and to preserve coherence across space and time.
  arXiv  Detail & Related papers  (2025-11-12T15:34:17Z)
• Evolving Graph Learning for Out-of-Distribution Generalization in Non-stationary Environments [61.62036321848316]
  Graph neural networks (GNNs) have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs.<n>Existing GNNs exhibit poor ability under distribution shifts, which is inevitable in dynamic scenarios.<n>This paper proposes Evolving Graph Learning framework for evolving graph generalization (Evoal) by environment-aware invariant pattern recognition.
  arXiv  Detail & Related papers  (2025-11-04T08:22:29Z)
• Perpetua: Multi-Hypothesis Persistence Modeling for Semi-Static Environments [14.727014155729826]
  This paper introduces Perpetua, a method for modeling the dynamics of semi-static features.<n>We chain together mixtures of "persistence" and "emergence" filters to model the probability that features will disappear or reappear.<n>We find that Perpetua yields better accuracy than similar approaches while also being online adaptable and robust to missing observations.
  arXiv  Detail & Related papers  (2025-07-24T21:11:23Z)
• Knowledge Guided Encoder-Decoder Framework: Integrating Multiple Physical Models for Agricultural Ecosystem Modeling [20.29135373542904]
  Agricultural monitoring is critical for ensuring food security, maintaining sustainable farming practices, and managing greenhouse gas emissions.<n>Traditional process-based physical models are often designed and implemented for specific situations, and their parameters could also be highly uncertain.<n>We propose a knowledge-guided encoder-decoder model, which can predict key crop variables by leveraging knowledge of underlying processes from multiple physical models.
  arXiv  Detail & Related papers  (2025-05-05T21:16:10Z)
• Foundation Models for Environmental Science: A Survey of Emerging Frontiers [27.773985216421394]
  This survey presents a comprehensive overview of foundation applications in environmental science.<n>It highlights advancements in common environmental use cases including forward prediction, data generation, data assimilation, downscaling, inverse modeling, model ensembling, and decision-making across domains.<n>We aim to promote interdisciplinary collaboration that accelerates advancements in machine learning for driving discovery in addressing critical environmental challenges.
  arXiv  Detail & Related papers  (2025-04-05T20:56:38Z)
• A Survey of Foundation Models for Environmental Science [16.426772639157704]
  Foundation models offer transformative opportunities by integrating diverse data sources.<n>We aim to foster interdisciplinary collaboration and advance the integration of cutting-edge machine learning for sustainable solutions in environmental science.
  arXiv  Detail & Related papers  (2025-03-05T03:33:31Z)
• Trajectory World Models for Heterogeneous Environments [67.27233466954814]
  Heterogeneity in sensors and actuators across environments poses a significant challenge to building large-scale pre-trained world models. We introduce UniTraj, a unified dataset comprising over one million trajectories from 80 environments, designed to scale data while preserving critical diversity. We propose TrajWorld, a novel architecture capable of flexibly handling varying sensor and actuator information and capturing environment dynamics in-context.
  arXiv  Detail & Related papers  (2025-02-03T13:59:08Z)
• MiTREE: Multi-input Transformer Ecoregion Encoder for Species Distribution Modelling [2.3776390335270694]
  We introduce MiTREE, a multi-input Vision-Transformer-based model with an ecoregion encoder. We evaluate our model on the SatBird Summer and Winter datasets, the goal of which is to predict bird species encounter rates.
  arXiv  Detail & Related papers  (2024-12-25T22:20:47Z)
• Learning to learn ecosystems from limited data -- a meta-learning approach [0.0]
  We develop a meta-learning framework with time-delayed feedforward neural networks to predict the long-term behaviors of ecological systems. We show that the framework is capable of accurately reconstructing the dynamical climate'' of the ecological system with limited data.
  arXiv  Detail & Related papers  (2024-10-02T16:23:34Z)
• LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models [25.047123247476016]
  LITE is a large language model for environmental ecosystems modeling. It unifies different environmental variables by transforming them into natural language descriptions and line graph images. During this step, the incomplete features are imputed by a sparse Mixture-of-Experts framework.
  arXiv  Detail & Related papers  (2024-04-01T15:14:07Z)
• LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment [59.320414108383055]
  We present LiveHPS, a novel single-LiDAR-based approach for scene-level human pose and shape estimation. We propose a huge human motion dataset, named FreeMotion, which is collected in various scenarios with diverse human poses.
  arXiv  Detail & Related papers  (2024-02-27T03:08:44Z)
• Foundation Models for Generalist Geospatial Artificial Intelligence [3.7002058945990415]
  This paper introduces a first-of-a-kind framework for the efficient pre-training and fine-tuning of foundational models on extensive data. We have utilized this framework to create Prithvi, a transformer-based foundational model pre-trained on more than 1TB of multispectral satellite imagery.
  arXiv  Detail & Related papers  (2023-10-28T10:19:55Z)
• FaIRGP: A Bayesian Energy Balance Model for Surface Temperatures Emulation [13.745581787463962]
  We introduce FaIRGP, a data-driven emulator that satisfies the physical temperature response equations of an energy balance model. We show how FaIRGP can be used to obtain estimates of top-of-atmosphere radiative forcing. We hope that this work will contribute to widening the adoption of data-driven methods in climate emulation.
  arXiv  Detail & Related papers  (2023-07-14T08:43:36Z)
• OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning [67.07363529640784]
  We propose OpenSTL to categorize prevalent approaches into recurrent-based and recurrent-free models. We conduct standard evaluations on datasets across various domains, including synthetic moving object trajectory, human motion, driving scenes, traffic flow and forecasting weather. We find that recurrent-free models achieve a good balance between efficiency and performance than recurrent models.
  arXiv  Detail & Related papers  (2023-06-20T03:02:14Z)
• ClimaX: A foundation model for weather and climate [51.208269971019504]
  ClimaX is a deep learning model for weather and climate science. It can be pre-trained with a self-supervised learning objective on climate datasets. It can be fine-tuned to address a breadth of climate and weather tasks.
  arXiv  Detail & Related papers  (2023-01-24T23:19:01Z)
• Conditioned Human Trajectory Prediction using Iterative Attention Blocks [70.36888514074022]
  We present a simple yet effective pedestrian trajectory prediction model aimed at pedestrians positions prediction in urban-like environments. Our model is a neural-based architecture that can run several layers of attention blocks and transformers in an iterative sequential fashion. We show that without explicit introduction of social masks, dynamical models, social pooling layers, or complicated graph-like structures, it is possible to produce on par results with SoTA models.
  arXiv  Detail & Related papers  (2022-06-29T07:49:48Z)
• Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learning [63.25627328308978]
  We propose a-temporal prediction network pipeline to generate future occupancy predictions. Compared to current SOTA, our approach predicts occupancy for a longer horizon of 3 seconds. We publicly release our grid occupancy dataset based on nulis to support further research.
  arXiv  Detail & Related papers  (2022-05-06T13:45:32Z)
• SILG: The Multi-environment Symbolic Interactive Language Grounding Benchmark [62.34200575624785]
  We propose the multi-environment Interactive Language Grounding benchmark (SILG) SILG consists of grid-world environments that require generalization to new dynamics, entities, and partially observed worlds (RTFM, Messenger, NetHack) We evaluate recent advances such as egocentric local convolution, recurrent state-tracking, entity-centric attention, and pretrained LM using SILG.
  arXiv  Detail & Related papers  (2021-10-20T17:02:06Z)
• Causal Discovery in Physical Systems from Videos [123.79211190669821]
  Causal discovery is at the core of human cognition. We consider the task of causal discovery from videos in an end-to-end fashion without supervision on the ground-truth graph structure.
  arXiv  Detail & Related papers  (2020-07-01T17:29:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.