AGI for the Earth, the path, possibilities and how to evaluate intelligence of models that work with Earth Observation Data?

• URL: http://arxiv.org/abs/2508.06057v1
• Date: Fri, 08 Aug 2025 06:28:58 GMT
• Title: AGI for the Earth, the path, possibilities and how to evaluate intelligence of models that work with Earth Observation Data?
• Authors: Mojtaba Valipour, Kelly Zheng, James Lowman, Spencer Szabados, Mike Gartner, Bobby Braswell,
• Abstract summary: We argue why Earth Observation data is useful for an intelligent model, and then we review existing benchmarks and highlight their limitations.<n>This paper emphasizes the need for a more comprehensive benchmark to evaluate earth observation models.
• Score: 0.08246494848934446
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Artificial General Intelligence (AGI) is closer than ever to becoming a reality, sparking widespread enthusiasm in the research community to collect and work with various modalities, including text, image, video, and audio. Despite recent efforts, satellite spectral imagery, as an additional modality, has yet to receive the attention it deserves. This area presents unique challenges, but also holds great promise in advancing the capabilities of AGI in understanding the natural world. In this paper, we argue why Earth Observation data is useful for an intelligent model, and then we review existing benchmarks and highlight their limitations in evaluating the generalization ability of foundation models in this domain. This paper emphasizes the need for a more comprehensive benchmark to evaluate earth observation models. To facilitate this, we propose a comprehensive set of tasks that a benchmark should encompass to effectively assess a model's ability to understand and interact with Earth observation data.

Related papers

• EscherVerse: An Open World Benchmark and Dataset for Teleo-Spatial Intelligence with Physical-Dynamic and Intent-Driven Understanding [56.89359230139883]
  We introduce Teleo-Spatial Intelligence (TSI), a new paradigm that unifies two critical pillars: Physical-Dynamic Reasoning and Intent-Driven Reasoning.<n>We present EscherVerse, consisting of a large-scale, open-world benchmark (Escher-Bench), a dataset (Escher-35k), and models (Escher series)<n>It is the first benchmark to systematically assess Intent-Driven Reasoning, challenging models to connect physical events to their underlying human purposes.
  arXiv  Detail & Related papers  (2026-01-04T14:42:39Z)
• Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning [11.611027504613324]
  This paper introduces Earth AI, a family of geospatial AI models and agentic reasoning.<n>A Gemini-powered agent handles complex, multi-step queries.<n>On a new benchmark of real-world crisis scenarios, our agent demonstrates the ability to deliver critical and timely insights.
  arXiv  Detail & Related papers  (2025-10-21T06:05:47Z)
• Remote Sensing-Oriented World Model [14.021235530589246]
  World models have shown potential in artificial intelligence by predicting and reasoning about world states beyond direct observations.<n>Existing approaches are predominantly evaluated in synthetic environments or constrained scene settings.<n>This paper bridges these gaps by introducing the first framework for world modeling in remote sensing.
  arXiv  Detail & Related papers  (2025-09-22T14:02:39Z)
• Towards Scalable and Generalizable Earth Observation Data Mining via Foundation Model Composition [0.0]
  We investigate whether foundation models pretrained on remote sensing and general vision datasets can be effectively combined to improve performance.<n>The results show that feature-level ensembling of smaller pretrained models can match or exceed the performance of much larger models.<n>The study highlights the potential of applying knowledge distillation to transfer the strengths of ensembles into more compact models.
  arXiv  Detail & Related papers  (2025-06-25T07:02:42Z)
• Vision Generalist Model: A Survey [87.49797517847132]
  We provide a comprehensive overview of the vision generalist models, delving into their characteristics and capabilities within the field.<n>We take a brief excursion into related domains, shedding light on their interconnections and potential synergies.
  arXiv  Detail & Related papers  (2025-06-11T17:23:41Z)
• No Location Left Behind: Measuring and Improving the Fairness of Implicit Representations for Earth Data [13.412573082645096]
  Implicit neural representations (INRs) exhibit growing promise in addressing Earth representation challenges.<n>Existing methods disproportionately prioritize global average performance.<n>We introduce FAIR-Earth: a first-of-its-kind dataset to examine and challenge inequities in Earth representations.
  arXiv  Detail & Related papers  (2025-02-05T16:51:13Z)
• Foundation Models for Remote Sensing and Earth Observation: A Survey [101.77425018347557]
  This survey systematically reviews the emerging field of Remote Sensing Foundation Models (RSFMs)<n>It begins with an outline of their motivation and background, followed by an introduction of their foundational concepts.<n>We benchmark these models against publicly available datasets, discuss existing challenges, and propose future research directions.
  arXiv  Detail & Related papers  (2024-10-22T01:08:21Z)
• Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond [101.15395503285804]
  General world models represent a crucial pathway toward achieving Artificial General Intelligence (AGI) In this survey, we embark on a comprehensive exploration of the latest advancements in world models. We examine challenges and limitations of world models, and discuss their potential future directions.
  arXiv  Detail & Related papers  (2024-05-06T14:37:07Z)
• There Are No Data Like More Data- Datasets for Deep Learning in Earth Observation [6.839093061382966]
  We want to put machine learning datasets dedicated to Earth observation data into the spotlight. We hope to contribute to an understanding that the nature of our data is what distinguishes the Earth observation community.
  arXiv  Detail & Related papers  (2023-10-30T02:19:16Z)
• GEO-Bench: Toward Foundation Models for Earth Monitoring [139.77907168809085]
  We propose a benchmark comprised of six classification and six segmentation tasks. This benchmark will be a driver of progress across a variety of Earth monitoring tasks.
  arXiv  Detail & Related papers  (2023-06-06T16:16:05Z)
• TMHOI: Translational Model for Human-Object Interaction Detection [18.804647133922195]
  We propose an innovative graph-based approach to detect human-object interactions (HOIs) Our method effectively captures the sentiment representation of HOIs by integrating both spatial and semantic knowledge. Our approach outperformed existing state-of-the-art graph-based methods by a significant margin.
  arXiv  Detail & Related papers  (2023-03-07T21:52:10Z)
• Predictive World Models from Real-World Partial Observations [66.80340484148931]
  We present a framework for learning a probabilistic predictive world model for real-world road environments. While prior methods require complete states as ground truth for learning, we present a novel sequential training method to allow HVAEs to learn to predict complete states from partially observed states only.
  arXiv  Detail & Related papers  (2023-01-12T02:07:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.