Earth Embeddings Reveal Diverse Urban Signals from Space

• URL: http://arxiv.org/abs/2604.03456v1
• Date: Fri, 03 Apr 2026 20:58:37 GMT
• Title: Earth Embeddings Reveal Diverse Urban Signals from Space
• Abstract summary: We benchmark three Earth embedding families, AlphaEarth, Prithvi, and Clay, for urban signal prediction.<n>Using a unified supervised-learning framework, we predict 14 neighborhood-level indicators spanning crime, income, health, and travel behavior.<n>Results show that Earth embeddings capture substantial urban variation, with the highest predictive skill for outcomes tied to built-environment structure.
• Score: 17.134313498337804
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conventional urban indicators derived from censuses, surveys, and administrative records are often costly, spatially inconsistent, and slow to update. Recent geospatial foundation models enable Earth embeddings, compact satellite image representations transferable across downstream tasks, but their utility for neighborhood-scale urban monitoring remains unclear. Here, we benchmark three Earth embedding families, AlphaEarth, Prithvi, and Clay, for urban signal prediction across six U.S. metropolitan areas from 2020 to 2023. Using a unified supervised-learning framework, we predict 14 neighborhood-level indicators spanning crime, income, health, and travel behavior, and evaluate performance under four settings: global, city-wise, year-wise, and city-year. Results show that Earth embeddings capture substantial urban variation, with the highest predictive skill for outcomes more directly tied to built-environment structure, including chronic health burdens and dominant commuting modes. By contrast, indicators shaped more strongly by fine-scale behavior and local policy, such as cycling, remain difficult to infer. Predictive performance varies markedly across cities but remains comparatively stable across years, indicating strong spatial heterogeneity alongside temporal robustness. Exploratory analysis suggests that cross-city variation in predictive performance is associated with urban form in task-specific ways. Controlled dimensionality experiments show that representation efficiency is critical: compact 64-dimensional AlphaEarth embeddings remain more informative than 64-dimensional reductions of Prithvi and Clay. This study establishes a benchmark for evaluating Earth embeddings in urban remote sensing and demonstrates their potential as scalable, low-cost features for SDG-aligned neighborhood-scale urban monitoring.

Related papers

• Inferring Urban Mobility Interactions from Aggregated Dynamics [45.73534370352232]
  Real-time urban governance depends not only on knowing where people are, but on how they move between places.<n>Here we show that this directional structure need not be observed to be known.<n>We infer future OD flows from area-level counts alone across twelve mobility datasets from cities in the United States and China.
  arXiv  Detail & Related papers  (2026-09-07T11:13:51Z)
• BEACON: Behavioral and Semantic Enrichment of AlphaEarth Embeddings through Tri-Modal Contrastive Learning [9.468116544984651]
  We propose BEACON, a tri-modal contrastive learning framework that aligns three views of urban space.<n> BEACON improves relative R2 over AlphaEarth by up to 43% for obesity prevalence, 34% for poor mental health, and 22% for median household income.<n>These findings highlight the value of augmenting geospatial foundation models with semantic and behavioral signals.
  arXiv  Detail & Related papers  (2026-08-30T04:46:23Z)
• UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City [63.28750191463138]
  Multimodal large language models (MLLMs) can interpret a street view, but urban agency depends on whether such local evidence remains useful after the agent starts to move.<n>We investigate how far current MLLM agents can turn local urban perception into reliable action in a complicated real-scale city.<n>We propose UrbanGround, the first sandbox to make this question testable in a physically constrained replica of Hong Kong built from territory-wide 3D geospatial data.
  arXiv  Detail & Related papers  (2026-08-27T17:59:33Z)
• Cross-View Urban Sensing: Mapping Subjective Streetscape Perception via AlphaEarth Embeddings and Urban Context [14.193542027484213]
  We present CVLNet, a Cross-View Learning Network that predicts street-level perception without requiring SVI at inference.<n>CVLNet is evaluated across four Southeast Asian cities: Singapore, Kuala Lumpur, Jakarta, and Manila.<n>We produce citywide road-level streetscape perception maps for five subjective perceptual dimensions across all four cities.
  arXiv  Detail & Related papers  (2026-08-17T09:21:30Z)
• Life Style Levels: Neighborhood Delineation using Geospatial Data [0.0]
  This study pro-poses a scalable, grid-based urban delineation framework using building morphology derived from open-source satellite imagery.<n>The proposed framework provides a scalable, interpretable, and cost-effective approach for granular urban affluence mapping across In-dian cities.
  arXiv  Detail & Related papers  (2026-07-07T17:37:03Z)
• UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics [18.634608060111713]
  UrbanWell is a benchmark designed to evaluate the capabilities of multimodal language (MLLMs) for urban wellbeing analytics.<n>We benchmark 15 representative MLLMs in a zero-shot setting, providing a comparative evaluation across spatial and temporal dimensions.<n>UrbanWell serves as a unified benchmark for evaluating multimodal and temporal reasoning in urban wellbeing analytics.
  arXiv  Detail & Related papers  (2026-06-14T16:19:21Z)
• Modeling Subjective Urban Perception with Human Gaze [60.73742038237224]
  We introduce Place Pulse-Gaze, an urban perception dataset that augments street view images with synchronized eye-tracking recordings and individual perception labels.<n>We propose a Gaze-Guided Urban Perception Framework to study how gaze behavior contributes to the modeling of subjective urban perception.
  arXiv  Detail & Related papers  (2026-05-01T16:25:13Z)
• Building Age Estimation: A New Multi-Modal Benchmark Dataset and Community Challenge [35.23751185910119]
  Estimating the construction year of buildings is critical for advancing sustainability, as older structures often lack energy-efficient features.<n>MapYourCity is a novel multi-modal benchmark dataset comprising top-view Very High Resolution (VHR) imagery, multi-spectral Earth Observation (EO) data from the Copernicus Sentinel-2 satellite constellation.<n>To advance research in EO generalization and multi-modal learning, we organized a community-driven data challenge in 2024, hosted by ESA $Phi$-lab.
  arXiv  Detail & Related papers  (2025-02-19T15:31:13Z)
• Space-aware Socioeconomic Indicator Inference with Heterogeneous Graphs [46.52719756897067]
  We present GeoHG, the first space-aware socioeconomic indicator inference method that utilizes a heterogeneous graph-based structure to represent geospace for non-continuous inference.
  arXiv  Detail & Related papers  (2024-05-23T03:19:02Z)
• CityPulse: Fine-Grained Assessment of Urban Change with Street View Time Series [12.621355888239359]
  Urban transformations have profound societal impact on both individuals and communities at large. We propose an end-to-end change detection model to effectively capture physical alterations in the built environment at scale. Our approach has the potential to supplement existing dataset and serve as a fine-grained and accurate assessment of urban change.
  arXiv  Detail & Related papers  (2024-01-02T08:57:09Z)
• Unified Data Management and Comprehensive Performance Evaluation for Urban Spatial-Temporal Prediction [Experiment, Analysis & Benchmark] [78.05103666987655]
  This work addresses challenges in accessing and utilizing diverse urban spatial-temporal datasets. We introduceatomic files, a unified storage format designed for urban spatial-temporal big data, and validate its effectiveness on 40 diverse datasets. We conduct extensive experiments using diverse models and datasets, establishing a performance leaderboard and identifying promising research directions.
  arXiv  Detail & Related papers  (2023-08-24T16:20:00Z)
• Effective Urban Region Representation Learning Using Heterogeneous Urban Graph Attention Network (HUGAT) [0.0]
  We propose heterogeneous urban graph attention network (HUGAT) for learning the representations of urban regions. In our experiments on NYC data, HUGAT outperformed all the state-of-the-art models.
  arXiv  Detail & Related papers  (2022-02-18T04:59:20Z)
• Methodological Foundation of a Numerical Taxonomy of Urban Form [62.997667081978825]
  We present a method for numerical taxonomy of urban form derived from biological systematics. We derive homogeneous urban tissue types and, by determining overall morphological similarity between them, generate a hierarchical classification of urban form. After framing and presenting the method, we test it on two cities - Prague and Amsterdam.
  arXiv  Detail & Related papers  (2021-04-30T12:47:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.