BEACON: Behavioral and Semantic Enrichment of AlphaEarth Embeddings through Tri-Modal Contrastive Learning

• URL: http://arxiv.org/abs/2608.29553v1
• Date: Sun, 30 Aug 2026 04:46:23 GMT
• Title: BEACON: Behavioral and Semantic Enrichment of AlphaEarth Embeddings through Tri-Modal Contrastive Learning
• Abstract summary: We propose BEACON, a tri-modal contrastive learning framework that aligns three views of urban space.<n> BEACON improves relative R2 over AlphaEarth by up to 43% for obesity prevalence, 34% for poor mental health, and 22% for median household income.<n>These findings highlight the value of augmenting geospatial foundation models with semantic and behavioral signals.
• Score: 9.468116544984651
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Geospatial foundation models such as the AlphaEarth Foundation produce compact and globally consistent representations of the Earth's surface that transfer effectively to a wide range of downstream tasks. However, because these models are trained primarily on Earth-observation imagery, their embeddings mainly capture physical and spectral characteristics while encoding human activity and urban function only weakly. To address this limitation, we propose BEACON, a tri-modal contrastive learning framework that aligns three complementary views of urban space: physical representations from AE embeddings, semantic representations from point-of-interest (POI) text, and human behavioral representations from hourly POI visitation, while keeping the deployed representation image-only. Using the Houston Metropolitan Area as a case study area, we evaluated the performance of the BEACON framework on nine downstream tasks, including seven regression and two classification tasks against six baselines (raw coordinates, Space2Vec, SatCLIP, TESSERA, Clay and AlphaEarth), using frozen linear and MLP probes over five seeds. Under a linear probe, BEACON improves relative R^2 over AlphaEarth by up to 43% for obesity prevalence, 34% for poor mental health, and 22% for median household income, while remaining competitive in the prediction of physical and environmental variables. These findings highlight the value of augmenting geospatial foundation models with semantic and behavioral signals, extending their applicability from physical Earth observation to human-centered urban analytics.

Related papers

• Probing Geospatial SSL Representations with Environmental Signals [51.908606610432194]
  Self-supervised learning (SSL) is designed to learn generic, transferable representations rather than representations optimized for a single task.<n>We ask a different question: do SSL representations preserve statistical associations with environmental variables that co-vary with the imaging process?<n>To answer this question, we probe SSL representations using co-located ERA5 reanalysis variables, a global dataset of physically consistent environmental variables.
  arXiv  Detail & Related papers  (2026-07-06T15:24:25Z)
• Better Together: Evaluating the Complementarity of Earth Embedding Models [5.793071003655904]
  Earth embedding models transform Earth observation data into embeddings uniquely tied to locations on the Earth's surface.<n>These models are typically evaluated in isolation, comparing the downstream task performance across different Earth embeddings.<n>We propose assessing Earth embeddings by their complementarity: the performance gain of fused embeddings over the best single-model baseline.
  arXiv  Detail & Related papers  (2026-05-18T17:10:13Z)
• Slum Detection and Density Mapping with AlphaEarth Foundations: A Representation Learning Evaluation Across 12 Global Cities [9.982796078979648]
  Pixel-level slum mapping has long been constrained by limited cross-city generalisation.<n>AlphaEarth Foundations offers a new analysis-ready basis for lightweight slum monitoring.<n>We evaluate AEF on slum classification and sub-pixel density estimation across 12 cities and 69 city-year pairs.
  arXiv  Detail & Related papers  (2026-05-11T05:54:15Z)
• Earth Embeddings Reveal Diverse Urban Signals from Space [17.134313498337804]
  We benchmark three Earth embedding families, AlphaEarth, Prithvi, and Clay, for urban signal prediction.<n>Using a unified supervised-learning framework, we predict 14 neighborhood-level indicators spanning crime, income, health, and travel behavior.<n>Results show that Earth embeddings capture substantial urban variation, with the highest predictive skill for outcomes tied to built-environment structure.
  arXiv  Detail & Related papers  (2026-04-03T20:58:37Z)
• UniSH: Unifying Scene and Human Reconstruction in a Feed-Forward Pass [83.7071371474926]
  UniSH is a unified, feed-forward framework for joint metric-scale 3D scene and human reconstruction.<n>Our framework bridges strong, disparate priors from scene reconstruction and HMR.<n>Our model achieves state-of-the-art performance on human-centric scene reconstruction.
  arXiv  Detail & Related papers  (2026-01-03T16:06:27Z)
• Beyond AlphaEarth: Toward Human-Centered Spatial Representation via POI-Guided Contrastive Learning [0.8677773374912304]
  AETHER (AlphaEarth-POI Enriched Representation Learning) adapts AlphaEarth to human-centered urban analysis through multimodal alignment guided by Points of Interest (POIs)<n>In Greater London, AETHER achieves consistent gains over the AE baseline, with a 7.2% relative improvement in land-use classification F1 and a 23.6% relative reduction in Kullback-Leibler divergence for socioeconomic mapping.
  arXiv  Detail & Related papers  (2025-10-10T22:20:39Z)
• TerraMAE: Learning Spatial-Spectral Representations from Hyperspectral Earth Observation Data via Adaptive Masked Autoencoders [1.1999555634662633]
  We introduce TerraMAE, a novel HSI encoding framework designed to learn highly representative spatial-spectral embeddings for diverse geospatial analyses.<n>We demonstrate its effectiveness through superior spatial-spectral information preservation in high-fidelity image reconstruction.
  arXiv  Detail & Related papers  (2025-08-09T15:32:22Z)
• GRACE: Estimating Geometry-level 3D Human-Scene Contact from 2D Images [54.602947113980655]
  Estimating the geometry level of human-scene contact aims to ground specific contact surface points at 3D human geometries.<n> GRACE (Geometry-level Reasoning for 3D Human-scene Contact Estimation) is a new paradigm for 3D human contact estimation.<n>It incorporates a point cloud encoder-decoder architecture along with a hierarchical feature extraction and fusion module.
  arXiv  Detail & Related papers  (2025-05-10T09:25:46Z)
• EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation [50.433911327489554]
  We introduce EarthMapper, a novel framework for controllable satellite-map translation.<n>We also contribute CNSatMap, a large-scale dataset comprising 302,132 precisely aligned satellite-map pairs across 38 Chinese cities.<n> experiments on CNSatMap and the New York dataset demonstrate EarthMapper's superior performance.
  arXiv  Detail & Related papers  (2025-04-28T02:41:12Z)
• Efficient Self-Supervised Learning for Earth Observation via Dynamic Dataset Curation [67.23953699167274]
  Self-supervised learning (SSL) has enabled the development of vision foundation models for Earth Observation (EO)<n>In EO, this challenge is amplified by the redundancy and heavy-tailed distributions common in satellite imagery.<n>We propose a dynamic dataset pruning strategy designed to improve SSL pre-training by maximizing dataset diversity and balance.
  arXiv  Detail & Related papers  (2025-04-09T15:13:26Z)
• TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesis [76.73338151115253]
  TriHuman is a novel human-tailored, deformable, and efficient tri-plane representation. We non-rigidly warp global ray samples into our undeformed tri-plane texture space. We show how such a tri-plane feature representation can be conditioned on the skeletal motion to account for dynamic appearance and geometry changes.
  arXiv  Detail & Related papers  (2023-12-08T16:40:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.