Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events
- URL: http://arxiv.org/abs/2411.12880v1
- Date: Tue, 19 Nov 2024 21:57:22 GMT
- Title: Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events
- Abstract summary: This paper introduces a novel retrieval-retrieval framework leveraging Large Language Models (LLMs)
We propose a Geo-Time Re-ranking (GTR-ranking) strategy that identifies multi-faceted criteria including spatial proximity, temporal association, semantic similarity, and category-instructed similarity to rank similartemporal events.
We apply the proposed framework to a dataset of four thousand Local Environmental Observer (LEO) Network events, achieving performance in recommending similar events among multiple cutting-edge dense retrieval models.
- Score: 10.15184389811683
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Retrieval and recommendation are two essential tasks in modern search tools. This paper introduces a novel retrieval-reranking framework leveraging Large Language Models (LLMs) to enhance the spatiotemporal and semantic associated mining and recommendation of relevant unusual climate and environmental events described in news articles and web posts. This framework uses advanced natural language processing techniques to address the limitations of traditional manual curation methods in terms of high labor cost and lack of scalability. Specifically, we explore an optimized solution to employ cutting-edge embedding models for semantically analyzing spatiotemporal events (news) and propose a Geo-Time Re-ranking (GT-R) strategy that integrates multi-faceted criteria including spatial proximity, temporal association, semantic similarity, and category-instructed similarity to rank and identify similar spatiotemporal events. We apply the proposed framework to a dataset of four thousand Local Environmental Observer (LEO) Network events, achieving top performance in recommending similar events among multiple cutting-edge dense retrieval models. The search and recommendation pipeline can be applied to a wide range of similar data search tasks dealing with geospatial and temporal data. We hope that by linking relevant events, we can better aid the general public to gain an enhanced understanding of climate change and its impact on different communities.
Related papers
- Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding [18.530343758279493]
We introduce GeoMEB, a large-scale multimodal embedding benchmark.<n>We present Geo-Embed, a unified embedding model that adapts a shared vision-language backbone to instruction-conditioned query-target matching.<n>Results motivate future geospatial embedders that organize training and evaluation around explicit query-target relations.
arXiv Detail & Related papers (2026-08-04T15:36:17Z) - Multimodal and Multiscale Spatial-Temporal Semantic Search and Recommendation with AI Foundation Models [27.517725318193627]
This work presents a novel framework that leverages AI foundation models, including Large Language Models (LLMs) and Vision-Language Models (VLMs)<n>By automatically linking relevant event reports, the proposed framework helps both data curators and the general public gain deeper insights into environmental change and its localized impacts.<n>These findings highlight the potential of AI foundation models to advance Geographic Information Retrieval (GIR) through multifaceted, intelligent analysis that integrates key geographic concepts: space, time, scale, and semantics.
arXiv Detail & Related papers (2026-06-15T15:02:30Z) - Cross-Sample Relational Fusion: Unifying Domain Generalization and Class-Incremental Learning [83.67663266193308]
Class-Incremental Learning (CIL) requires a learning system to learn new classes while retaining previously learned knowledge.<n>In real-world scenarios such as autonomous driving, a system trained on urban roads in sunny weather may later need to operate in rural or highway environments.<n>We propose a unified framework to address domain shift and catastrophic forgetting simultaneously.
arXiv Detail & Related papers (2026-05-09T09:49:13Z) - GLASS: A Generative Recommender for Long-sequence Modeling via SID-Tier and Semantic Search [51.44490997013772]
GLASS is a novel framework that integrates long-term user interests into the generative process via SID-Tier and Semantic Search.<n>We show that GLASS outperforms state-of-the-art baselines in experiments on two large-scale real-world datasets.
arXiv Detail & Related papers (2026-02-05T13:48:33Z) - From Time and Place to Preference: LLM-Driven Geo-Temporal Context in Recommendations [3.402237483362839]
Most recommender systems treat timestamps as numeric or cyclical values, overlooking real-world context such as holidays, events, and seasonal patterns.<n>We propose a scalable framework that uses large language models (LLMs) to generate geo-temporal embeddings from only a timestamp and coarse location.
arXiv Detail & Related papers (2025-10-28T13:57:23Z) - Large Multi-modal Model Cartographic Map Comprehension for Textual Locality Georeferencing [0.5120567378386615]
Millions of biological sample records collected in the last few centuries archived in natural history collections are un-georeferenced.<n>We present preliminary experiments and results of a novel method that exploits multi-modal capabilities of recent Large Multi-Modal Models (LMM)<n>This method enables the model to visually contextualize spatial relations it reads in the locality description.
arXiv Detail & Related papers (2025-07-11T13:23:25Z) - Spatial-RAG: Spatial Retrieval Augmented Generation for Real-World Geospatial Reasoning Questions [5.053463027769152]
Spatial-RAG is a Retrieval-Augmented Generation framework designed for geospatial question answering.<n>It integrates structured spatial databases with large language models (LLMs) via a hybrid spatial retriever.<n>It formulates the answering process as a multi-objective optimization over spatial and semantic relevance.
arXiv Detail & Related papers (2025-02-04T01:30:06Z) - A Novel End-To-End Event Geolocation Method Leveraging Hyperbolic Space and Toponym Hierarchies [0.0]
Timely detection and geolocation of events based on social data can provide critical information for applications such as crisis response and resource allocation.
This paper proposes a novel end-to-end event geolocation method (GTOP) leveraging Hyperbolic space and toponym hierarchies.
arXiv Detail & Related papers (2024-12-14T15:43:58Z) - Into the Unknown: Generating Geospatial Descriptions for New Environments [18.736071151303726]
Rendezvous task requires reasoning over allocentric spatial relationships.
Using opensource descriptions paired with coordinates (e.g., Wikipedia) provides training data but suffers from limited spatially-oriented text.
We propose a large-scale augmentation method for generating high-quality synthetic data for new environments.
arXiv Detail & Related papers (2024-06-28T14:56:21Z) - Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrieval [0.0]
We introduce a pioneering system designed to tackle zero-shot geospatial question-answering tasks with high precision.
Our approach represents a significant improvement in addressing the limitations of current large language models.
arXiv Detail & Related papers (2024-06-26T21:59:54Z) - Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understanding [57.62275091656578]
We refer to the complex events composed of many news articles over an extended period as Temporal Complex Event (TCE)
This paper proposes a novel approach using Large Language Models (LLMs) to systematically extract and analyze the event chain within TCE.
arXiv Detail & Related papers (2024-06-04T16:42:17Z) - SCTc-TE: A Comprehensive Formulation and Benchmark for Temporal Event Forecasting [63.01035584154509]
We develop a fully automated pipeline and construct a large-scale dataset named MidEast-TE from about 0.6 million news articles.
This dataset focuses on the cooperation and conflict events among countries mainly in the MidEast region from 2015 to 2022.
We propose a novel method LoGo that is able to take advantage of both Local and Global contexts for SCTc-TE forecasting.
arXiv Detail & Related papers (2023-12-02T07:40:21Z) - Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching [60.645802236700035]
Navigating drones through natural language commands remains challenging due to the dearth of accessible multi-modal datasets.
We introduce GeoText-1652, a new natural language-guided geo-localization benchmark.
This dataset is systematically constructed through an interactive human-computer process.
arXiv Detail & Related papers (2023-11-21T17:52:30Z) - CurriculumLoc: Enhancing Cross-Domain Geolocalization through
Multi-Stage Refinement [11.108860387261508]
Visual geolocalization is a cost-effective and scalable task that involves matching one or more query images taken at some unknown location, to a set of geo-tagged reference images.
We develop CurriculumLoc, a novel keypoint detection and description with global semantic awareness and a local geometric verification.
We achieve new high recall@1 scores of 62.6% and 94.5% on ALTO, with two different distances metrics, respectively.
arXiv Detail & Related papers (2023-11-20T08:40:01Z) - Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese
Geographic Re-Ranking [61.60169764507917]
Chinese geographic re-ranking task aims to find the most relevant addresses among retrieved candidates.
We propose an innovative framework, namely Geo-Encoder, to more effectively integrate Chinese geographical semantics into re-ranking pipelines.
arXiv Detail & Related papers (2023-09-04T13:44:50Z) - Exploring the Limits of Historical Information for Temporal Knowledge
Graph Extrapolation [59.417443739208146]
We propose a new event forecasting model based on a novel training framework of historical contrastive learning.
CENET learns both the historical and non-historical dependency to distinguish the most potential entities.
We evaluate our proposed model on five benchmark graphs.
arXiv Detail & Related papers (2023-08-29T03:26:38Z) - Tracking Objects and Activities with Attention for Temporal Sentence
Grounding [51.416914256782505]
Temporal sentence (TSG) aims to localize the temporal segment which is semantically aligned with a natural language query in an untrimmed segment.
We propose a novel Temporal Sentence Tracking Network (TSTNet), which contains (A) a Cross-modal Targets Generator to generate multi-modal and search space, and (B) a Temporal Sentence Tracker to track multi-modal targets' behavior and to predict query-related segment.
arXiv Detail & Related papers (2023-02-21T16:42:52Z) - GEO-BLEU: Similarity Measure for Geospatial Sequences [16.752127721090226]
We propose a novel similarity measure, GEO-BLEU, which can be especially useful in the context of geospatial sequence modeling and generation.
BLEU is one of the most popular measures used in machine translation research, while introducing spatial proximity to the idea of n-gram.
We compare this measure with an established baseline, dynamic time warping, applying it to actual generated geospatial sequences.
arXiv Detail & Related papers (2021-12-14T03:50:19Z) - An Empirical Study: Extensive Deep Temporal Point Process [61.14164208094238]
We first review recent research emphasis and difficulties in modeling asynchronous event sequences with deep temporal point process.
We propose a Granger causality discovery framework for exploiting the relations among multi-types of events.
arXiv Detail & Related papers (2021-10-19T10:15:00Z) - Clustering high dimensional meteorological scenarios: results and
performance index [2.4186361602373823]
We discuss the problem of grouping and selecting representatives of possible climate scenarios among climate simulations provided by RTE.
The data used is composed of temperature times series for 200 different possible scenarios on a grid of geographical locations in France.
We first show that the choice of the distance used for the clustering has a strong impact on the meaning of the results.
arXiv Detail & Related papers (2020-12-14T13:06:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.