SIGMUS: Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces

• URL: http://arxiv.org/abs/2509.00287v1
• Date: Sat, 30 Aug 2025 00:35:41 GMT
• Title: SIGMUS: Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces
• Authors: Brian Wang, Mani Srivastava,
• Abstract summary: We create SIGMUS, a system for Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces.<n>We use Large Language Models (LLMs) to produce the necessary world knowledge for identifying relationships between incidents occurring in urban spaces and data from different modalities.<n>We find that our system is able to produce reasonable connections between 5 different data sources and relevant incidents occurring at the same time and location.
• Score: 3.4824497671819152
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern urban spaces are equipped with an increasingly diverse set of sensors, all producing an abundance of multimodal data. Such multimodal data can be used to identify and reason about important incidents occurring in urban landscapes, such as major emergencies, cultural and social events, as well as natural disasters. However, such data may be fragmented over several sources and difficult to integrate due to the reliance on human-driven reasoning for identifying relationships between the multimodal data corresponding to an incident, as well as understanding the different components which define an incident. Such relationships and components are critical to identifying the causes of such incidents, as well as producing forecasting the scale and intensity of future incidents as they begin to develop. In this work, we create SIGMUS, a system for Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces. SIGMUS uses Large Language Models (LLMs) to produce the necessary world knowledge for identifying relationships between incidents occurring in urban spaces and data from different modalities, allowing us to organize evidence and observations relevant to an incident without relying and human-encoded rules for relating multimodal sensory data with incidents. This organized knowledge is represented as a knowledge graph, organizing incidents, observations, and much more. We find that our system is able to produce reasonable connections between 5 different data sources (new article text, CCTV images, air quality, weather, and traffic measurements) and relevant incidents occurring at the same time and location.

Related papers

• Harnessing Rich Multi-Modal Data for Spatial-Temporal Homophily-Embedded Graph Learning Across Domains and Localities [2.5065738436850835]
  This research proposes a heterogeneous data pipeline that performs cross-domain data fusion.<n>We aim to address complex urban problems across multiple domains and localities by harnessing the rich information over 50 data sources.
  arXiv  Detail & Related papers  (2025-12-11T23:51:54Z)
• Spatial Knowledge Graph-Guided Multimodal Synthesis [78.11669780958657]
  We introduce a novel multimodal synthesis approach guided by spatial knowledge graphs, grounded in the concept of knowledge-to-data generation.<n>In experiments, data synthesized from diverse types of spatial knowledge, including direction and distance, enhance the spatial perception and reasoning abilities of MLLMs markedly.<n>We hope that the idea of knowledge-based data synthesis can advance the development of spatial intelligence.
  arXiv  Detail & Related papers  (2025-05-28T17:50:21Z)
• Network-Wide Traffic Flow Estimation Across Multiple Cities with Global Open Multi-Source Data: A Large-Scale Case Study in Europe and North America [10.605083464975749]
  Network-wide traffic flow, which captures dynamic traffic volume on each link of a general network, is fundamental to smart mobility applications.<n>Existing research uses various supplementary data sources to compensate for insufficient sensor coverage and estimate the unobserved traffic flow.<n>We develop an attention-based graph neural network that effectively extracts and synthesizes information from GOMS maps.
  arXiv  Detail & Related papers  (2025-02-06T05:59:18Z)
• Collaborative Imputation of Urban Time Series through Cross-city Meta-learning [54.438991949772145]
  We propose a novel collaborative imputation paradigm leveraging meta-learned implicit neural representations (INRs)<n>We then introduce a cross-city collaborative learning scheme through model-agnostic meta learning.<n>Experiments on a diverse urban dataset from 20 global cities demonstrate our model's superior imputation performance and generalizability.
  arXiv  Detail & Related papers  (2025-01-20T07:12:40Z)
• Schema-Guided Culture-Aware Complex Event Simulation with Multi-Agent Role-Play [69.57968387772428]
  Complex news events, such as natural disasters and socio-political conflicts, require swift responses from the government and society. We develop a controllable complex news event simulator guided by both the event schema representing domain knowledge. We introduce a geo-diverse commonsense and cultural norm-aware knowledge enhancement component.
  arXiv  Detail & Related papers  (2024-10-24T17:21:43Z)
• A Social Context-aware Graph-based Multimodal Attentive Learning Framework for Disaster Content Classification during Emergencies [0.0]
  CrisisSpot is a method that captures complex relationships between textual and visual modalities. IDEA captures both harmonious and contrasting patterns within the data to enhance multimodal interactions. CrisisSpot achieved an average F1-score gain of 9.45% and 5.01% compared to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-10-11T13:51:46Z)
• Urban Traffic Accident Risk Prediction Revisited: Regionality, Proximity, Similarity and Sparsity [18.566139471849844]
  Traffic accidents pose a significant risk to human health and property safety. To prevent traffic accidents, predicting their risks has garnered growing interest. We argue that a desired prediction solution should demonstrate resilience to the complexity of traffic accidents.
  arXiv  Detail & Related papers  (2024-07-29T03:10:15Z)
• SMA-Hyper: Spatiotemporal Multi-View Fusion Hypergraph Learning for Traffic Accident Prediction [2.807532512532818]
  Current data-driven models often struggle with data sparsity and the integration of diverse urban data sources. We introduce a deep dynamic learning framework designed for traffic accident prediction. It incorporates dual adaptive graph learning mechanisms that enable high-order cross-regional learning. It also employs an advance attention mechanism to fuse multiple views of accident data and urban functional features.
  arXiv  Detail & Related papers  (2024-07-24T21:10:34Z)
• Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analyses [76.59021017301127]
  We propose a large-scale traffic crash language dataset, named CrashEvent, summarizing 19,340 real-world crash reports. We further formulate the crash event feature learning as a novel text reasoning problem and further fine-tune various large language models (LLMs) to predict detailed accident outcomes. Our experiments results show that our LLM-based approach not only predicts the severity of accidents but also classifies different types of accidents and predicts injury outcomes.
  arXiv  Detail & Related papers  (2024-06-16T03:10:16Z)
• A Transformer Framework for Data Fusion and Multi-Task Learning in Smart Cities [99.56635097352628]
  This paper proposes a Transformer-based AI system for emerging smart cities. It supports virtually any input data and output task types present S&CCs. It is demonstrated through learning diverse task sets representative of S&CC environments.
  arXiv  Detail & Related papers  (2022-11-18T20:43:09Z)
• GeoAI for Knowledge Graph Construction: Identifying Causality Between Cascading Events to Support Environmental Resilience Research [3.3072870202596736]
  This paper introduces our GeoAI solutions to identify causality among events, in particular, disaster events. Our solution enriches the event knowledge base and allows for the exploration of linked cascading events in large knowledge graphs.
  arXiv  Detail & Related papers  (2022-11-11T05:31:03Z)
• An Experimental Urban Case Study with Various Data Sources and a Model for Traffic Estimation [65.28133251370055]
  We organize an experimental campaign with video measurement in an area within the urban network of Zurich, Switzerland. We focus on capturing the traffic state in terms of traffic flow and travel times by ensuring measurements from established thermal cameras. We propose a simple yet efficient Multiple Linear Regression (MLR) model to estimate travel times with fusion of various data sources.
  arXiv  Detail & Related papers  (2021-08-02T08:13:57Z)
• A German Corpus for Fine-Grained Named Entity Recognition and Relation Extraction of Traffic and Industry Events [63.08899104652265]
  This work describes a corpus of German-language documents which has been annotated with fine-grained geo-entities. It has also been annotated with a set of 15 traffic- and industry-related n-ary relations and events. The corpus consists of newswire texts, Twitter messages, and traffic reports from radio stations, police and railway companies.
  arXiv  Detail & Related papers  (2020-04-07T11:39:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.