Joint Spatio-Textual Reasoning for Answering Tourism Questions

• URL: http://arxiv.org/abs/2009.13613v2
• Date: Mon, 19 Oct 2020 07:18:42 GMT
• Title: Joint Spatio-Textual Reasoning for Answering Tourism Questions
• Authors: Danish Contractor, Shashank Goel, Mausam, Parag Singla
• Abstract summary: Our Points is to answer real-world questions that seek goal-of-Interest (POI) We develop the first jointtextual-reasoning model which combines geo-spatial knowledge with information in textual corpora to answer questions. We report substantial improvements over existing models with-out joint-textual reasoning.
• Score: 19.214280482194503
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Our goal is to answer real-world tourism questions that seek Points-of-Interest (POI) recommendations. Such questions express various kinds of spatial and non-spatial constraints, necessitating a combination of textual and spatial reasoning. In response, we develop the first joint spatio-textual reasoning model, which combines geo-spatial knowledge with information in textual corpora to answer questions. We first develop a modular spatial-reasoning network that uses geo-coordinates of location names mentioned in a question, and of candidate answer POIs, to reason over only spatial constraints. We then combine our spatial-reasoner with a textual reasoner in a joint model and present experiments on a real world POI recommendation task. We report substantial improvements over existing models with-out joint spatio-textual reasoning.

Related papers

• OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence [51.0456395687016]
  multimodal large language models (LLMs) have opened new frontiers in artificial intelligence. We propose a MLLM (OmniGeo) tailored to geospatial applications. By combining the strengths of natural language understanding and spatial reasoning, our model enhances the ability of instruction following and the accuracy of GeoAI systems.
  arXiv  Detail & Related papers  (2025-03-20T16:45:48Z)
• Space3D-Bench: Spatial 3D Question Answering Benchmark [49.259397521459114]
  We present Space3D-Bench - a collection of 1000 general spatial questions and answers related to scenes of the Replica dataset. We provide an assessment system that grades natural language responses based on predefined ground-truth answers. Finally, we introduce a baseline called RAG3D-Chat integrating the world understanding of foundation models with rich context retrieval.
  arXiv  Detail & Related papers  (2024-08-29T16:05:22Z)
• GeoReasoner: Reasoning On Geospatially Grounded Context For Natural Language Understanding [0.32885740436059047]
  GeoReasoner is a language model capable of reasoning on geospatially grounded natural language. It first leverages Large Language Models to generate a comprehensive location description based on linguistic inferences and distance information. It also encodes direction and distance information into spatial embedding via treating them as pseudo-sentences.
  arXiv  Detail & Related papers  (2024-08-21T06:35:21Z)
• Analyzing Human Questioning Behavior and Causal Curiosity through Natural Queries [91.70689724416698]
  We present NatQuest, a collection of 13,500 naturally occurring questions from three diverse sources. Our analysis reveals a significant presence of causal questions (up to 42%) within the dataset.
  arXiv  Detail & Related papers  (2024-05-30T17:55:28Z)
• Location Aware Modular Biencoder for Tourism Question Answering [33.5507972300392]
  We propose treating the QA task as a dense vector retrieval problem. We encode questions and POIs separately and retrieve the most relevant POIs for a question by utilizing embedding space similarity. Experiments on a real-world tourism QA dataset demonstrate that our approach is effective, efficient, and outperforms previous methods.
  arXiv  Detail & Related papers  (2024-01-04T10:39:58Z)
• Rethinking Sensors Modeling: Hierarchical Information Enhanced Traffic Forecasting [47.1051445072085]
  We argue to rethink the sensor's dependency modeling from two hierarchies: regional and global. We generate representative and common-temporal patterns as global nodes to reflect a global dependency between sensors. In pursuit of the generality of reality of node representations, we incorporate a Meta GCN to propagate and global nodes in the physical data space.
  arXiv  Detail & Related papers  (2023-09-20T13:08:34Z)
• SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation [25.52363878314735]
  SpaBERT provides a general-purpose geo-entity representation based on neighboring entities in geospatial data. SpaBERT is pretrained with masked language modeling and masked entity prediction tasks. We apply SpaBERT to two downstream tasks: geo-entity typing and geo-entity linking.
  arXiv  Detail & Related papers  (2022-10-21T19:42:32Z)
• GreaseLM: Graph REASoning Enhanced Language Models for Question Answering [159.9645181522436]
  GreaseLM is a new model that fuses encoded representations from pretrained LMs and graph neural networks over multiple layers of modality interaction operations. We show that GreaseLM can more reliably answer questions that require reasoning over both situational constraints and structured knowledge, even outperforming models 8x larger.
  arXiv  Detail & Related papers  (2022-01-21T19:00:05Z)
• Geographic Question Answering: Challenges, Uniqueness, Classification, and Future Directions [10.21626173269271]
  Question Answering (QA) aims at generating answers to questions phrased in natural language. QA systems are still struggling to answer questions which involve geographic entities or concepts.
  arXiv  Detail & Related papers  (2021-05-19T20:47:36Z)
• SIRI: Spatial Relation Induced Network For Spatial Description Resolution [64.38872296406211]
  We propose a novel relationship induced (SIRI) network for language-guided localization. We show that our method is around 24% better than the state-of-the-art method in terms of accuracy, measured by an 80-pixel radius. Our method also generalizes well on our proposed extended dataset collected using the same settings as Touchdown.
  arXiv  Detail & Related papers  (2020-10-27T14:04:05Z)
• From Topic Networks to Distributed Cognitive Maps: Zipfian Topic Universes in the Area of Volunteered Geographic Information [59.0235296929395]
  We investigate how language encodes and networks geographic information on the aboutness level of texts. Our study shows a Zipfian organization of the thematic universe in which geographical places are located in online communication. Places, whether close to each other or not, are located in neighboring places that span similarworks in the topic universe.
  arXiv  Detail & Related papers  (2020-02-04T18:31:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.