Pre-training Contextual Location Embeddings in Personal Trajectories via Efficient Hierarchical Location Representations

• URL: http://arxiv.org/abs/2310.01252v1
• Date: Mon, 2 Oct 2023 14:40:24 GMT
• Title: Pre-training Contextual Location Embeddings in Personal Trajectories via Efficient Hierarchical Location Representations
• Authors: Chung Park, Taesan Kim, Junui Hong, Minsung Choi, Jaegul Choo
• Abstract summary: Pre-training the embedding of a location generated from human mobility data has become a popular method for location based services. Previous studies have handled less than ten thousand distinct locations, which is insufficient in the real-world applications. We propose a Geo-Tokenizer, designed to efficiently reduce the number of locations to be trained by representing a location as a combination of several grids at different scales.
• Score: 30.493743596793212
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pre-training the embedding of a location generated from human mobility data has become a popular method for location based services. In practice, modeling the location embedding is too expensive, due to the large number of locations to be trained in situations with fine-grained resolution or extensive target regions. Previous studies have handled less than ten thousand distinct locations, which is insufficient in the real-world applications. To tackle this problem, we propose a Geo-Tokenizer, designed to efficiently reduce the number of locations to be trained by representing a location as a combination of several grids at different scales. In the Geo-Tokenizer, a grid at a larger scale shares the common set of grids at smaller scales, which is a key factor in reducing the size of the location vocabulary. The sequences of locations preprocessed with the Geo-Tokenizer are utilized by a causal location embedding model to capture the temporal dependencies of locations. This model dynamically calculates the embedding vector of a target location, which varies depending on its trajectory. In addition, to efficiently pre-train the location embedding model, we propose the Hierarchical Auto-regressive Location Model objective to effectively train decomposed locations in the Geo-Tokenizer. We conducted experiments on two real-world user trajectory datasets using our pre-trained location model. The experimental results show that our model significantly improves the performance of downstream tasks with fewer model parameters compared to existing location embedding methods.

Related papers

• Learning Where to Look: Self-supervised Viewpoint Selection for Active Localization using Geometrical Information [68.10033984296247]
  This paper explores the domain of active localization, emphasizing the importance of viewpoint selection to enhance localization accuracy. Our contributions involve using a data-driven approach with a simple architecture designed for real-time operation, a self-supervised data training method, and the capability to consistently integrate our map into a planning framework tailored for real-world robotics applications.
  arXiv  Detail & Related papers  (2024-07-22T12:32:09Z)
• Coupled Laplacian Eigenmaps for Locally-Aware 3D Rigid Point Cloud Matching [0.0]
  We propose a new technique, based on graph Laplacian eigenmaps, to match point clouds by taking into account fine local structures. To deal with the order and sign ambiguity of Laplacian eigenmaps, we introduce a new operator, called Coupled Laplacian. We show that the similarity between those aligned high-dimensional spaces provides a locally meaningful score to match shapes.
  arXiv  Detail & Related papers  (2024-02-27T10:10:12Z)
• SQLNet: Scale-Modulated Query and Localization Network for Few-Shot Class-Agnostic Counting [71.38754976584009]
  The class-agnostic counting (CAC) task has recently been proposed to solve the problem of counting all objects of an arbitrary class with several exemplars given in the input image. We propose a novel localization-based CAC approach, termed Scale-modulated Query and Localization Network (Net) It fully explores the scales of exemplars in both the query and localization stages and achieves effective counting by accurately locating each object and predicting its approximate size.
  arXiv  Detail & Related papers  (2023-11-16T16:50:56Z)
• GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization [61.10806364001535]
  Worldwide Geo-localization aims to pinpoint the precise location of images taken anywhere on Earth. Existing approaches divide the globe into discrete geographic cells, transforming the problem into a classification task. We propose GeoCLIP, a novel CLIP-inspired Image-to-GPS retrieval approach that enforces alignment between the image and its corresponding GPS locations.
  arXiv  Detail & Related papers  (2023-09-27T20:54:56Z)
• Surface Reconstruction from Point Clouds by Learning Predictive Context Priors [68.12457459590921]
  Surface reconstruction from point clouds is vital for 3D computer vision. We introduce Predictive Context Priors by learning Predictive Queries for each specific point cloud at inference time. Our experimental results in surface reconstruction for single shapes or complex scenes show significant improvements over the state-of-the-art under widely used benchmarks.
  arXiv  Detail & Related papers  (2022-04-23T08:11:33Z)
• Ordinal UNLOC: Target Localization with Noisy and Incomplete Distance Measures [1.6836876499886007]
  A main challenge in target localization arises from the lack of reliable distance measures. We develop a new computational framework to estimate the location of a target without the need for reliable distance measures.
  arXiv  Detail & Related papers  (2021-05-06T13:54:31Z)
• PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation [87.50205728818601]
  We propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space. Our PGL model learns the distinctive representations of local regions, and hence is able to retain structural information.
  arXiv  Detail & Related papers  (2020-11-25T11:03:11Z)
• Zero-Shot Multi-View Indoor Localization via Graph Location Networks [66.05980368549928]
  indoor localization is a fundamental problem in location-based applications. We propose a novel neural network based architecture Graph Location Networks (GLN) to perform infrastructure-free, multi-view image based indoor localization. GLN makes location predictions based on robust location representations extracted from images through message-passing networks. We introduce a novel zero-shot indoor localization setting and tackle it by extending the proposed GLN to a dedicated zero-shot version.
  arXiv  Detail & Related papers  (2020-08-06T07:36:55Z)
• SE-KGE: A Location-Aware Knowledge Graph Embedding Model for Geographic Question Answering and Spatial Semantic Lifting [9.949690056661218]
  We propose a location-aware KG embedding model called SE-KGE. It encodes spatial information such as point coordinates or bounding boxes of geographic entities into the KG embedding space. We also construct a geographic knowledge graph as well as a set of geographic query-answer pairs called DBGeo to evaluate the performance of SE-KGE.
  arXiv  Detail & Related papers  (2020-04-25T17:46:31Z)
• FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing [12.518673970373422]
  Data-driven learning model-based cooperative localization and location data processing are considered. We first review state-of-the-art algorithms in the context of federated learning. We demonstrate various practical use cases that are summarized from a mixture of standard, newly published, and unpublished works.
  arXiv  Detail & Related papers  (2020-03-08T01:51:56Z)
• Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells [11.071527762096053]
  We propose a representation learning model called Space2Vec to encode the absolute positions and spatial relationships of places. Results show that because of its multi-scale representations, Space2Vec outperforms well-established ML approaches.
  arXiv  Detail & Related papers  (2020-02-16T04:22:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.