VidTAG: Temporally Aligned Video to GPS Geolocalization with Denoising Sequence Prediction at a Global Scale

• URL: http://arxiv.org/abs/2604.12159v1
• Date: Tue, 14 Apr 2026 00:35:07 GMT
• Title: VidTAG: Temporally Aligned Video to GPS Geolocalization with Denoising Sequence Prediction at a Global Scale
• Abstract summary: The task of video geolocalization aims to determine the precise GPS coordinates of a video's origin and map its trajectory.<n>We propose VidTAG, a dual-encoder framework that performs frame-to-GPS retrieval using both self-supervised and language-aligned features.<n>Our approach enables fine-grained video geolocalization and lays a strong foundation for future research.
• Score: 46.71012068113612
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The task of video geolocalization aims to determine the precise GPS coordinates of a video's origin and map its trajectory; with applications in forensics, social media, and exploration. Existing classification-based approaches operate at a coarse city-level granularity and fail to capture fine-grained details, while image retrieval methods are impractical on a global scale due to the need for extensive image galleries which are infeasible to compile. Comparatively, constructing a gallery of GPS coordinates is straightforward and inexpensive. We propose VidTAG, a dual-encoder framework that performs frame-to-GPS retrieval using both self-supervised and language-aligned features. To address temporal inconsistencies in video predictions, we introduce the TempGeo module, which aligns frame embeddings, and the GeoRefiner module, an encoder-decoder architecture that refines GPS features using the aligned frame embeddings. Evaluations on Mapillary (MSLS) and GAMa datasets demonstrate our model's ability to generate temporally consistent trajectories and outperform baselines, achieving a 20% improvement at the 1 km threshold over GeoCLIP. We also beat current State-of-the-Art by 25% on global coarse grained video geolocalization (CityGuessr68k). Our approach enables fine-grained video geolocalization and lays a strong foundation for future research. More details on the project webpage: https://parthpk.github.io/vidtag_webpage/

Related papers

• Trajectory-aware Cross-view Geo-localization with Sequential Observations [14.771498439131953]
  Cross-view-localization matches ground-level observations against satellite imagery.<n>Recent methods show that sequential queries such as video clips yield richer cues than single images.<n>We introduce SeqLoc-VL, a dataset of $sim$39K--text triplets, and TrajLoc, a unified framework capable of processing video clips and route descriptions.
  arXiv  Detail & Related papers  (2026-07-16T22:39:19Z)
• DualGeo: A Dual-View Framework for Worldwide Image Geo-localization [24.463319677769405]
  We propose DualGeo, a two-stage framework for worldwide image geo-localization.<n>First, it establishes a geo-representational foundation by fusing image and semantic segmentation features.<n>Second, it performs geo-cognitive refinement by re-ranking retrieved candidates using geographic clustering.<n>Experiments show that DualGeo outperforms state-of-the-art methods, improving street-level (1 km) and city-level (25 km) localization accuracy by 3.6%-16.58% and 1.29%-8.77%, respectively.
  arXiv  Detail & Related papers  (2026-04-28T12:00:04Z)
• CityGuessr: City-Level Video Geo-Localization on a Global Scale [54.371452373726584]
  We propose a novel problem of worldwide video geolocalization with the objective of hierarchically predicting the correct city, state/province, country, and continent, given a video. No large scale video datasets that have extensive worldwide coverage exist, to train models for solving this problem. We introduce a new dataset, CityGuessr68k comprising of 68,269 videos from 166 cities all over the world.
  arXiv  Detail & Related papers  (2024-11-10T03:20:00Z)
• GAReT: Cross-view Video Geolocalization with Adapters and Auto-Regressive Transformers [53.80009458891537]
  Cross-view video geo-localization aims to derive GPS trajectories from street-view videos by aligning them with aerial-view images. Current CVGL methods use camera and odometry data, typically absent in real-world scenarios. We propose GAReT, a fully transformer-based method for CVGL that does not require camera and odometry data.
  arXiv  Detail & Related papers  (2024-08-05T21:29:33Z)
• G3: An Effective and Adaptive Framework for Worldwide Geolocalization Using Large Multi-Modality Models [40.69217368870192]
  We propose a novel framework for worldwide geolocalization based on Retrieval-Augmented Generation (RAG) G3 consists of three steps, i.e., Geo-alignment, Geo-diversification, and Geo-verification. Experiments on two well-established datasets verify the superiority of G3 compared to other state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-23T15:37:06Z)
• GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization [61.10806364001535]
  Worldwide Geo-localization aims to pinpoint the precise location of images taken anywhere on Earth. Existing approaches divide the globe into discrete geographic cells, transforming the problem into a classification task. We propose GeoCLIP, a novel CLIP-inspired Image-to-GPS retrieval approach that enforces alignment between the image and its corresponding GPS locations.
  arXiv  Detail & Related papers  (2023-09-27T20:54:56Z)
• Geo-Encoder: A Chunk-Argument Bi-Encoder Framework for Chinese Geographic Re-Ranking [61.60169764507917]
  Chinese geographic re-ranking task aims to find the most relevant addresses among retrieved candidates. We propose an innovative framework, namely Geo-Encoder, to more effectively integrate Chinese geographical semantics into re-ranking pipelines.
  arXiv  Detail & Related papers  (2023-09-04T13:44:50Z)
• A Gis Aided Approach for Geolocalizing an Unmanned Aerial System Using Deep Learning [0.4297070083645048]
  We propose an alternative approach to geolocalize a UAS when GPS signal is degraded or denied. Considering UAS has a downward-looking camera on its platform that can acquire real-time images as the platform flies, we apply modern deep learning techniques to achieve geolocalization. We extract GIS information from OpenStreetMap (OSM) to semantically segment matched features into building and terrain classes.
  arXiv  Detail & Related papers  (2022-08-25T17:51:15Z)
• GAMa: Cross-view Video Geo-localization [68.33955764543465]
  We focus on ground videos instead of images which provides contextual cues. At clip-level, a short video clip is matched with corresponding aerial image and is later used to get video-level geo-localization of a long video. Our proposed method achieves a Top-1 recall rate of 19.4% and 45.1% @1.0mile.
  arXiv  Detail & Related papers  (2022-07-06T04:25:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.