GNSS-FM: A Self-Supervised Foundation Model for Daily GNSS Displacement Time Series

• URL: http://arxiv.org/abs/2606.07725v1
• Date: Fri, 05 Jun 2026 16:39:49 GMT
• Title: GNSS-FM: A Self-Supervised Foundation Model for Daily GNSS Displacement Time Series
• Abstract summary: We presentFM, a self-supervised foundation model for daily time series.<n>It is pretrained on data from over 17,000 globally distributed stations.<n>Results show that self-supervised pretraining is a promising approach for time series analysis.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Displacement time series from Global Navigation Satellite Systems (GNSS) are essential for a wide range of applications, including monitoring tectonic crustal deformations and investigating the different stages of the earthquake cycle. Machine learning methods have proven promising for GNSS applications; however, most remain fully supervised. This creates a bottleneck as labeled data are scarce, even though large amounts of unlabeled GNSS data are freely available. We present GNSS-FM, a self-supervised foundation model for daily GNSS time series. The model uses a dual-stream input combining displacement and velocity-like increments, and is pretrained using a masked latent prediction objective with vector-quantized targets adapted from wav2vec 2.0, with several modifications for geodetic data. Pretrained on data from over 17,000 globally distributed GNSS stations, an analysis of the learned codebook suggests that the representations capture the main signal types in GNSS displacement data, including seismic offsets, tectonic drift, and seasonal patterns. The foundation model is later fine-tuned on two downstream tasks, namely 90-day displacement forecasting and seismic step localization, where it outperforms strong task-specific baselines in both cases. These results show that self-supervised pretraining is a promising approach for GNSS time series analysis.

Related papers

• High-Order Liquid Evidence Encoding for Gradual GNSS Spoofing Detection in Autonomous Driving [6.820140586466226]
  Spoofing attacks can manipulate vehicle position estimates.<n>Existing methods often rely on static vehicle-behavior features.<n>We propose a causal high-order liquid evidence framework for spoofing detection.
  arXiv  Detail & Related papers  (2026-08-12T08:30:17Z)
• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• GTS_Forecaster: a novel deep learning based geodetic time series forecasting toolbox with python [13.397971255488365]
  We introduce GTS Forecaster, an open-source Python package for geodetic time series forecasting.<n>It integrates advanced deep learning models to effectively model nonlinear spatial-temporal patterns.<n> GTS Forecaster supports forecasting, visualization, and evaluation of outlier datasets.
  arXiv  Detail & Related papers  (2025-09-10T06:33:09Z)
• Learning-based NLOS Detection and Uncertainty Prediction of GNSS Observations with Transformer-Enhanced LSTM Network [2.798138034569478]
  This work proposes a deeplearning-based method to detect NLOS and predict errors by analyzing pseudo-temporal modeling problem. We use datasets from Hong Kong and Aachen to train and evaluate the proposed network. We show that the proposed method avoids trajectory divergence in real-world vehicle localization by classifying and excluding NLOS observations.
  arXiv  Detail & Related papers  (2023-09-01T14:17:02Z)
• Probabilistic detection of GNSS spoofing using opportunistic information [1.9688858888666714]
  Civilian signals are usually not cryptographically protected.<n>This makes attacks that forge signals relatively easy.<n>Considering modern devices often have network connections and onboard sensors, a Probabilistic Detection of Spoofing scheme is proposed.
  arXiv  Detail & Related papers  (2023-05-09T12:53:07Z)
• Automated classification of pre-defined movement patterns: A comparison between GNSS and UWB technology [55.41644538483948]
  Real-time location systems (RTLS) allow for collecting data from human movement patterns. The current study aims to design and evaluate an automated framework to classify human movement patterns in small areas.
  arXiv  Detail & Related papers  (2023-03-10T14:46:42Z)
• Online Evolutionary Neural Architecture Search for Multivariate Non-Stationary Time Series Forecasting [72.89994745876086]
  This work presents the Online Neuro-Evolution-based Neural Architecture Search (ONE-NAS) algorithm. ONE-NAS is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods.
  arXiv  Detail & Related papers  (2023-02-20T22:25:47Z)
• Time-to-Green predictions for fully-actuated signal control systems with supervised learning [56.66331540599836]
  This paper proposes a time series prediction framework using aggregated traffic signal and loop detector data. We utilize state-of-the-art machine learning models to predict future signal phases' duration. Results based on an empirical data set from a fully-actuated signal control system in Zurich, Switzerland, show that machine learning models outperform conventional prediction methods.
  arXiv  Detail & Related papers  (2022-08-24T07:50:43Z)
• Deep Autoregressive Models with Spectral Attention [74.08846528440024]
  We propose a forecasting architecture that combines deep autoregressive models with a Spectral Attention (SA) module. By characterizing in the spectral domain the embedding of the time series as occurrences of a random process, our method can identify global trends and seasonality patterns. Two spectral attention models, global and local to the time series, integrate this information within the forecast and perform spectral filtering to remove time series's noise.
  arXiv  Detail & Related papers  (2021-07-13T11:08:47Z)
• Score-based Generative Modeling in Latent Space [93.8985523558869]
  Score-based generative models (SGMs) have recently demonstrated impressive results in terms of both sample quality and distribution coverage. Here, we propose the Latent Score-based Generative Model (LSGM), a novel approach that trains SGMs in a latent space. Moving from data to latent space allows us to train more expressive generative models, apply SGMs to non-continuous data, and learn smoother SGMs in a smaller space.
  arXiv  Detail & Related papers  (2021-06-10T17:26:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.