STCAD: Scalable Trajectory Clustering and Anomaly Detection on Terabyte-Scale AIS Data
- URL: http://arxiv.org/abs/2608.10249v1
- Date: Mon, 10 Aug 2026 21:32:42 GMT
- Title: STCAD: Scalable Trajectory Clustering and Anomaly Detection on Terabyte-Scale AIS Data
- Abstract summary: We present a scalable framework for unsupervised clustering of maritime trajectories derived from terabyte-scale Automatic Identification System (AIS) archives.<n> Variable-length trajectories are encoded with a custom BERT-based model trained via masked token modeling and clustered using CURE hierarchical clustering.<n>An intrinsic anomaly detection method based on reconstruction loss and clustering noise assignment identifies irregular navigation patterns.
- Score: 35.18016233072556
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a scalable framework for unsupervised clustering of maritime trajectories derived from terabyte-scale Automatic Identification System (AIS) archives. Variable-length trajectories are encoded with a custom BERT-based model trained via masked token modeling and clustered using CURE hierarchical clustering, producing physically interpretable trajectory groups without requiring a predefined number of clusters. An intrinsic unsupervised anomaly detection method based on reconstruction loss and clustering noise assignment identifies irregular navigation patterns. The framework is demonstrated on a national-scale AIS dataset comprising billions of messages spanning one year, yielding stable trajectory clusters and a clear separation between nominal and anomalous vessel behavior.
Related papers
- Turtle shell clustering: A mixture approach to discriminative clustering with applications to flow cytometry and other data [0.254890465057467]
Generative approaches to clustering provide information on geometric properties of clusters.<n>Discriminative approaches provide boundaries between clusters.<n>We present a fully unsupervised, probabilistic, and discriminative clustering method.
arXiv Detail & Related papers (2026-04-25T00:33:30Z) - Weight-Informed Self-Explaining Clustering for Mixed-Type Tabular Data [63.62853416081748]
WISE is a framework that unifies representation, feature weighting, clustering, and interpretation.<n>It produces faithful, human-interpretable explanations grounded in the same primitives that drive clustering.
arXiv Detail & Related papers (2026-04-07T13:18:31Z) - Universal Transformation of One-Class Classifiers for Unsupervised Anomaly Detection [51.73001988341294]
Anomaly detection is typically formulated as a one-class classification problem.<n>We present a dataset folding method that transforms an arbitrary one-class classifier-based anomaly detector into a fully unsupervised method.
arXiv Detail & Related papers (2026-02-13T16:54:12Z) - Spatio-Temporal Graphs Beyond Grids: Benchmark for Maritime Anomaly Detection [14.841789798257055]
We introduce a novel benchmark dataset for anomaly detection in the maritime domain.<n>Our dataset enables systematic evaluation across three different granularities: node-level, edge-level, and graph-level anomalies.
arXiv Detail & Related papers (2025-12-23T06:28:12Z) - Adaptive and Robust DBSCAN with Multi-agent Reinforcement Learning [53.527506374566485]
We propose a novel Adaptive and Robust DBSCAN with Multi-agent Reinforcement Learning cluster framework, namely AR-DBSCAN.<n>We show that AR-DBSCAN not only improves clustering accuracy by up to 144.1% and 175.3% in the NMI and ARI metrics, respectively, but also is capable of robustly finding dominant parameters.
arXiv Detail & Related papers (2025-05-07T11:37:23Z) - Stable Trajectory Clustering: An Efficient Split and Merge Algorithm [1.9253333342733674]
Clustering algorithms group data points by characteristics to identify patterns.<n>This paper presents whole-trajectory clustering and sub-trajectory clustering algorithms based on DBSCAN line segment clustering.
arXiv Detail & Related papers (2025-04-30T17:11:36Z) - Towards Learnable Anchor for Deep Multi-View Clustering [49.767879678193005]
In this paper, we propose the Deep Multi-view Anchor Clustering (DMAC) model that performs clustering in linear time.<n>With the optimal anchors, the full sample graph is calculated to derive a discriminative embedding for clustering.<n>Experiments on several datasets demonstrate superior performance and efficiency of DMAC compared to state-of-the-art competitors.
arXiv Detail & Related papers (2025-03-16T09:38:11Z) - Generative Anomaly Detection for Time Series Datasets [1.7954335118363964]
Traffic congestion anomaly detection is of paramount importance in intelligent traffic systems.
We propose a data-driven generative approach that can perform tractable density estimation for detecting traffic anomalies.
Our approach significantly outperforms several state-of-the-art congestion anomaly detection and diagnosis methods in terms of Recall and F1-Score.
arXiv Detail & Related papers (2022-06-28T17:08:47Z) - Recurrent Spectral Network (RSN): shaping the basin of attraction of a
discrete map to reach automated classification [4.724825031148412]
A novel strategy to automated classification is introduced which exploits a fully trained dynamical system to steer items toward distinct attractors.
Non-linear terms act for a transient and allow to disentangle the data supplied as initial condition to the discrete dynamical system.
Our novel approach to classification, that we here term Recurrent Spectral Network (RSN), is successfully challenged against a simple test-bed model, created for illustrative purposes, as well as a standard dataset for image processing training.
arXiv Detail & Related papers (2022-02-09T14:59:06Z) - Anomaly Clustering: Grouping Images into Coherent Clusters of Anomaly
Types [60.45942774425782]
We introduce anomaly clustering, whose goal is to group data into coherent clusters of anomaly types.
This is different from anomaly detection, whose goal is to divide anomalies from normal data.
We present a simple yet effective clustering framework using a patch-based pretrained deep embeddings and off-the-shelf clustering methods.
arXiv Detail & Related papers (2021-12-21T23:11:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.