CmIVTP: Cross-modal Interaction-based Vessel Trajectory Prediction for Maritime Intelligence

• URL: http://arxiv.org/abs/2605.26524v1
• Date: Tue, 26 May 2026 04:14:35 GMT
• Title: CmIVTP: Cross-modal Interaction-based Vessel Trajectory Prediction for Maritime Intelligence
• Abstract summary: We propose a cross-modal interaction-based vessel trajectory prediction framework (named CmIVTP) to model the intricate interactions between vessel dynamics and environmental constraints.<n>CmIVTP achieves better performance on multimodal-driven vessel trajectory prediction benchmarks.
• Score: 8.119468130391292
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Maritime intelligent transportation systems (MITS) are essential for ensuring navigation safety and efficiency in busy waterways. However, accurate vessel trajectory prediction remains challenging due to the limitations of single-source data. Automatic identification system (AIS) data is often sparse or unavailable for small vessels, while closed-circuit television (CCTV) data alone cannot fully capture dynamic vessel behavior. To mitigate these challenges, we propose a cross-modal interaction-based vessel trajectory prediction (named CmIVTP) framework to model the intricate interactions between vessel dynamics and environmental constraints. Specifically, we introduce a target-aware scene encoder to extract scene semantic features, effectively capturing vessel-environment interactions and enhancing trajectory prediction accuracy. In addition, we propose a cross-modal interaction transformer, which integrates AIS-derived motion features, CCTV-based environmental features, and scene representations. It leverages cross-modal attention mechanisms to simultaneously capture intra-modal semantics and inter-modal interactions, ensuring dynamically consistent and environmentally feasible predictions. Furthermore, we construct a vessel group trajectory bank by clustering historical AIS trajectories into representative motion patterns, providing an efficient and scalable approach for candidate trajectory generation. Additionally, we introduce the maritime multimodal dataset plus (named Maritime-MmD$^+$), a large-scale dataset that synchronizes AIS data and CCTV video data, providing robust support for multimodal trajectory prediction research. Extensive experiments demonstrate that CmIVTP achieves better performance on multimodal-driven vessel trajectory prediction benchmarks. The code resources for this work can be available at https://github.com/LouisYxLu/CmIVTP.

Related papers

• NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVectorized Lane Priors and the NaviLane Forecasting Framework [17.236684865710938]
  Vessel trajectory prediction is essential for traffic management, collision warning, route planning, and autonomous navigation.<n>Most public AIS resources lack structured representations of navigational lanes, waterway geometry, and navigable-region constraints.<n>We introduce NaviAIS, a standardized scenario-level AIS dataset for vessel trajectory prediction.<n>We propose NaviLane, a hierarchical macro-action framework for map-aware prediction.
  arXiv  Detail & Related papers  (2026-07-21T09:15:06Z)
• From Vessel Trajectories to Safety-Critical Encounter Scenarios: A Generative AI Framework for Autonomous Ship Digital Testing [4.73074147871828]
  This paper proposes a data-driven framework that converts large-scale Automatic Identification System (AIS) trajectories into structured safety-critical encounter scenarios.<n>Experiments on real-world maritime traffic flows demonstrate that the proposed method improves trajectory fidelity and smoothness.
  arXiv  Detail & Related papers  (2026-03-30T06:14:04Z)
• Unified Multimodal Vessel Trajectory Prediction with Explainable Navigation Intention [18.699213433572996]
  Vessel trajectory prediction is fundamental to intelligent maritime systems.<n>Existing vessel trajectory prediction methods suffer from limited scenario applicability and insufficient explainability.<n>We propose a unified vessel trajectory prediction framework incorporating explainable navigation intentions.
  arXiv  Detail & Related papers  (2025-11-18T08:56:30Z)
• Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection [54.1960918379255]
  Neptune-X is a data-centric generative-selection framework for maritime object detection.<n>X-to-Maritime is a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes.<n>Our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy.
  arXiv  Detail & Related papers  (2025-09-25T04:59:02Z)
• Multi-vessel Interaction-Aware Trajectory Prediction and Collision Risk Assessment [0.3277163122167433]
  We present a transformer-based framework for multi-vessel trajectory prediction with integrated collision risk analysis.<n>We evaluate the model on large-scale real-world AIS data using joint multi-vessel metrics.
  arXiv  Detail & Related papers  (2025-09-01T23:38:01Z)
• Visual Trajectory Prediction of Vessels for Inland Navigation [42.81677042059531]
  This study addresses the challenges of video-based vessel tracking and prediction by integrating advanced object detection methods.<n>A comparative evaluation of tracking algorithms, including BoT-SORT, Deep OC-SORT, and ByeTrack, highlights the robustness of the Kalman filter in providing smoothed trajectories.<n>The findings underline the necessity of customized datasets and models for inland navigation.
  arXiv  Detail & Related papers  (2025-05-01T15:31:15Z)
• Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework [57.994965436344195]
  Beamforming is a key technology in millimeter-wave (mmWave) communications that improves signal transmission by optimizing directionality and intensity.<n> multimodal sensing-aided beam prediction has gained significant attention, using various sensing data to predict user locations or network conditions.<n>Despite its promising potential, the adoption of multimodal sensing-aided beam prediction is hindered by high computational complexity, high costs, and limited datasets.
  arXiv  Detail & Related papers  (2025-04-07T15:38:25Z)
• STGDPM:Vessel Trajectory Prediction with Spatio-Temporal Graph Diffusion Probabilistic Model [0.0]
  Vessel trajectory prediction is a critical component for ensuring maritime traffic safety and avoiding collisions.<n>Due to the inherent uncertainty in vessel behavior, trajectory prediction systems must adopt a multimodal approach to accurately model potential future motion states.<n>We propose modeling interactions as dynamic graphs, replacing traditional aggregation-based techniques that rely on vessel states.
  arXiv  Detail & Related papers  (2025-03-11T05:50:27Z)
• Navigation World Models [68.58459393846461]
  We introduce a controllable video generation model that predicts future visual observations based on past observations and navigation actions.<n>In familiar environments, NWM can plan navigation trajectories by simulating them and evaluating whether they achieve the desired goal.<n>Experiments demonstrate its effectiveness in planning trajectories from scratch or by ranking trajectories sampled from an external policy.
  arXiv  Detail & Related papers  (2024-12-04T18:59:45Z)
• Multi-Agent Dynamic Relational Reasoning for Social Robot Navigation [50.01551945190676]
  Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. We propose a systematic relational reasoning approach with explicit inference of the underlying dynamically evolving relational structures. We demonstrate its effectiveness for multi-agent trajectory prediction and social robot navigation.
  arXiv  Detail & Related papers  (2024-01-22T18:58:22Z)
• Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections [45.508973373913946]
  We focus on decentralized navigation among multiple non-communicating rational agents at street intersections without traffic signs or signals. Our key insight is that the geometric structure of the intersection and the incentive of agents to move efficiently and avoid collisions (rationality) reduces the space of likely behaviors. We design Multiple Topologies Prediction (MTP), a data-driven trajectory-prediction mechanism that reconstructs trajectory representations of high-likelihood modes in multiagent intersection scenes.
  arXiv  Detail & Related papers  (2020-11-08T02:56:42Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)
• Implicit Latent Variable Model for Scene-Consistent Motion Forecasting [78.74510891099395]
  In this paper, we aim to learn scene-consistent motion forecasts of complex urban traffic directly from sensor data. We model the scene as an interaction graph and employ powerful graph neural networks to learn a distributed latent representation of the scene.
  arXiv  Detail & Related papers  (2020-07-23T14:31:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.