Temporal-IRL: Modeling Port Congestion and Berth Scheduling with Inverse Reinforcement Learning

• URL: http://arxiv.org/abs/2506.19843v1
• Date: Tue, 24 Jun 2025 17:59:12 GMT
• Title: Temporal-IRL: Modeling Port Congestion and Berth Scheduling with Inverse Reinforcement Learning
• Authors: Guo Li, Zixiang Xu, Wei Zhang, Yikuan Hu, Xinyu Yang, Nikolay Aristov, Mingjie Tang, Elenna R Dugundji,
• Abstract summary: The model learns berth scheduling to predict vessel sequencing at the terminal and estimate vessel port stay.<n>We trained and tested the model, achieving demonstrably excellent results.
• Score: 13.45559229405042
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Predicting port congestion is crucial for maintaining reliable global supply chains. Accurate forecasts enableimprovedshipment planning, reducedelaysand costs, and optimizeinventoryanddistributionstrategies, thereby ensuring timely deliveries and enhancing supply chain resilience. To achieve accurate predictions, analyzing vessel behavior and their stay times at specific port terminals is essential, focusing particularly on berth scheduling under various conditions. Crucially, the model must capture and learn the underlying priorities and patterns of berth scheduling. Berth scheduling and planning are influenced by a range of factors, including incoming vessel size, waiting times, and the status of vessels within the port terminal. By observing historical Automatic Identification System (AIS) positions of vessels, we reconstruct berth schedules, which are subsequently utilized to determine the reward function via Inverse Reinforcement Learning (IRL). For this purpose, we modeled a specific terminal at the Port of New York/New Jersey and developed Temporal-IRL. This Temporal-IRL model learns berth scheduling to predict vessel sequencing at the terminal and estimate vessel port stay, encompassing both waiting and berthing times, to forecast port congestion. Utilizing data from Maher Terminal spanning January 2015 to September 2023, we trained and tested the model, achieving demonstrably excellent results.

Related papers

• Beyond the Next Port: A Multi-Task Transformer for Forecasting Future Voyage Segment Durations [3.9443085703523706]
  The study reformulates future-port ETA prediction as a segment-level time-series forecasting problem.<n>We develop a transformer-based architecture that integrates historical sailing durations, destination port congestion, and static vessel descriptors.<n>The proposed framework employs a causally masked attention mechanism to capture long-range temporal dependencies and a multi-task learning head to jointly predict segment sailing durations and port congestion states.
  arXiv  Detail & Related papers  (2026-01-12T21:32:05Z)
• Predict-then-Optimize for Seaport Power-Logistics Scheduling: Generalization across Varying Tasks Stream [5.75432978300135]
  Power-logistics scheduling in modern seaports typically follow a predict-then-optimize pipeline.<n>Decision-focused learning has been proposed, which aligns the training of forecasting models with downstream decision outcomes.<n>We address this gap with a decision-focused continual learning framework that adapts online to a stream of scheduling tasks.
  arXiv  Detail & Related papers  (2025-11-11T07:36:08Z)
• Predicting Barge Tow Size on Inland Waterways Using Vessel Trajectory Derived Features: Proof of Concept [0.0]
  This study introduces a novel method to use Automatic Identification System (AIS) vessel tracking data to predict the number of barges in tow using Machine Learning (ML)<n>To train and test the model, barge instances were annotated from satellite scenes across the Lower Mississippi River.<n>The proposed approach provides a scalable, readily implementable method for enhancing Maritime Domain Awareness (MDA) with strong potential applications in lock scheduling, port management, and freight planning.
  arXiv  Detail & Related papers  (2025-10-28T01:51:23Z)
• UnLoc: Leveraging Depth Uncertainties for Floorplan Localization [80.55849461031879]
  UnLoc is an efficient data-driven solution for sequential camera localization within floorplans.<n>We introduce a novel probabilistic model that incorporates uncertainty estimation, modeling depth predictions as explicit probability distributions.<n>We evaluate UnLoc on large-scale synthetic and real-world datasets, demonstrating significant improvements in terms of accuracy and robustness.
  arXiv  Detail & Related papers  (2025-09-14T14:45:43Z)
• Sundial: A Family of Highly Capable Time Series Foundation Models [64.6322079384575]
  We introduce Sundial, a family of native, flexible, and scalable time series foundation models.<n>Our models are pre-trained without specifying any prior distribution and can generate multiple probable predictions.<n>Sundial achieves state-of-the-art results on both point and probabilistic forecasting benchmarks with a just-in-time inference speed.
  arXiv  Detail & Related papers  (2025-02-02T14:52:50Z)
• Valeo4Cast: A Modular Approach to End-to-End Forecasting [93.86257326005726]
  Our solution ranks first in the Argoverse 2 End-to-end Forecasting Challenge, with 63.82 mAPf. We depart from the current trend of tackling this task via end-to-end training from perception to forecasting, and instead use a modular approach. We surpass forecasting results by +17.1 points over last year's winner and by +13.3 points over this year's runner-up.
  arXiv  Detail & Related papers  (2024-06-12T11:50:51Z)
• Predictive Analysis for Optimizing Port Operations [5.268909485011467]
  This study aims to develop a port operation solution with competitive prediction and classification capabilities for estimating vessel Total and Delay times. The proposed solution is designed to assist decision-making in port environments and predict service delays.
  arXiv  Detail & Related papers  (2024-01-25T20:29:07Z)
• Multi-Path Long-Term Vessel Trajectories Forecasting with Probabilistic Feature Fusion for Problem Shifting [8.970625329763559]
  This paper addresses the challenge of boosting the precision of multi-path long-term vessel trajectory forecasting on engineered sequences of Automatic Identification System (AIS) data. We have developed a deep auto-encoder model and a phased framework approach to predict the next 12 hours of vessel trajectories using 1 to 3 hours of AIS data as input. We have shown that our model achieves more accurate forecasting with average and median errors of 11km and 6km, respectively, a 25% improvement from the current state-of-the-art approaches.
  arXiv  Detail & Related papers  (2023-10-29T09:15:22Z)
• Attention-Based Ensemble Pooling for Time Series Forecasting [55.2480439325792]
  We propose a method for pooling that performs a weighted average over candidate model forecasts. We test this method on two time-series forecasting problems: multi-step forecasting of the dynamics of the non-stationary Lorenz 63 equation, and one-step forecasting of the weekly incident deaths due to COVID-19.
  arXiv  Detail & Related papers  (2023-10-24T22:59:56Z)
• Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting [54.04430089029033]
  We present Lag-Llama, a general-purpose foundation model for time series forecasting based on a decoder-only transformer architecture. Lag-Llama is pretrained on a large corpus of diverse time series data from several domains, and demonstrates strong zero-shot generalization capabilities. When fine-tuned on relatively small fractions of such previously unseen datasets, Lag-Llama achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2023-10-12T12:29:32Z)
• Streaming Motion Forecasting for Autonomous Driving [71.7468645504988]
  We introduce a benchmark that queries future trajectories on streaming data and we refer to it as "streaming forecasting" Our benchmark inherently captures the disappearance and re-appearance of agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks. We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster.
  arXiv  Detail & Related papers  (2023-10-02T17:13:16Z)
• Meta-Learning over Time for Destination Prediction Tasks [53.12827614887103]
  A need to understand and predict vehicles' behavior underlies both public and private goals in the transportation domain. Recent studies have found, at best, only marginal improvements in predictive performance from incorporating temporal information. We propose an approach based on hypernetworks, in which a neural network learns to change its own weights in response to an input.
  arXiv  Detail & Related papers  (2022-06-29T17:58:12Z)
• Discovering Gateway Ports in Maritime Using Temporal Graph Neural Network Port Classification [4.293083690039338]
  We propose a temporal graph neural network (TGNN) based port classification method to enable vessels to discover gateway ports efficiently. The proposed method processes vessel data to build dynamic graphs capturing-temporal dependencies between a set of static and dynamic navigational features in the data. The experimental results indicate that our TGNN-based port classification method provides an f-score of 95% in classifying ports.
  arXiv  Detail & Related papers  (2022-04-25T12:02:18Z)
• Predicting Berth Stay for Tanker Terminals: A Systematic and Dynamic Approach [1.6694381776724387]
  The proposed approach can predict berth stay with the accuracy up to 98.81% validated by historical baselines. The model may be potentially applied for short-term pilot-booking or scheduling optimizations within a reasonable time frame.
  arXiv  Detail & Related papers  (2022-04-08T14:03:33Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)
• Multioutput Gaussian Processes with Functional Data: A Study on Coastal Flood Hazard Assessment [0.0]
  We introduce a surrogate model that accounts for time-varying inputs and provides information on spatially varying inland flooding. In several experiments, we demonstrate the versatility of the model for both learning maps and inferring unobserved maps. We conclude that our framework is a promising approach for forecast and early-warning systems.
  arXiv  Detail & Related papers  (2020-07-28T08:15:17Z)
• Incorporating travel behavior regularity into passenger flow forecasting [11.763229353978321]
  We propose a new forecasting framework for boarding flow by incorporating the generative mechanism into standard time series models. We develop the return probability parallelogram (RPP) to summarize the causal relationships and estimate the return flow. The proposed framework is evaluated using real-world passenger flow data.
  arXiv  Detail & Related papers  (2020-04-02T13:46:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.