Railway Operation Rescheduling System via Dynamic Simulation and Reinforcement Learning

• URL: http://arxiv.org/abs/2201.06276v1
• Date: Mon, 17 Jan 2022 08:40:01 GMT
• Title: Railway Operation Rescheduling System via Dynamic Simulation and Reinforcement Learning
• Abstract summary: The number of railway service disruptions has been increasing owing to intensification of natural disasters. abrupt changes in social situations such as the COVID-19 pandemic require railway companies to modify the traffic schedule frequently. The proposed system enables rapid generation of the traffic schedule of a whole line because the optimization process is conducted in advance as the training.
• Score: 13.333957453318742
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The number of railway service disruptions has been increasing owing to intensification of natural disasters. In addition, abrupt changes in social situations such as the COVID-19 pandemic require railway companies to modify the traffic schedule frequently. Therefore, automatic support for optimal scheduling is anticipated. In this study, an automatic railway scheduling system is presented. The system leverages reinforcement learning and a dynamic simulator that can simulate the railway traffic and passenger flow of a whole line. The proposed system enables rapid generation of the traffic schedule of a whole line because the optimization process is conducted in advance as the training. The system is evaluated using an interruption scenario, and the results demonstrate that the system can generate optimized schedules of the whole line in a few minutes.

Related papers

• A Temporal Planning Framework for Disruption Aware Dynamic Route Optimization in Heterogeneous Railway Systems [0.0]
  This study proposes a framework based on temporal planning for dynamic route optimization and disruption management.<n>It generates conflict-free timestamped operational plans specifying both optimized schedules and executable action sequences.
  arXiv  Detail & Related papers  (2026-06-12T16:00:31Z)
• LeapTS: Rethinking Time Series Forecasting as Adaptive Multi-Horizon Scheduling [74.94985663101906]
  We present LeapTS, a novel framework that reformulates time series forecasting as a dynamic scheduling process over the prediction horizon.<n>We show that LeapTS improves overall forecasting performance by at least 7.4% while achieving a 2.6$times$ to 5.3$times$ inference speedup over representative Transformer-based models.
  arXiv  Detail & Related papers  (2026-05-11T09:54:02Z)
• SOPE: Stabilizing Off-Policy Evaluation for Online RL with Prior Data [49.370849653460716]
  We propose SOPE, an algorithm that uses an actor-aligned Off-Policy Policy Evaluation signal as an automated early-stopping mechanism.<n> evaluated on 25 continuous control tasks from the Minari benchmark suite.<n>SOPE improves baseline performance by up to 45.6% while reducing the required TFLOPs by up to 22x.
  arXiv  Detail & Related papers  (2026-05-07T08:32:09Z)
• Simulation-Driven Railway Delay Prediction: An Imitation Learning Approach [12.018920884898215]
  We introduce Drift-Corrected Imitation Learning (DCIL), a novel self-supervised algorithm that extends DAgger by incorporating distance-based drift correction.<n>We evaluate DCIL using a comprehensive real-world dataset from textscInfrabel, the Belgian railway infrastructure manager.
  arXiv  Detail & Related papers  (2025-12-17T14:06:26Z)
• An approach based on metaheuristic algorithms to the timetabling problem in deregulated railway markets [0.384477122144121]
  This paper sets out a modular simulation framework to reproduce the dynamics of deregulated railway systems. Ten metaheuristic algorithms are then evaluated in order to optimize train schedules in the liberalized Spanish railway market. The results emphasize the trade-off between scheduling more trains and adhering to requested times.
  arXiv  Detail & Related papers  (2025-04-24T11:36:39Z)
• Boosting-inspired online learning with transfer for railway maintenance [0.0]
  This paper introduces BOLT-RM (Boosting-inspired Online Learning with Transfer for Railway Maintenance), a model designed to address these challenges using continual learning for predictive maintenance. It retains past knowledge while improving predictive accuracy with each new learning episode, using a boosting-like knowledge sharing mechanism. The proposed BOLT-RM model demonstrates significant improvements in identifying wheel anomalies, establishing a reliable sequence for maintenance interventions.
  arXiv  Detail & Related papers  (2025-04-11T14:03:31Z)
• Strategizing Equitable Transit Evacuations: A Data-Driven Reinforcement Learning Approach [5.962540020947193]
  This paper proposes a data-driven, reinforcement learning-based framework to optimize bus-based evacuations. We model the evacuation problem as a Markov Decision Process solved by reinforcement learning. We show that the proposed framework achieves significant improvements in both evacuation efficiency and equitable service distribution.
  arXiv  Detail & Related papers  (2024-12-08T02:17:38Z)
• DiFSD: Ego-Centric Fully Sparse Paradigm with Uncertainty Denoising and Iterative Refinement for Efficient End-to-End Self-Driving [55.53171248839489]
  We propose an ego-centric fully sparse paradigm, named DiFSD, for end-to-end self-driving. Specifically, DiFSD mainly consists of sparse perception, hierarchical interaction and iterative motion planner. Experiments conducted on nuScenes and Bench2Drive datasets demonstrate the superior planning performance and great efficiency of DiFSD.
  arXiv  Detail & Related papers  (2024-09-15T15:55:24Z)
• Residual Chain Prediction for Autonomous Driving Path Planning [5.139918355140954]
  Residual Chain Loss dynamically adjusts the loss calculation process to enhance the temporal dependency and accuracy of predicted path points. Our findings highlight the potential of Residual Chain Loss to revolutionize planning component of autonomous driving systems.
  arXiv  Detail & Related papers  (2024-04-08T11:43:40Z)
• Applying Reinforcement Learning to Optimize Traffic Light Cycles [0.0]
  We propose the application of reinforcement learning to optimize traffic light cycles in real-time. We present a case study using the Simulation Urban Mobility simulator to train a Deep Q-Network algorithm.
  arXiv  Detail & Related papers  (2024-02-22T07:37:04Z)
• Traffic Light Control with Reinforcement Learning [0.0]
  This paper proposes a real-time traffic light control method using deep Q learning. It incorporates a reward function considering queue lengths, delays, travel time, and throughput. The model dynamically decides phase changes based on current traffic conditions.
  arXiv  Detail & Related papers  (2023-08-28T04:29:49Z)
• FastRLAP: A System for Learning High-Speed Driving via Deep RL and Autonomous Practicing [71.76084256567599]
  We present a system that enables an autonomous small-scale RC car to drive aggressively from visual observations using reinforcement learning (RL) Our system, FastRLAP (faster lap), trains autonomously in the real world, without human interventions, and without requiring any simulation or expert demonstrations. The resulting policies exhibit emergent aggressive driving skills, such as timing braking and acceleration around turns and avoiding areas which impede the robot's motion, approaching the performance of a human driver using a similar first-person interface over the course of training.
  arXiv  Detail & Related papers  (2023-04-19T17:33:47Z)
• Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks [0.5801044612920815]
  Connected automated driving has the potential to significantly improve urban traffic efficiency. Cooperative behavior planning can be employed to jointly optimize the motion of multiple vehicles. The present work proposes to leverage reinforcement learning and a graph-based scene representation for cooperative multi-agent planning.
  arXiv  Detail & Related papers  (2023-01-30T08:21:18Z)
• Unified Automatic Control of Vehicular Systems with Reinforcement Learning [64.63619662693068]
  This article contributes a streamlined methodology for vehicular microsimulation. It discovers high performance control strategies with minimal manual design. The study reveals numerous emergent behaviors resembling wave mitigation, traffic signaling, and ramp metering.
  arXiv  Detail & Related papers  (2022-07-30T16:23:45Z)
• Tackling Real-World Autonomous Driving using Deep Reinforcement Learning [63.3756530844707]
  In this work, we propose a model-free Deep Reinforcement Learning Planner training a neural network that predicts acceleration and steering angle. In order to deploy the system on board the real self-driving car, we also develop a module represented by a tiny neural network.
  arXiv  Detail & Related papers  (2022-07-05T16:33:20Z)
• Cooperative Behavioral Planning for Automated Driving using Graph Neural Networks [0.5801044612920815]
  This work proposes to leverage machine learning algorithms to optimize traffic flow at urban intersections by jointly planning for multiple vehicles. Learning-based behavior planning poses several challenges, demanding for a suited input and output representation as well as large amounts of ground-truth data. We train and evaluate the proposed method in an open-source simulation environment for decision making in automated driving.
  arXiv  Detail & Related papers  (2022-02-23T09:36:15Z)
• Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior [135.78858513845233]
  STRIVE is a method to automatically generate challenging scenarios that cause a given planner to produce undesirable behavior, like collisions. To maintain scenario plausibility, the key idea is to leverage a learned model of traffic motion in the form of a graph-based conditional VAE. A subsequent optimization is used to find a "solution" to the scenario, ensuring it is useful to improve the given planner.
  arXiv  Detail & Related papers  (2021-12-09T18:03:27Z)
• Offline-to-Online Reinforcement Learning via Balanced Replay and Pessimistic Q-Ensemble [135.6115462399788]
  Deep offline reinforcement learning has made it possible to train strong robotic agents from offline datasets. State-action distribution shift may lead to severe bootstrap error during fine-tuning. We propose a balanced replay scheme that prioritizes samples encountered online while also encouraging the use of near-on-policy samples.
  arXiv  Detail & Related papers  (2021-07-01T16:26:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.