Momentum Based Reward Design for Low Emission Traffic Signal Control

• URL: http://arxiv.org/abs/2605.29693v1
• Date: Thu, 28 May 2026 09:53:31 GMT
• Title: Momentum Based Reward Design for Low Emission Traffic Signal Control
• Abstract summary: This paper proposes a Momentum-Based Reward Function (MBRF) that encourages vehicles to keep moving rather than penalizing congestion alone.<n>Results show that the proposed reward produces better throughput-emission trade-offs and more stable learning behavior than delay or queue-based rewards.
• Score: 1.8352113484137627
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Urban traffic congestion is a growing global issue contributing significantly to long commute times and environmental pollution. Traditional traffic signal control systems often fail to adapt to dynamic traffic conditions. Adaptive traffic signal control can improve urban traffic without changing road infrastructure. Deep Reinforcement Learning (DRL) has shown strong performance for this task, but existing delay and queue-based rewards often produce short-sighted or unstable policies. This paper proposes a Momentum-Based Reward Function (MBRF) that encourages vehicles to keep moving rather than penalizing congestion alone. The method is evaluated in SUMO (Simulation of Urban MObility) using standard traffic metrics such as waiting time, queue length, throughput, and CO2 emissions. Results show that the proposed reward produces better throughput-emission trade-offs and more stable learning behavior than delay or queue-based rewards, as well as classical controllers such as Max Pressure and LQF.

Related papers

• Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections [0.0]
  Traffic signal systems are increasingly deployed as networked cyber-physical components within smart-city infrastructures.<n>This paper investigates reinforcement learning as an edge-intelligent approach for adaptive traffic signal operation at a signalized urban intersection in Kuwait.
  arXiv  Detail & Related papers  (2026-06-20T15:44:01Z)
• Self-Regulating Cars: Automating Traffic Control in Free Flow Road Networks [5.557442038265024]
  We introduce self-regulating cars, a reinforcement learning-based traffic control protocol that dynamically modulates vehicle speeds to optimize throughput and prevent congestion.<n>Our approach integrates classical traffic flow theory, gap acceptance models, and microscopic simulation into a physics-informed RL framework.<n>It also achieves smoother, congestion-resistant flow while generalizing across varied traffic patterns, demonstrating its potential for scalable, ML-driven traffic management.
  arXiv  Detail & Related papers  (2025-06-13T17:31:23Z)
• Smart Traffic Signals: Comparing MARL and Fixed-Time Strategies [0.0]
  Urban traffic congestion, particularly at intersections, significantly impacts travel time, fuel consumption, and emissions.<n>Traditional fixed-time signal control systems often lack the adaptability to manage dynamic traffic patterns effectively.<n>This study explores the application of multi-agent reinforcement learning to optimize traffic signal coordination across multiple intersections.
  arXiv  Detail & Related papers  (2025-05-20T15:59:44Z)
• Large-scale Regional Traffic Signal Control Based on Single-Agent Reinforcement Learning [5.1129002613887105]
  This paper puts forward a single-agent reinforcement learning (RL)-based regional traffic signal control model.<n>The model can coordinate traffic signals across a large area with the goals of alleviating regional traffic congestion and minimizing the total travel time.<n>Experiments are carried out with the SUMO traffic simulation software.
  arXiv  Detail & Related papers  (2025-03-12T10:51:29Z)
• Improving Traffic Flow Predictions with SGCN-LSTM: A Hybrid Model for Spatial and Temporal Dependencies [55.2480439325792]
  This paper introduces the Signal-Enhanced Graph Convolutional Network Long Short Term Memory (SGCN-LSTM) model for predicting traffic speeds across road networks. Experiments on the PEMS-BAY road network traffic dataset demonstrate the SGCN-LSTM model's effectiveness.
  arXiv  Detail & Related papers  (2024-11-01T00:37:00Z)
• Reinforcement Learning for Adaptive Traffic Signal Control: Turn-Based and Time-Based Approaches to Reduce Congestion [2.733700237741334]
  This paper explores the use of Reinforcement Learning to enhance traffic signal operations at intersections. We introduce two RL-based algorithms: a turn-based agent, which dynamically prioritizes traffic signals based on real-time queue lengths, and a time-based agent, which adjusts signal phase durations according to traffic conditions. Simulation results demonstrate that both RL algorithms significantly outperform conventional traffic signal control systems.
  arXiv  Detail & Related papers  (2024-08-28T12:35:56Z)
• GARLIC: GPT-Augmented Reinforcement Learning with Intelligent Control for Vehicle Dispatching [81.82487256783674]
  GARLIC: a framework of GPT-Augmented Reinforcement Learning with Intelligent Control for vehicle dispatching.<n>This paper introduces GARLIC: a framework of GPT-Augmented Reinforcement Learning with Intelligent Control for vehicle dispatching.
  arXiv  Detail & Related papers  (2024-08-19T08:23:38Z)
• A Holistic Framework Towards Vision-based Traffic Signal Control with Microscopic Simulation [53.39174966020085]
  Traffic signal control (TSC) is crucial for reducing traffic congestion that leads to smoother traffic flow, reduced idling time, and mitigated CO2 emissions. In this study, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation. We introduce a holistic traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmarking.
  arXiv  Detail & Related papers  (2024-03-11T16:42:29Z)
• Uncertainty Quantification for Image-based Traffic Prediction across Cities [63.136794104678025]
  Uncertainty quantification (UQ) methods provide an approach to induce probabilistic reasoning. We investigate their application to a large-scale image-based traffic dataset spanning multiple cities. We find that our approach can capture both temporal and spatial effects on traffic behaviour in a representative case study for the city of Moscow.
  arXiv  Detail & Related papers  (2023-08-11T13:35:52Z)
• DenseLight: Efficient Control for Large-scale Traffic Signals with Dense Feedback [109.84667902348498]
  Traffic Signal Control (TSC) aims to reduce the average travel time of vehicles in a road network. Most prior TSC methods leverage deep reinforcement learning to search for a control policy. We propose DenseLight, a novel RL-based TSC method that employs an unbiased reward function to provide dense feedback on policy effectiveness.
  arXiv  Detail & Related papers  (2023-06-13T05:58:57Z)
• AI-aided Traffic Control Scheme for M2M Communications in the Internet of Vehicles [61.21359293642559]
  The dynamics of traffic and the heterogeneous requirements of different IoV applications are not considered in most existing studies. We consider a hybrid traffic control scheme and use proximal policy optimization (PPO) method to tackle it.
  arXiv  Detail & Related papers  (2022-03-05T10:54:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.