Emission-Aware Reinforcement Learning for Sustainable Electric Vehicle Charging and Carbon Dioxide Reduction Under Varying Renewable Penetration

• URL: http://arxiv.org/abs/2605.24543v1
• Date: Sat, 23 May 2026 12:19:45 GMT
• Title: Emission-Aware Reinforcement Learning for Sustainable Electric Vehicle Charging and Carbon Dioxide Reduction Under Varying Renewable Penetration
• Abstract summary: Electric Vehicle (EV) adoption challenges power distribution networks through peak load spikes, voltage instability, and transformer overloads from uncoordinated charging.<n>Existing approaches rarely treat real-time carbon intensity or fluctuating renewable energy (RE) availability as primary scheduling objectives.<n>This paper proposes an emission-aware RL strategy based on the Soft Actor Critic (SAC) algorithm, with a multi-objective reward that penalises carbon emissions, curtailed on-site renewables, and unmet user demand.
• Score: 1.4498318750453458
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The rapid growth of Electric Vehicle (EV) adoption challenges power distribution networks through peak load spikes, voltage instability, and transformer overloads from uncoordinated charging. While Model Predictive Control (MPC) and standard Reinforcement Learning (RL) methods have addressed these issues, existing approaches rarely treat real-time carbon intensity or fluctuating renewable energy (RE) availability as primary scheduling objectives, leaving substantial decarbonisation potential unrealised. This paper proposes an emission-aware RL strategy based on the Soft Actor Critic (SAC) algorithm, with a multi-objective reward that penalises carbon emissions, curtailed on-site renewables, and unmet user demand. The agent is trained within a unified benchmarking framework on the EV2Gym platform, incorporating behind-the-meter solar and wind profiles, time-varying EirGrid carbon intensity data, and realistic workplace EV behaviour across 25 Electric Vehicle Supply Equipment (EVSE) units. Nine control strategies, including heuristics, emission-aware MPC variants, and the proposed RL agent, are compared under five renewable penetration scenarios (0%-50%) over ten independent runs each. The RL agent achieves a carbon intensity as low as 23.96 grams of carbon dioxide per kilowatt-hour under 50% wind penetration, representing up to 87% emission reduction versus the uncontrolled baseline, and outperforms the external graph-based Power Distribution Network (PDN) benchmark. Transformer overload remains below 7 kWh across scenarios, against up to 1093 kWh for the As Fast As Possible (AFAP) heuristic, and renewable self-consumption reaches 52% under combined wind and solar supply. Embedding carbon intensity forecasts into the RL state and reward aligns charging with low-emission periods while preserving grid compliance and user satisfaction.

Related papers

• FM-CAC: Carbon-Aware Control for Battery-Buffered Edge AI via Time-Series Foundation Models [4.9890124441309185]
  Edge AI deployments scale to billions of devices running always-on, real-time compound AI pipelines.<n>This paper proposes FM-CAC, a proactive carbon-aware control framework that leverages a battery as an active temporal buffer.<n>Results show that FM-CAC reduces carbon emissions by up to 65.6% while maintaining near-maximum inference accuracy.
  arXiv  Detail & Related papers  (2026-04-07T17:23:06Z)
• A Cherry-Picking Approach to Large Load Shaping for More Effective Carbon Reduction [1.392465349422406]
  This study uses a series of calibrated ERCOT day-ahead direct current optimal power flow (DC-OPF) simulations for counterfactual analysis of load shaping strategies on grid CO2 emissions and cost of electricity.<n>In terms of annual grid level CO2 emissions reductions, LMP-based shaping outperforms other common strategies, but can be significantly improved upon.
  arXiv  Detail & Related papers  (2026-01-25T20:43:51Z)
• Forecast Aware Deep Reinforcement Learning for Efficient Electricity Load Scheduling in Dairy Farms [1.299941371793082]
  This study proposes a Deep Reinforcement Learning framework for efficient load scheduling in dairy farms.<n>The proposed Forecast Aware PPO incorporates short term forecasts of demand and renewable generation using hour of day and month based residual calibration.<n>For battery scheduling, PPO reduces grid imports by 13.1%, demonstrating scalability and effectiveness for sustainable energy management in modern dairy farming.
  arXiv  Detail & Related papers  (2026-01-12T22:41:26Z)
• Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids [50.64533198075622]
  Reinforcement learning (RL) is a powerful framework for optimizing decision-making in complex systems under uncertainty.<n>In this paper, we introduce Shielded Controller Units (SCUs), a systematic and interpretable approach that leverages prior knowledge of system dynamics.<n>We demonstrate the effectiveness of SCUs on a remote microgrid optimization task with strict operational requirements.
  arXiv  Detail & Related papers  (2025-11-30T19:28:34Z)
• Resilient Charging Infrastructure via Decentralized Coordination of Electric Vehicles at Scale [37.56003520528009]
  Existing decentralized approaches struggle under severe contingencies, such as station outages or unexpected surges in charging requests.<n>We propose a novel collective learning-based coordination framework that allows EVs to balance individual comfort on their selections against system-wide efficiency.<n>In the framework, EVs are recommended for adaptive charging behaviors that shift priority between comfort and efficiency.
  arXiv  Detail & Related papers  (2025-11-26T00:32:23Z)
• Towards net-zero manufacturing: carbon-aware scheduling for GHG emissions reduction [0.0]
  Scope 2 emissions are the indirect emissions related to the production and consumption of grid electricity.<n>This study introduces a carbon-aware permutation flow-shop scheduling model designed to reduce scope 2 emissions.
  arXiv  Detail & Related papers  (2025-03-03T09:06:54Z)
• Federated Reinforcement Learning for Electric Vehicles Charging Control on Distribution Networks [42.04263644600909]
  Multi-agent deep reinforcement learning (MADRL) has proven its effectiveness in EV charging control. Existing MADRL-based approaches fail to consider the natural power flow of EV charging/discharging in the distribution network. This paper proposes a novel approach that combines multi-EV charging/discharging with a radial distribution network (RDN) operating under optimal power flow.
  arXiv  Detail & Related papers  (2023-08-17T05:34:46Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• Solar Power driven EV Charging Optimization with Deep Reinforcement Learning [6.936743119804558]
  Decentralized energy resources, such as Electric Vehicles (EV) and solar photovoltaic systems (PV), are continuously integrated in residential power systems. This paper aims to address the challenge of domestic EV charging while prioritizing clean, solar energy consumption.
  arXiv  Detail & Related papers  (2022-11-17T11:52:27Z)
• Federated Reinforcement Learning for Real-Time Electric Vehicle Charging and Discharging Control [42.17503767317918]
  This paper develops an optimal EV charging/discharging control strategy for different EV users under dynamic environments. A horizontal federated reinforcement learning (HFRL)-based method is proposed to fit various users' behaviors and dynamic environments. Simulation results illustrate that the proposed real-time EV charging/discharging control strategy can perform well among various factors.
  arXiv  Detail & Related papers  (2022-10-04T08:22:46Z)
• Modelling the transition to a low-carbon energy supply [91.3755431537592]
  A transition to a low-carbon electricity supply is crucial to limit the impacts of climate change. Reducing carbon emissions could help prevent the world from reaching a tipping point, where runaway emissions are likely. Runaway emissions could lead to extremes in weather conditions around the world.
  arXiv  Detail & Related papers  (2021-09-25T12:37:05Z)
• Risk Adversarial Learning System for Connected and Autonomous Vehicle Charging [43.42105971560163]
  We study the design of a rational decision support system (RDSS) for a connected and autonomous vehicle charging infrastructure (CAV-CI) In the considered CAV-CI, the distribution system operator (DSO) deploys electric vehicle supply equipment (EVSE) to provide an EV charging facility for human-driven connected vehicles (CVs) and autonomous vehicles (AVs) The charging request by the human-driven EV becomes irrational when it demands more energy and charging period than its actual need. We propose a novel risk adversarial multi-agent learning system (ALS) for CAV-CI to solve
  arXiv  Detail & Related papers  (2021-08-02T02:38:15Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.