Optimized Renewable Energy Planning MDP for Socially-Equitable Electricity Coverage in the US

• URL: http://arxiv.org/abs/2509.00008v1
• Date: Fri, 15 Aug 2025 04:56:01 GMT
• Title: Optimized Renewable Energy Planning MDP for Socially-Equitable Electricity Coverage in the US
• Abstract summary: This study develops a Markov Decision Process framework to optimize renewable energy allocation.<n>It explicitly addresses social equity concerns in electricity distribution.<n>Results show equity-focused optimization can achieve 32.9% renewable energy penetration while reducing underserved low-income populations by 55%.
• Score: 0.9668407688201359
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traditional power grid infrastructure presents significant barriers to renewable energy integration and perpetuates energy access inequities, with low-income communities experiencing disproportionately longer power outages. This study develops a Markov Decision Process (MDP) framework to optimize renewable energy allocation while explicitly addressing social equity concerns in electricity distribution. The model incorporates budget constraints, energy demand variability, and social vulnerability indicators across eight major U.S. cities to evaluate policy alternatives for equitable clean energy transitions. Numerical experiments compare the MDP-based approach against baseline policies including random allocation, greedy renewable expansion, and expert heuristics. Results demonstrate that equity-focused optimization can achieve 32.9% renewable energy penetration while reducing underserved low-income populations by 55% compared to conventional approaches. The expert policy achieved the highest reward, while the Monte Carlo Tree Search baseline provided competitive performance with significantly lower budget utilization, demonstrating that fair distribution of clean energy resources is achievable without sacrificing overall system performance and providing ways for integrating social equity considerations with climate goals and inclusive access to clean power infrastructure.

Related papers

• Reinforcement learning-based dynamic cleaning scheduling framework for solar energy system [0.4061135251278187]
  This study presents a reinforcement learning-based framework to autonomously optimize the cleaning schedules of PV panels in arid regions.<n>It achieves up to 13% cost savings by dynamically responding to weather uncertainties.<n>This work underscores the potential of RL-driven autonomous decision-making to optimize maintenance operations in renewable energy systems.
  arXiv  Detail & Related papers  (2026-03-08T08:13:36Z)
• Who cuts emissions, who turns up the heat? causal machine learning estimates of energy efficiency interventions [0.0]
  We use a causal machine learning model trained on nationally representative data of the English housing stock.<n>We estimate average and conditional treatment effects of wall insulation on gas consumption.<n>Low energy burden groups achieve substantial savings, whereas those experiencing high energy burdens see little to no reduction.
  arXiv  Detail & Related papers  (2025-08-06T14:29:38Z)
• An Explainable Equity-Aware P2P Energy Trading Framework for Socio-Economically Diverse Microgrid [0.0]
  This paper proposes a novel framework that integrates multi-objective mixed-integer linear programming (MILP), cooperative game theory, and a dynamic equity-adjustment mechanism driven by reinforcement learning (RL)<n>The framework demonstrates peak demand reductions of up to 72.6%, and significant cooperative gains.
  arXiv  Detail & Related papers  (2025-07-24T18:38:51Z)
• A Reinforcement Learning Approach for Optimal Control in Microgrids [43.122212629962235]
  Microgrids provide a promising solution by enabling localized control over energy generation, storage, and distribution.<n>This paper presents a novel reinforcement learning (RL)-based methodology for optimizing microgrid energy management.
  arXiv  Detail & Related papers  (2025-06-28T20:10:00Z)
• Explainable AI for building energy retrofitting under data scarcity [40.14307808809578]
  This study presents an Artificial Intelligence (AI) and Machine Learning (ML)-based framework to recommend energy efficiency measures for residential buildings.<n>Using Latvia as a case study, the methodology addresses challenges associated with limited datasets, class imbalance and data scarcity.<n>The evaluation of the approach shows that it notably overcomes data limitations, achieving improvements up to 54% in precision, recall and F1 score.
  arXiv  Detail & Related papers  (2025-04-08T14:00:08Z)
• The Energy Loss Phenomenon in RLHF: A New Perspective on Mitigating Reward Hacking [72.45765726160151]
  This work identifies the Energy Loss Phenomenon in Reinforcement Learning from Human Feedback and its connection to reward hacking.<n>We propose an Energy loss-aware PPO algorithm (EPPO) which penalizes the increase in energy loss in the final layer during reward calculation to prevent excessive energy loss.
  arXiv  Detail & Related papers  (2025-01-31T18:10:53Z)
• A Safe Genetic Algorithm Approach for Energy Efficient Federated Learning in Wireless Communication Networks [53.561797148529664]
  Federated Learning (FL) has emerged as a decentralized technique, where contrary to traditional centralized approaches, devices perform a model training in a collaborative manner. Despite the existing efforts made in FL, its environmental impact is still under investigation, since several critical challenges regarding its applicability to wireless networks have been identified. The current work proposes a Genetic Algorithm (GA) approach, targeting the minimization of both the overall energy consumption of an FL process and any unnecessary resource utilization.
  arXiv  Detail & Related papers  (2023-06-25T13:10:38Z)
• Combating Uncertainties in Wind and Distributed PV Energy Sources Using Integrated Reinforcement Learning and Time-Series Forecasting [2.774390661064003]
  unpredictability of renewable energy generation poses challenges for electricity providers and utility companies. We propose a novel framework with two objectives: (i) combating uncertainty of renewable energy in smart grid by leveraging time-series forecasting with Long-Short Term Memory (LSTM) solutions, and (ii) establishing distributed and dynamic decision-making framework with multi-agent reinforcement learning using Deep Deterministic Policy Gradient (DDPG) algorithm.
  arXiv  Detail & Related papers  (2023-02-27T19:12:50Z)
• Predict+Optimize Problem in Renewable Energy Scheduling [31.032838966665828]
  This paper benchmarks solutions from the IEEE-CIS Technical Challenge on Predict+ for Renewable Energy Scheduling.<n>The top-ranked method employed optimization using LightGBM ensembles achieved at least a 2% reduction in energy costs.<n>The novelty of this work lies in its comprehensive evaluation of Predict+ methodologies applied to a real-world renewable energy scheduling problem.
  arXiv  Detail & Related papers  (2022-12-21T02:34:12Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)
• Battery and Hydrogen Energy Storage Control in a Smart Energy Network with Flexible Energy Demand using Deep Reinforcement Learning [2.5666730153464465]
  We introduce a hybrid energy storage system composed of battery and hydrogen energy storage. We propose a deep reinforcement learning-based control strategy to optimise the scheduling of the hybrid energy storage system and energy demand in real-time.
  arXiv  Detail & Related papers  (2022-08-26T16:47:48Z)
• ECO: Enabling Energy-Neutral IoT Devices through Runtime Allocation of Harvested Energy [0.8774604259603302]
  We present a runtime-based energy-allocation framework to optimize the utility of the target device under energy constraints. The proposed framework uses an efficient iterative algorithm to compute initial energy allocations at the beginning of a day. We evaluate this framework using solar and motion energy harvesting modalities and American Time Use Survey data from 4772 different users.
  arXiv  Detail & Related papers  (2021-02-26T17:21:25Z)
• A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids [58.666456917115056]
  This paper presents a Reinforcement Learning based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers.
  arXiv  Detail & Related papers  (2020-09-23T02:17:51Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.