Automated deep reinforcement learning for real-time scheduling strategy of multi-energy system integrated with post-carbon and direct-air carbon captured system

• URL: http://arxiv.org/abs/2301.07768v1
• Date: Wed, 18 Jan 2023 20:22:44 GMT
• Title: Automated deep reinforcement learning for real-time scheduling strategy of multi-energy system integrated with post-carbon and direct-air carbon captured system
• Authors: Tobi Michael Alabi, Nathan P. Lawrence, Lin Lu, Zaiyue Yang, R. Bhushan Gopaluni
• Abstract summary: The adoption of CDRT is not economically viable at the current carbon price. The proposed DRL agent can meet the prosumers' multi-energy demand and schedule the CDRT energy demand economically. The configuration with PCCS and solid-sorbent DACS is considered the most suitable.
• Score: 4.721325160754968
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The carbon-capturing process with the aid of CO2 removal technology (CDRT) has been recognised as an alternative and a prominent approach to deep decarbonisation. However, the main hindrance is the enormous energy demand and the economic implication of CDRT if not effectively managed. Hence, a novel deep reinforcement learning agent (DRL), integrated with an automated hyperparameter selection feature, is proposed in this study for the real-time scheduling of a multi-energy system coupled with CDRT. Post-carbon capture systems (PCCS) and direct-air capture systems (DACS) are considered CDRT. Various possible configurations are evaluated using real-time multi-energy data of a district in Arizona and CDRT parameters from manufacturers' catalogues and pilot project documentation. The simulation results validate that an optimised soft-actor critic (SAC) algorithm outperformed the TD3 algorithm due to its maximum entropy feature. We then trained four (4) SAC agents, equivalent to the number of considered case studies, using optimised hyperparameter values and deployed them in real time for evaluation. The results show that the proposed DRL agent can meet the prosumers' multi-energy demand and schedule the CDRT energy demand economically without specified constraints violation. Also, the proposed DRL agent outperformed rule-based scheduling by 23.65%. However, the configuration with PCCS and solid-sorbent DACS is considered the most suitable configuration with a high CO2 captured-released ratio of 38.54, low CO2 released indicator value of 2.53, and a 36.5% reduction in CDR cost due to waste heat utilisation and high absorption capacity of the selected sorbent. However, the adoption of CDRT is not economically viable at the current carbon price. Finally, we showed that CDRT would be attractive at a carbon price of 400-450USD/ton with the provision of tax incentives by the policymakers.

Related papers

• Carbon Market Simulation with Adaptive Mechanism Design [55.25103894620696]
  A carbon market is a market-based tool that incentivizes economic agents to align individual profits with the global utility. We propose an adaptive mechanism design framework, simulating the market using hierarchical, model-free multi-agent reinforcement learning (MARL) Numerical results show MARL enables government agents to balance productivity, equality, and carbon emissions.
  arXiv  Detail & Related papers  (2024-06-12T05:08:51Z)
• Generative AI for Low-Carbon Artificial Intelligence of Things with Large Language Models [67.0243099823109]
  Generative AI (GAI) holds immense potential to reduce carbon emissions of Artificial Intelligence of Things (AIoT) In this article, we explore the potential of GAI for carbon emissions reduction and propose a novel GAI-enabled solution for low-carbon AIoT. We propose a Large Language Model (LLM)-enabled carbon emission optimization framework, in which we design pluggable LLM and Retrieval Augmented Generation (RAG) modules.
  arXiv  Detail & Related papers  (2024-04-28T05:46:28Z)
• Optimal Economic Gas Turbine Dispatch with Deep Reinforcement Learning [4.059196561157555]
  Three popular DRL algorithms are implemented for an economic GT dispatch problem on a case study in Alberta, Canada. Among the tested algorithms and baseline methods, Deep Q-Networks (DQN) obtained the highest rewards. We propose and implement a method to assign GT operation and maintenance cost dynamically based on operating hours and cycles.
  arXiv  Detail & Related papers  (2023-08-28T22:42:51Z)
• Towards Carbon-Neutral Edge Computing: Greening Edge AI by Harnessing Spot and Future Carbon Markets [24.462679595118672]
  We propose an online algorithm that purchases CER in multiple timescales and makes decisions about where to offload ML tasks. Considering the NP-hardness of the $T$-slot problems, we further propose the resource-restricted randomized dependent rounding algorithm. Our theoretical analysis and extensive simulation results driven by the real carbon intensity trace show the superior performance of the proposed algorithms.
  arXiv  Detail & Related papers  (2023-04-22T11:14:16Z)
• Machine Guided Discovery of Novel Carbon Capture Solvents [48.7576911714538]
  Machine learning offers a promising method for reducing the time and resource burdens of materials development. We have developed an end-to-end "discovery cycle" to select new aqueous amines compatible with the commercially viable acid gas scrubbing carbon capture. The prediction process shows 60% accuracy against experiment for both material parameters and 80% for a single parameter on an external test set.
  arXiv  Detail & Related papers  (2023-03-24T18:32:38Z)
• Real-time high-resolution CO$_2$ geological storage prediction using nested Fourier neural operators [58.728312684306545]
  Carbon capture and storage (CCS) plays an essential role in global decarbonization. Scaling up CCS deployment requires accurate and high-resolution modeling of the storage reservoir pressure buildup and the gaseous plume migration. We introduce Nested Fourier Neural Operator (FNO), a machine-learning framework for high-resolution dynamic 3D CO2 storage modeling at a basin scale.
  arXiv  Detail & Related papers  (2022-10-31T04:04:03Z)
• (Private)-Retroactive Carbon Pricing [(P)ReCaP]: A Market-based Approach for Climate Finance and Risk Assessment [64.83786252406105]
  Retrospective Social Cost of Carbon Updating (ReSCCU) is a novel mechanism that corrects for limitations as empirically measured evidence is collected. To implement ReSCCU in the context of carbon taxation, we propose Retroactive Carbon Pricing (ReCaP) To alleviate systematic risks and minimize government involvement, we introduce the Private ReCaP (PReCaP) prediction market.
  arXiv  Detail & Related papers  (2022-05-02T06:02:13Z)
• Digital Twins based Day-ahead Integrated Energy System Scheduling under Load and Renewable Energy Uncertainties [14.946548030861866]
  Digital twins (DT) of an integrated energy system (IES) can improve coordinations among various energy converters. Case studies show that the proposed DT-based method is able to reduce the operating cost of IES by 63.5%.
  arXiv  Detail & Related papers  (2021-09-29T13:58:01Z)
• Estimating air quality co-benefits of energy transition using machine learning [5.758035706324685]
  Estimating health benefits of reducing fossil fuel use from improved air quality provides important rationales for carbon emissions abatement. We develop a novel and succinct machine learning framework that is able to provide precise and robust annual average fine particle (PM2.5) concentration estimations. Our findings prompt careful policy designs to maximize cost-effectiveness in the transition towards a carbon-neutral energy system.
  arXiv  Detail & Related papers  (2021-05-29T14:52:57Z)
• Optimal control towards sustainable wastewater treatment plants based on multi-agent reinforcement learning [1.0765359420035392]
  This study used a novel technique, multi-agent deep reinforcement learning, to optimize dissolved oxygen and chemical dosage in a WWTP. The result shows that optimization based on LCA has lower environmental impacts compared to baseline scenario. The cost-oriented control strategy exhibits comparable overall performance to the LCA driven strategy.
  arXiv  Detail & Related papers  (2020-08-19T05:34:47Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.