Multi-market value-stacking: Battery control for combined imbalance participation and non-uniform FCR bidding

• URL: http://arxiv.org/abs/2605.23964v1
• Date: Tue, 12 May 2026 17:32:11 GMT
• Title: Multi-market value-stacking: Battery control for combined imbalance participation and non-uniform FCR bidding
• Abstract summary: We propose a two-stage control framework for the European context that introduces non-uniform FCR bids.<n>In the first stage, we derive a time-varying bid sequence using data-driven Monte Carlo (MC) optimization.<n>In the second stage, a Deep Reinforcement Learning (DRL) agent leverages the residual flexibility for real-time imbalance trading.
• Score: 2.183622338864934
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The growing share of Renewable Energy Sources (RES) in modern power systems increases both grid imbalances and frequency deviations, reinforcing the need for ancillary services such as Frequency Containment Reserve (FCR) and passive balancing. Battery Energy Storage Systems (BESS) are well-suited for these services, but prior research typically relies on uniform FCR bids that remain constant throughout the control period. Such static bids fail to fully exploit BESS flexibility, as they do not balance the trade-off between reserving energy for FCR delivery and using it for imbalance arbitrage, limiting the achievable value in value-stacking settings. To address this limitation, we propose a two-stage control framework for the European context that introduces non-uniform FCR bids. In the first stage, we derive a time-varying bid sequence using data-driven Monte Carlo (MC) optimization. In the second stage, a Deep Reinforcement Learning (DRL) agent leverages the residual flexibility for real-time imbalance trading while proactively managing the State of Energy (SoE) to ensure compliance with FCR requirements. The framework is presented as a proof of concept, highlighting the potential benefits of time-varying bidding strategies. By incorporating daily cycle budgets and time-varying reserve commitments, our approach achieves a 7.56% profit increase compared to uniform baselines. These results show that non-uniform bidding can unlock additional value by more effectively aligning reserve obligations with rapidly changing imbalance opportunities.

Related papers

• Constraint-Aware Aggregation for Federated Reinforcement Learning in Microgrid Energy Coordination [1.675857332621569]
  Federated Reinforcement Learning (FedRL) enables coordination of distributed energy resources without sharing raw local data.<n>Standard aggregation methods such as FedAvg do not account for system-level constraints, often leading to unsafe global behavior.<n>We propose aggregation rules that incorporate both local performance and estimated constraint violation into the server-side update.
  arXiv  Detail & Related papers  (2026-07-14T13:33:25Z)
• Learning to Bid in FCR Markets: A Best-of-Both-Worlds Approach [2.526827376313772]
  We show that the multi-country FCR clearing problem can be recast as a repeated multi-unit uniform-price auction against an endogenous vector of opposing bids.<n>This reformulation yields an online learning problem and allows us to adapt a Best-of-Worlds semi-bandit algorithm implementable from this standard market feedback.<n>The results show that learning-based bidding in FCR markets is theoretically grounded and practically useful when the learning rule matches product-level market stability.
  arXiv  Detail & Related papers  (2026-05-29T09:38:47Z)
• Energy-Structured Low-Rank Adaptation for Continual Learning [78.5390284258307]
  We propose textbfEnergy-Concentrated and textbfEnergy-Ordered textbfLow-textbfRank textbfAdaptation (E$2$-LoRA)<n>By explicitly ordering and concentrating knowledge into leading ranks, E$2$-LoRA frees capacity for subsequent tasks.
  arXiv  Detail & Related papers  (2026-05-26T12:55:02Z)
• Ratio-Variance Regularized Policy Optimization [64.95520246570446]
  We show that explicitly constraining the policy ratio variance provides a principled local approximation to trust-region constraints.<n>We introduce $bf R2bf VPO$ (Ratio-Variance Regularized Policy Optimization), which implements this constraint via a primal-dual optimization framework.
  arXiv  Detail & Related papers  (2026-05-26T09:53:42Z)
• Post-hoc Provider Fairness Adaptation via Hierarchical Exposure Alignment [54.58748721533078]
  Post-hoc Fairness Adaptation (PFA) is a lightweight framework that equips a frozen recommender with a fairness adapter.<n>It learns personalized additive score adjustments from user-item embeddings to steer provider exposure toward fairness.<n>PFA achieves substantial fairness gains with negligible accuracy loss, consistently outperforming strong baselines.
  arXiv  Detail & Related papers  (2026-05-02T16:32:52Z)
• ECHO-2: A Large-Scale Distributed Rollout Framework for Cost-Efficient Reinforcement Learning [12.981638650752926]
  Reinforcement learning (RL) is a critical stage in post-training large language models (LLMs)<n>We present ECHO-2, a distributed RL framework for post-training with remote inference workers and non-negligible dissemination latency.<n>ECHO-2 significantly improves cost efficiency while preserving RL reward comparable to strong baselines.
  arXiv  Detail & Related papers  (2026-02-02T14:57:53Z)
• Deep Time-series Forecasting Needs Kernelized Moment Balancing [56.619037429652984]
  Deep time-series forecasting can be formulated as a distribution balancing problem aimed at aligning the distribution of the forecasts and ground truths.<n>We propose direct forecasting with kernelized moment balancing (KMB-DF)<n>Experiments across multiple models and datasets show that KMB-DF consistently improves forecasting accuracy and achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2026-01-31T13:20:18Z)
• Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids [50.64533198075622]
  Reinforcement learning (RL) is a powerful framework for optimizing decision-making in complex systems under uncertainty.<n>In this paper, we introduce Shielded Controller Units (SCUs), a systematic and interpretable approach that leverages prior knowledge of system dynamics.<n>We demonstrate the effectiveness of SCUs on a remote microgrid optimization task with strict operational requirements.
  arXiv  Detail & Related papers  (2025-11-30T19:28:34Z)
• Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies [4.950434218152639]
  We propose a new RL-based control framework for batteries to obtain a safe energy arbitrage strategy in the imbalance settlement mechanism. We use the Belgian imbalance price of 2023 to evaluate the performance of our proposed framework.
  arXiv  Detail & Related papers  (2024-04-29T16:03:21Z)
• Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanism [6.520803851931361]
  Growth in the penetration of renewable energy sources makes supply more uncertain and leads to an increase in the system imbalance. We propose a battery control framework based on distributional reinforcement learning (DRL) Our proposed control framework takes a risk-sensitive perspective, allowing BRPs to adjust their risk preferences.
  arXiv  Detail & Related papers  (2023-12-23T15:38:31Z)
• Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework [53.97223237572147]
  This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users.
  arXiv  Detail & Related papers  (2022-11-29T01:18:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.