Learning to Bid in FCR Markets: A Best-of-Both-Worlds Approach
- URL: http://arxiv.org/abs/2605.31070v1
- Date: Fri, 29 May 2026 09:38:47 GMT
- Title: Learning to Bid in FCR Markets: A Best-of-Both-Worlds Approach
- Abstract summary: We show that the multi-country FCR clearing problem can be recast as a repeated multi-unit uniform-price auction against an endogenous vector of opposing bids.<n>This reformulation yields an online learning problem and allows us to adapt a Best-of-Worlds semi-bandit algorithm implementable from this standard market feedback.<n>The results show that learning-based bidding in FCR markets is theoretically grounded and practically useful when the learning rule matches product-level market stability.
- Score: 2.526827376313772
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Bidding in the European Frequency Containment Reserve (FCR) market is challenging for flexibility providers because competing offers are hidden and bidders observe only partial feedback form the market, such as, clearing price and awarded quantity. For a participant active in a single country, we show that the multi-country FCR clearing problem can be recast as a repeated multi-unit uniform-price auction against an endogenous vector of opposing bids. This reformulation yields an online learning problem and allows us to adapt a Best-of-Both-Worlds combinatorial semi-bandit algorithm implementable from this standard market feedback. The resulting bidder achieves logarithmic pseudo-regret in stochastic environments and $\mathcal{O}(\sqrt{T})$ regret in adversarial ones. Synthetic experiments confirm the expected scaling, and backtests on historical European FCR data show competitive performance in practice: the method performs especially well on stable products, while EXP3-type baselines can be safer under stronger non-stationarity. Overall, the results show that learning-based bidding in FCR markets is theoretically grounded and practically useful when the learning rule matches product-level market stability.
Related papers
- Post-hoc Provider Fairness Adaptation via Hierarchical Exposure Alignment [54.58748721533078]
Post-hoc Fairness Adaptation (PFA) is a lightweight framework that equips a frozen recommender with a fairness adapter.<n>It learns personalized additive score adjustments from user-item embeddings to steer provider exposure toward fairness.<n>PFA achieves substantial fairness gains with negligible accuracy loss, consistently outperforming strong baselines.
arXiv Detail & Related papers (2026-05-02T16:32:52Z) - Training Language Models for Bilateral Trade with Private Information [47.25254982913256]
Bilateral trade demands individual, strategic surplus rationality, and cooperation to realize gains from trade.<n>We develop a structured bargaining environment where large language models negotiate via tool calls within an event-driven simulator.<n>The environment serves two purposes: a benchmark for frontier models and as a training environment for open-weight models via reinforcement learning.
arXiv Detail & Related papers (2026-04-10T03:04:20Z) - Transfer Learning for Contextual Joint Assortment-Pricing under Cross-Market Heterogeneity [6.055048454425298]
We study transfer learning for contextual joint-pricing under a multinomial logit choice model with bandit feedback.<n>We develop a bias-aware framework that combines aggregate-then-debias estimation with a UCB-style policy.
arXiv Detail & Related papers (2026-03-18T14:48:04Z) - CARE What Fails: Contrastive Anchored-REflection for Verifiable Multimodal [84.71254539482369]
Group-relative reinforcement learning with verifiable rewards (RLVR) often wastes the most informative data it already has the failures.<n>We present CARE, a failure-centric post-training framework for multimodal reasoning that turns errors into supervision.<n> CARE improves accuracy and training smoothness while explicitly increasing the share of learning signal that comes from failures.
arXiv Detail & Related papers (2025-12-22T16:34:21Z) - Robust Reinforcement Learning in Finance: Modeling Market Impact with Elliptic Uncertainty Sets [57.179679246370114]
In financial applications, reinforcement learning (RL) agents are commonly trained on historical data, where their actions do not influence prices.<n>During deployment, these agents trade in live markets where their own transactions can shift asset prices, a phenomenon known as market impact.<n>Traditional robust RL approaches address this model misspecification by optimizing the worst-case performance over a set of uncertainties.<n>We develop a novel class of elliptic uncertainty sets, enabling efficient and tractable robust policy evaluation.
arXiv Detail & Related papers (2025-10-22T18:22:25Z) - The Bidding Games: Reinforcement Learning for MEV Extraction on Polygon Blockchain [0.11880231424287215]
We present a reinforcement learning framework for MEV extraction on Polygon Atlas.<n>Our work establishes that reinforcement learning provides a critical advantage in high-frequency MEV environments.
arXiv Detail & Related papers (2025-10-16T12:54:53Z) - Scalable Fairness Shaping with LLM-Guided Multi-Agent Reinforcement Learning for Peer-to-Peer Electricity Markets [3.7321070110102075]
Peer-to-peer (P2P) energy trading is becoming central to modern distribution systems.<n>A fairness-aware multiagent reinforcement learning framework, FairMarket-RL, is proposed.<n>The framework shifts exchanges toward local P2P trades, lowers consumer costs relative to grid-only procurement, sustains strong fairness across participants, and preserves utility viability.
arXiv Detail & Related papers (2025-08-26T02:25:17Z) - FairMarket-RL: LLM-Guided Fairness Shaping for Multi-Agent Reinforcement Learning in Peer-to-Peer Markets [1.7284653203366598]
This paper presents FairMarket-RL, a novel framework that combines Large Language Models (LLMs) with Reinforcement Learning (RL) to enable fairness-aware trading agents.<n>In a simulated P2P microgrid with multiple sellers and buyers, the LLM acts as a real-time fairness critic, evaluating each trading episode using two metrics: Fairness-To-Buyer (FTB) and Fairness-Between-Sellers (FBS)
arXiv Detail & Related papers (2025-06-28T01:17:55Z) - VFed-SSD: Towards Practical Vertical Federated Advertising [53.08038962443853]
We propose a semi-supervised split distillation framework VFed-SSD to alleviate the two limitations.
Specifically, we develop a self-supervised task MatchedPair Detection (MPD) to exploit the vertically partitioned unlabeled data.
Our framework provides an efficient federation-enhanced solution for real-time display advertising with minimal deploying cost and significant performance lift.
arXiv Detail & Related papers (2022-05-31T17:45:30Z) - Multi-Asset Spot and Option Market Simulation [52.77024349608834]
We construct realistic spot and equity option market simulators for a single underlying on the basis of normalizing flows.
We leverage the conditional invertibility property of normalizing flows and introduce a scalable method to calibrate the joint distribution of a set of independent simulators.
arXiv Detail & Related papers (2021-12-13T17:34:28Z) - Robust Market Making via Adversarial Reinforcement Learning [5.482532589225552]
We show that adversarial reinforcement learning can be used to produce market marking agents robust to adversarial and adaptively-chosen market conditions.
We show that our ARL method consistently converges, and we prove for several special cases that the profiles that we converge to correspond to Nash equilibria in a simplified single-stage game.
arXiv Detail & Related papers (2020-03-03T22:40:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.