Collaborative Contextual Bayesian Optimization

• URL: http://arxiv.org/abs/2604.18912v1
• Date: Mon, 20 Apr 2026 23:28:22 GMT
• Title: Collaborative Contextual Bayesian Optimization
• Abstract summary: Contextual Bayesian Optimization (CBO) aims to approximate an entire mapping from the context space to its corresponding optimal design.<n>CBO is more challenging as it must approximate an entire mapping from the context space to its corresponding optimal design.<n>We propose CCBO, a unified framework enabling multiple clients to jointly perform CBO with controllable contexts.
• Score: 8.326135672859204
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Discovering optimal designs through sequential data collection is essential in many real-world applications. While Bayesian Optimization (BO) has achieved remarkable success in this setting, growing attention has recently turned to context-specific optimal design, formalized as Contextual Bayesian Optimization (CBO). Unlike BO, CBO is inherently more challenging as it must approximate an entire mapping from the context space to its corresponding optimal design, requiring simultaneous exploration across contexts and exploitation within each. In many modern applications, such tasks arise across multiple potentially heterogeneous but related clients, where collaboration can significantly improve learning efficiency. We propose CCBO, Collaborative Contextual Bayesian Optimization, a unified framework enabling multiple clients to jointly perform CBO with controllable contexts, supporting both online collaboration and offline initialization from peers' historical beliefs, with an optional privacy-preserving communication mechanism. We establish sublinear regret guarantees and demonstrate, through extensive simulations and a real-world hot rolling application, that CCBO achieves substantial improvements over existing approaches even under client heterogeneity. The code to reproduce the results can be found at https://github.com/cchihyu/Collaborative-Contextual-Bayesian-Optimization

Related papers

• ARCO-BO: Adaptive Resource-aware COllaborative Bayesian Optimization for Heterogeneous Multi-Agent Design [17.623641273672337]
  We introduce Adaptive Resource Aware Collaborative Bayesian Optimization (ARCO-BO)<n>ARCO-BO explicitly accounts for heterogeneity in multi-agent optimization.<n>Experiments on synthetic and high-dimensional engineering problems show that ARCO-BO consistently outperforms independent BO.
  arXiv  Detail & Related papers  (2025-10-18T22:06:10Z)
• Collaborative Bayesian Optimization via Wasserstein Barycenters [11.41081495236219]
  We introduce a collaborative Bayesian optimization (BO) framework that addresses black-box optimization and data privacy challenges.<n>In this framework agents work collaboratively to optimize a function they only have oracle access to.<n>We prove that our proposed algorithm is numerically consistent and that its implementation via Monte Carlo methods is accurate.
  arXiv  Detail & Related papers  (2025-04-15T00:15:09Z)
• Offline Learning for Combinatorial Multi-armed Bandits [56.96242764723241]
  Off-CMAB is the first offline learning framework for CMAB.<n>Off-CMAB combines pessimistic reward estimations with solvers.<n>Experiments on synthetic and real-world datasets highlight the superior performance of CLCB.
  arXiv  Detail & Related papers  (2025-01-31T16:56:18Z)
• Client-Centric Federated Adaptive Optimization [78.30827455292827]
  Federated Learning (FL) is a distributed learning paradigm where clients collaboratively train a model while keeping their own data private.<n>We propose Federated-Centric Adaptive Optimization, which is a class of novel federated optimization approaches.
  arXiv  Detail & Related papers  (2025-01-17T04:00:50Z)
• CoBo: Collaborative Learning via Bilevel Optimization [36.8801794168583]
  Collaborative learning is an important tool to train multiple clients more effectively by enabling communication among clients. In this paper, we model client-selection and model-training as two interconnected optimization problems. We introduce CoBo, a scalable and elastic, SGD-type alternating optimization algorithm that efficiently addresses these problem with theoretical convergence guarantees.
  arXiv  Detail & Related papers  (2024-09-09T11:59:42Z)
• Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation [55.75188191403343]
  We introduce utility, which is a function predefined by each user and describes the trade-off between cost and performance of BO. We validate our algorithm on various LC datasets and found it outperform all the previous multi-fidelity BO and transfer-BO baselines we consider.
  arXiv  Detail & Related papers  (2024-05-28T07:38:39Z)
• Reinforced In-Context Black-Box Optimization [64.25546325063272]
  RIBBO is a method to reinforce-learn a BBO algorithm from offline data in an end-to-end fashion. RIBBO employs expressive sequence models to learn the optimization histories produced by multiple behavior algorithms and tasks. Central to our method is to augment the optimization histories with textitregret-to-go tokens, which are designed to represent the performance of an algorithm based on cumulative regret over the future part of the histories.
  arXiv  Detail & Related papers  (2024-02-27T11:32:14Z)
• Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties [49.351577714596544]
  We propose a human-AI collaborative Bayesian framework to incorporate expert preferences about unmeasured abstract properties into surrogate modeling. We provide an efficient strategy that can also handle any incorrect/misleading expert bias in preferential judgments.
  arXiv  Detail & Related papers  (2024-02-27T09:23:13Z)
• Collaborative and Distributed Bayesian Optimization via Consensus: Showcasing the Power of Collaboration for Optimal Design [7.066023612489374]
  We propose a new collaborative paradigm for Bayesian optimization. Our approach provides a generic and flexible framework that can incorporate different collaboration mechanisms. We show that our framework can effectively accelerate and improve the optimal design process and benefit all participants.
  arXiv  Detail & Related papers  (2023-06-25T21:43:05Z)
• Personalizing Federated Learning with Over-the-Air Computations [84.8089761800994]
  Federated edge learning is a promising technology to deploy intelligence at the edge of wireless networks in a privacy-preserving manner. Under such a setting, multiple clients collaboratively train a global generic model under the coordination of an edge server. This paper presents a distributed training paradigm that employs analog over-the-air computation to address the communication bottleneck.
  arXiv  Detail & Related papers  (2023-02-24T08:41:19Z)
• Multi-Fidelity Bayesian Optimization via Deep Neural Networks [19.699020509495437]
  In many applications, the objective function can be evaluated at multiple fidelities to enable a trade-off between the cost and accuracy. We propose Deep Neural Network Multi-Fidelity Bayesian Optimization (DNN-MFBO) that can flexibly capture all kinds of complicated relationships between the fidelities. We show the advantages of our method in both synthetic benchmark datasets and real-world applications in engineering design.
  arXiv  Detail & Related papers  (2020-07-06T23:28:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.