OpenBox: A Generalized Black-box Optimization Service

• URL: http://arxiv.org/abs/2106.00421v1
• Date: Tue, 1 Jun 2021 12:02:50 GMT
• Title: OpenBox: A Generalized Black-box Optimization Service
• Authors: Yang Li, Yu Shen, Wentao Zhang, Yuanwei Chen, Huaijun Jiang, Mingchao Liu, Jiawei Jiang, Jinyang Gao, Wentao Wu, Zhi Yang, Ce Zhang, Bin Cui
• Abstract summary: Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. In this paper, we build OpenBox, an open-source and general-purpose BBO service with improved usability.
• Score: 30.106879709523728
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. However, it remains a challenge for users to apply BBO methods to their problems at hand with existing software packages, in terms of applicability, performance, and efficiency. In this paper, we build OpenBox, an open-source and general-purpose BBO service with improved usability. The modular design behind OpenBox also facilitates flexible abstraction and optimization of basic BBO components that are common in other existing systems. OpenBox is distributed, fault-tolerant, and scalable. To improve efficiency, OpenBox further utilizes "algorithm agnostic" parallelization and transfer learning. Our experimental results demonstrate the effectiveness and efficiency of OpenBox compared to existing systems.

Related papers

• Black-box optimization using factorization and Ising machines [1.855858265809853]
  Black-box optimization (BBO) is used in materials design, drug discovery, and machine learning.<n>The FMQA algorithm uses a factorization machine (FM) as a surrogate model for BBO.<n>To be able to perform BBO with the FMQA algorithm immediately, we introduce the FMQA algorithm along with Python packages to run it.
  arXiv  Detail & Related papers  (2025-07-24T00:37:23Z)
• Reinforced In-Context Black-Box Optimization [64.25546325063272]
  RIBBO is a method to reinforce-learn a BBO algorithm from offline data in an end-to-end fashion. RIBBO employs expressive sequence models to learn the optimization histories produced by multiple behavior algorithms and tasks. Central to our method is to augment the optimization histories with textitregret-to-go tokens, which are designed to represent the performance of an algorithm based on cumulative regret over the future part of the histories.
  arXiv  Detail & Related papers  (2024-02-27T11:32:14Z)
• Large Language Models to Enhance Bayesian Optimization [57.474613739645605]
  We present LLAMBO, a novel approach that integrates the capabilities of Large Language Models (LLM) within Bayesian optimization. At a high level, we frame the BO problem in natural language, enabling LLMs to iteratively propose and evaluate promising solutions conditioned on historical evaluations. Our findings illustrate that LLAMBO is effective at zero-shot warmstarting, and enhances surrogate modeling and candidate sampling, especially in the early stages of search when observations are sparse.
  arXiv  Detail & Related papers  (2024-02-06T11:44:06Z)
• A General Framework for User-Guided Bayesian Optimization [51.96352579696041]
  We propose ColaBO, the first Bayesian-principled framework for prior beliefs beyond the typical kernel structure. We empirically demonstrate ColaBO's ability to substantially accelerate optimization when the prior information is accurate, and to retain approximately default performance when it is misleading.
  arXiv  Detail & Related papers  (2023-11-24T18:27:26Z)
• Optimizing with Low Budgets: a Comparison on the Black-box Optimization Benchmarking Suite and OpenAI Gym [2.511157007295545]
  Black-box optimization (BO) algorithms are popular in machine learning (ML) We compare BBO tools for ML with more classical COCOs. Some algorithms from the BBO community perform surprisingly well on ML tasks.
  arXiv  Detail & Related papers  (2023-09-29T18:33:10Z)
• NUBO: A Transparent Python Package for Bayesian Optimization [0.0]
  NUBO is a framework for optimizing black-box functions, such as physical experiments and computer simulators. It focuses on transparency and user experience to make Bayesian optimization accessible to researchers from all disciplines. NUBO is written in Python but does not require expert knowledge of Python to optimize simulators and experiments.
  arXiv  Detail & Related papers  (2023-05-11T10:34:27Z)
• OpenBox: A Python Toolkit for Generalized Black-box Optimization [50.88355903338381]
  Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. This paper presents OpenBox, an open-source BBO toolkit with improved usability. It implements user-friendly interfaces and visualization for users to define and manage their tasks.
  arXiv  Detail & Related papers  (2023-04-26T07:13:50Z)
• Black Box Optimization Using QUBO and the Cross Entropy Method [11.091089276821716]
  Black box optimization can be used to optimize functions whose analytic form is unknown. A common approach to realize BBO is to learn a surrogate model which approximates the target black box function. We present our approach BOX-QUBO, where the surrogate model is a QUBO matrix.
  arXiv  Detail & Related papers  (2022-06-24T22:57:24Z)
• Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarking [8.874754363200614]
  Existing studies in black-box optimization for machine learning suffer from low generalizability. We propose a benchmark suite, OptimSuite, which covers a broad range of black-box optimization problems. ABBO achieves competitive performance on all benchmark suites.
  arXiv  Detail & Related papers  (2020-10-08T14:17:30Z)
• Siamese Box Adaptive Network for Visual Tracking [100.46025199664642]
  We propose a simple yet effective visual tracking framework (named Siamese Box Adaptive Network, SiamBAN) SiamBAN directly classifies objects and regresses their bounding boxes in a unified convolutional network (FCN) SiamBAN achieves state-of-the-art performance and runs at 40 FPS, confirming its effectiveness and efficiency.
  arXiv  Detail & Related papers  (2020-03-15T05:58:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.