Towards Portfolios of Streamlined Constraint Models: A Case Study with
the Balanced Academic Curriculum Problem
- URL: http://arxiv.org/abs/2009.10152v1
- Date: Mon, 21 Sep 2020 19:48:02 GMT
- Title: Towards Portfolios of Streamlined Constraint Models: A Case Study with
the Balanced Academic Curriculum Problem
- Authors: Patrick Spracklen, Nguyen Dang, \"Ozg\"ur Akg\"un, Ian Miguel
- Abstract summary: We focus on the automatic addition of streamliner constraints, derived from the types present in an abstract Essence specification of a problem class of interest.
The refinement of streamlined Essence specifications into constraint models gives rise to a large number of modelling choices.
Various forms of racing are utilised to constrain the computational cost of training.
- Score: 1.8466814193413488
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Augmenting a base constraint model with additional constraints can strengthen
the inferences made by a solver and therefore reduce search effort. We focus on
the automatic addition of streamliner constraints, derived from the types
present in an abstract Essence specification of a problem class of interest,
which trade completeness for potentially very significant reduction in search.
The refinement of streamlined Essence specifications into constraint models
suitable for input to constraint solvers gives rise to a large number of
modelling choices in addition to those required for the base Essence
specification. Previous automated streamlining approaches have been limited in
evaluating only a single default model for each streamlined specification. In
this paper we explore the effect of model selection in the context of
streamlined specifications. We propose a new best-first search method that
generates a portfolio of Pareto Optimal streamliner-model combinations by
evaluating for each streamliner a portfolio of models to search and explore the
variability in performance and find the optimal model. Various forms of racing
are utilised to constrain the computational cost of training.
Related papers
- Athanor: Local Search over Abstract Constraint Specifications [2.3383199519492455]
We focus on general-purpose local search solvers that accept as input a constraint model.
The Athanor solver we describe herein differs in that it begins from a specification of a problem in the abstract constraint specification language Essence.
arXiv Detail & Related papers (2024-10-08T11:41:38Z) - FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction [26.26211464623954]
Federated Importance-Aware Submodel Extraction (FIARSE) is a novel approach that dynamically adjusts submodels based on the importance of model parameters.
Compared to existing works, the proposed method offers a theoretical foundation for the submodel extraction.
Extensive experiments are conducted on various datasets to showcase the superior performance of the proposed FIARSE.
arXiv Detail & Related papers (2024-07-28T04:10:11Z) - Oracle Inequalities for Model Selection in Offline Reinforcement
Learning [105.74139523696284]
We study the problem of model selection in offline RL with value function approximation.
We propose the first model selection algorithm for offline RL that achieves minimax rate-optimal inequalities up to logarithmic factors.
We conclude with several numerical simulations showing it is capable of reliably selecting a good model class.
arXiv Detail & Related papers (2022-11-03T17:32:34Z) - When to Update Your Model: Constrained Model-based Reinforcement
Learning [50.74369835934703]
We propose a novel and general theoretical scheme for a non-decreasing performance guarantee of model-based RL (MBRL)
Our follow-up derived bounds reveal the relationship between model shifts and performance improvement.
A further example demonstrates that learning models from a dynamically-varying number of explorations benefit the eventual returns.
arXiv Detail & Related papers (2022-10-15T17:57:43Z) - A Nested Weighted Tchebycheff Multi-Objective Bayesian Optimization
Approach for Flexibility of Unknown Utopia Estimation in Expensive Black-box
Design Problems [0.0]
In existing work, a weighted Tchebycheff MOBO approach has been demonstrated which attempts to estimate the unknown utopia in formulating acquisition function.
We propose a nested weighted Tchebycheff MOBO framework where we build a regression model selection procedure from an ensemble of models.
arXiv Detail & Related papers (2021-10-16T00:44:06Z) - Data Summarization via Bilevel Optimization [48.89977988203108]
A simple yet powerful approach is to operate on small subsets of data.
In this work, we propose a generic coreset framework that formulates the coreset selection as a cardinality-constrained bilevel optimization problem.
arXiv Detail & Related papers (2021-09-26T09:08:38Z) - Sufficiently Accurate Model Learning for Planning [119.80502738709937]
This paper introduces the constrained Sufficiently Accurate model learning approach.
It provides examples of such problems, and presents a theorem on how close some approximate solutions can be.
The approximate solution quality will depend on the function parameterization, loss and constraint function smoothness, and the number of samples in model learning.
arXiv Detail & Related papers (2021-02-11T16:27:31Z) - Control as Hybrid Inference [62.997667081978825]
We present an implementation of CHI which naturally mediates the balance between iterative and amortised inference.
We verify the scalability of our algorithm on a continuous control benchmark, demonstrating that it outperforms strong model-free and model-based baselines.
arXiv Detail & Related papers (2020-07-11T19:44:09Z) - Model Reuse with Reduced Kernel Mean Embedding Specification [70.044322798187]
We present a two-phase framework for finding helpful models for a current application.
In the upload phase, when a model is uploading into the pool, we construct a reduced kernel mean embedding (RKME) as a specification for the model.
Then in the deployment phase, the relatedness of the current task and pre-trained models will be measured based on the value of the RKME specification.
arXiv Detail & Related papers (2020-01-20T15:15:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.