Statistics · stat.ML
The Parallel Knowledge Gradient Method for Batch Bayesian Optimization
See on the mapAbstract
In many applications of black-box optimization, one can evaluate multiple points simultaneously, e.g. when evaluating the performances of several different neural network architectures in a parallel computing environment. In this paper, we develop a novel batch Bayesian optimization algorithm --- the parallel knowledge gradient method. By construction, this method provides the one-step Bayes-optimal batch of points to sample. We provide an efficient strategy for computing this Bayes-optimal batch of points, and we demonstrate that the parallel knowledge gradient method finds global optima significantly faster than previous batch Bayesian optimization algorithms on both synthetic test functions and when tuning hyperparameters of practical machine learning algorithms, especially when function evaluations are noisy.
References
The reference list for this paper has not been collected yet.
Cited by 3
3 papers in the index cite this (Semantic Scholar counts 254 in total).
The cited-by list is still filling in while reference lists are collected.