Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1164 docs add source of logei formula #1188

Merged
merged 3 commits into from
Jan 13, 2025
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 14 additions & 1 deletion smac/acquisition/function/expected_improvement.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,11 +17,24 @@


class EI(AbstractAcquisitionFunction):
r"""Expected Improvement (with or without function values in log space) acquisition function
r"""The Expected Improvement (EI) criterion is used to decide where to evaluate a function f(x) next. The goal is to
balance exploration and exploitation. Expected Improvement (with or without function values in log space)
acquisition function

:math:`EI(X) := \mathbb{E}\left[ \max\{0, f(\mathbf{X^+}) - f_{t+1}(\mathbf{X}) - \xi \} \right]`,
with :math:`f(X^+)` as the best location.

Reference for EI: Jones, D.R. and Schonlau, M. and Welch, W.J. (1998). Efficient Global Optimization of Expensive
Black-Box Functions. Journal of Global Optimization 13, 455–492

Reference for logEI: Hutter, F. and Hoos, H. and Leyton-Brown, K. and Murphy, K. (2009). An experimental
investigation of model-based parameter optimisation: SPO and beyond. In: Conference on Genetic and
Evolutionary Computation

The logEI implemententation is based on the derivation of the orginal equation by:
Watanabe, S. (2024). Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on
Log-Transformed Objective. https://arxiv.org/abs/2411.18095

Parameters
----------
xi : float, defaults to 0.0
Expand Down
Loading