Constrained optimization in simulation: efficient global optimization and Karush-Kuhn-Tucker conditions

Creative Commons License

Kleijnen J. P. C., Angün M. E., Van Nieuwenhuyse I., Van Beers W. C. M.

Journal of Global Optimization, 2024 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1007/s10898-024-01448-3
  • Dergi Adı: Journal of Global Optimization
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, IBZ Online, ABI/INFORM, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, MathSciNet, zbMATH, Civil Engineering Abstracts
  • Anahtar Kelimeler: Bayesian optimization, Efficient global optimization, Gaussian process, Karush-Kuhn-Tucker conditions, Kriging, Machine learning
  • Galatasaray Üniversitesi Adresli: Evet

Özet

We develop a novel methodology for solving constrained optimization problems in deterministic simulation. In these problems, the goal (or objective) output is to be minimized, subject to one or more constraints for the other outputs and for the inputs. Our methododology combines the“Karush-Kuhn-Tucker”(KKT) conditions with“efficient global optimization”(EGO).These KKT conditions are well-known first-order necessary optimality conditions in white-box mathematical optimization, but our method is the first EGO method that uses these conditions. EGO is a popular type of algorithm that is closely related to“Bayesian optimization” and“active machine learning”, as they all use Gaussian processes or Kriging to approximate the input/output behavior of black-box models. We numerically compare the performance of our KKT-EGO algorithm and two alternative EGO algorithms, in several popular examples. In some examples our algorithm converges faster to the true optimum, so our algorithm may provide a suitable alternative.