Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms

Logan Mathesen, Giulia Pedrielli, Szu Hui Ng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The field of simulation optimization has seen algorithms proposed for local optimization, drawing upon different locally convergent search methods. Similarly, there are numerous global optimization algorithms with differing strategies to achieve convergence. In this paper, we look specifically into meta-model based algorithms that stochastically drive global search through an optimal sampling criteria evaluated over a constructed meta-model of the predicted response considering the uncertainty of the response. We propose Trust Region Based Optimization with Adaptive Restart (TBOAR), a family of algorithms that dynamically restarts a trust region based search method via an optimal sampling criteria derived upon a meta-model based global search approach. Additionally, we propose a new sampling criteria to reconcile undesirable adaptive restart trajectories. This paper presents preliminary results showing the advantage of the proposed approach over the benchmark Efficient Global Optimization algorithm, focusing on a deterministic black box simulator with a d-dimensional input and a one-dimensional response.

Original languageEnglish (US)
Title of host publication2017 Winter Simulation Conference, WSC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2104-2115
Number of pages12
ISBN (Electronic)9781538634288
DOIs
StatePublished - Jan 4 2018
Event2017 Winter Simulation Conference, WSC 2017 - Las Vegas, United States
Duration: Dec 3 2017Dec 6 2017

Other

Other2017 Winter Simulation Conference, WSC 2017
CountryUnited States
CityLas Vegas
Period12/3/1712/6/17

Fingerprint

Trust Region
Restart
Stochastic Optimization
Global optimization
Metamodel
Global Optimization
Optimization Algorithm
Global Search
Search Methods
Model-based
Sampling
Simulation Optimization
Local Optimization
Black Box
Simulator
Trajectory
Benchmark
Uncertainty
Optimization
Simulators

ASJC Scopus subject areas

  • Software
  • Modeling and Simulation
  • Computer Science Applications

Cite this

Mathesen, L., Pedrielli, G., & Ng, S. H. (2018). Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms. In 2017 Winter Simulation Conference, WSC 2017 (pp. 2104-2115). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WSC.2017.8247943

Trust region based stochastic optimization with adaptive restart : A family of global optimization algorithms. / Mathesen, Logan; Pedrielli, Giulia; Ng, Szu Hui.

2017 Winter Simulation Conference, WSC 2017. Institute of Electrical and Electronics Engineers Inc., 2018. p. 2104-2115.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mathesen, L, Pedrielli, G & Ng, SH 2018, Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms. in 2017 Winter Simulation Conference, WSC 2017. Institute of Electrical and Electronics Engineers Inc., pp. 2104-2115, 2017 Winter Simulation Conference, WSC 2017, Las Vegas, United States, 12/3/17. https://doi.org/10.1109/WSC.2017.8247943
Mathesen L, Pedrielli G, Ng SH. Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms. In 2017 Winter Simulation Conference, WSC 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 2104-2115 https://doi.org/10.1109/WSC.2017.8247943
Mathesen, Logan ; Pedrielli, Giulia ; Ng, Szu Hui. / Trust region based stochastic optimization with adaptive restart : A family of global optimization algorithms. 2017 Winter Simulation Conference, WSC 2017. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 2104-2115
@inproceedings{e1949148d2024d55bd1783a31dcad22c,
title = "Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms",
abstract = "The field of simulation optimization has seen algorithms proposed for local optimization, drawing upon different locally convergent search methods. Similarly, there are numerous global optimization algorithms with differing strategies to achieve convergence. In this paper, we look specifically into meta-model based algorithms that stochastically drive global search through an optimal sampling criteria evaluated over a constructed meta-model of the predicted response considering the uncertainty of the response. We propose Trust Region Based Optimization with Adaptive Restart (TBOAR), a family of algorithms that dynamically restarts a trust region based search method via an optimal sampling criteria derived upon a meta-model based global search approach. Additionally, we propose a new sampling criteria to reconcile undesirable adaptive restart trajectories. This paper presents preliminary results showing the advantage of the proposed approach over the benchmark Efficient Global Optimization algorithm, focusing on a deterministic black box simulator with a d-dimensional input and a one-dimensional response.",
author = "Logan Mathesen and Giulia Pedrielli and Ng, {Szu Hui}",
year = "2018",
month = "1",
day = "4",
doi = "10.1109/WSC.2017.8247943",
language = "English (US)",
pages = "2104--2115",
booktitle = "2017 Winter Simulation Conference, WSC 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Trust region based stochastic optimization with adaptive restart

T2 - A family of global optimization algorithms

AU - Mathesen, Logan

AU - Pedrielli, Giulia

AU - Ng, Szu Hui

PY - 2018/1/4

Y1 - 2018/1/4

N2 - The field of simulation optimization has seen algorithms proposed for local optimization, drawing upon different locally convergent search methods. Similarly, there are numerous global optimization algorithms with differing strategies to achieve convergence. In this paper, we look specifically into meta-model based algorithms that stochastically drive global search through an optimal sampling criteria evaluated over a constructed meta-model of the predicted response considering the uncertainty of the response. We propose Trust Region Based Optimization with Adaptive Restart (TBOAR), a family of algorithms that dynamically restarts a trust region based search method via an optimal sampling criteria derived upon a meta-model based global search approach. Additionally, we propose a new sampling criteria to reconcile undesirable adaptive restart trajectories. This paper presents preliminary results showing the advantage of the proposed approach over the benchmark Efficient Global Optimization algorithm, focusing on a deterministic black box simulator with a d-dimensional input and a one-dimensional response.

AB - The field of simulation optimization has seen algorithms proposed for local optimization, drawing upon different locally convergent search methods. Similarly, there are numerous global optimization algorithms with differing strategies to achieve convergence. In this paper, we look specifically into meta-model based algorithms that stochastically drive global search through an optimal sampling criteria evaluated over a constructed meta-model of the predicted response considering the uncertainty of the response. We propose Trust Region Based Optimization with Adaptive Restart (TBOAR), a family of algorithms that dynamically restarts a trust region based search method via an optimal sampling criteria derived upon a meta-model based global search approach. Additionally, we propose a new sampling criteria to reconcile undesirable adaptive restart trajectories. This paper presents preliminary results showing the advantage of the proposed approach over the benchmark Efficient Global Optimization algorithm, focusing on a deterministic black box simulator with a d-dimensional input and a one-dimensional response.

UR - http://www.scopus.com/inward/record.url?scp=85044543235&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85044543235&partnerID=8YFLogxK

U2 - 10.1109/WSC.2017.8247943

DO - 10.1109/WSC.2017.8247943

M3 - Conference contribution

AN - SCOPUS:85044543235

SP - 2104

EP - 2115

BT - 2017 Winter Simulation Conference, WSC 2017

PB - Institute of Electrical and Electronics Engineers Inc.

ER -