A sequential neighbor exploratory experimental design method for complex simulation metamodeling

Yonglin Lei, Wei Dong, Zhi Zhu, Hessam Sarjoughian

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

Original languageEnglish (US)
Title of host publication2019 Spring Simulation Conference, SpringSim 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781510883888
DOIs
StatePublished - Apr 1 2019
Event2019 Spring Simulation Conference, SpringSim 2019 - Tucson, United States
Duration: Apr 29 2019May 2 2019

Publication series

Name2019 Spring Simulation Conference, SpringSim 2019

Conference

Conference2019 Spring Simulation Conference, SpringSim 2019
CountryUnited States
CityTucson
Period4/29/195/2/19

Fingerprint

Metamodeling
Experimental design
Design of experiments
Design Method
Latin Hypercube
Simulation
Support Vector Regression
Domain Knowledge
Metamodel
Count
Simulation Model
Regression
Scenarios
Resources
Computing
Experiment
Experiments
Training

Keywords

  • K-d tree
  • Latin Hypercube
  • Neighbor exploratory
  • Sequential experimental design
  • Simulation metamodel

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Control and Optimization
  • Modeling and Simulation

Cite this

Lei, Y., Dong, W., Zhu, Z., & Sarjoughian, H. (2019). A sequential neighbor exploratory experimental design method for complex simulation metamodeling. In 2019 Spring Simulation Conference, SpringSim 2019 [8732886] (2019 Spring Simulation Conference, SpringSim 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SpringSim.2019.8732886

A sequential neighbor exploratory experimental design method for complex simulation metamodeling. / Lei, Yonglin; Dong, Wei; Zhu, Zhi; Sarjoughian, Hessam.

2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8732886 (2019 Spring Simulation Conference, SpringSim 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lei, Y, Dong, W, Zhu, Z & Sarjoughian, H 2019, A sequential neighbor exploratory experimental design method for complex simulation metamodeling. in 2019 Spring Simulation Conference, SpringSim 2019., 8732886, 2019 Spring Simulation Conference, SpringSim 2019, Institute of Electrical and Electronics Engineers Inc., 2019 Spring Simulation Conference, SpringSim 2019, Tucson, United States, 4/29/19. https://doi.org/10.23919/SpringSim.2019.8732886
Lei Y, Dong W, Zhu Z, Sarjoughian H. A sequential neighbor exploratory experimental design method for complex simulation metamodeling. In 2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8732886. (2019 Spring Simulation Conference, SpringSim 2019). https://doi.org/10.23919/SpringSim.2019.8732886
Lei, Yonglin ; Dong, Wei ; Zhu, Zhi ; Sarjoughian, Hessam. / A sequential neighbor exploratory experimental design method for complex simulation metamodeling. 2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 Spring Simulation Conference, SpringSim 2019).
@inproceedings{11b641337fc540f8bc83c0bf2e709150,
title = "A sequential neighbor exploratory experimental design method for complex simulation metamodeling",
abstract = "Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.",
keywords = "K-d tree, Latin Hypercube, Neighbor exploratory, Sequential experimental design, Simulation metamodel",
author = "Yonglin Lei and Wei Dong and Zhi Zhu and Hessam Sarjoughian",
year = "2019",
month = "4",
day = "1",
doi = "10.23919/SpringSim.2019.8732886",
language = "English (US)",
series = "2019 Spring Simulation Conference, SpringSim 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 Spring Simulation Conference, SpringSim 2019",

}

TY - GEN

T1 - A sequential neighbor exploratory experimental design method for complex simulation metamodeling

AU - Lei, Yonglin

AU - Dong, Wei

AU - Zhu, Zhi

AU - Sarjoughian, Hessam

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

AB - Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

KW - K-d tree

KW - Latin Hypercube

KW - Neighbor exploratory

KW - Sequential experimental design

KW - Simulation metamodel

UR - http://www.scopus.com/inward/record.url?scp=85068595975&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068595975&partnerID=8YFLogxK

U2 - 10.23919/SpringSim.2019.8732886

DO - 10.23919/SpringSim.2019.8732886

M3 - Conference contribution

T3 - 2019 Spring Simulation Conference, SpringSim 2019

BT - 2019 Spring Simulation Conference, SpringSim 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -