A sequential neighbor exploratory experimental design method for complex simulation metamodeling

Yonglin Lei, Wei Dong, Zhi Zhu, Hessam Sarjoughian

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

Original languageEnglish (US)
Title of host publicationSimulation Series
PublisherThe Society for Modeling and Simulation International
Edition2
ISBN (Electronic)9781510892521, 9781510892538, 9781510892545, 9781510892552, 9781510892569
DOIs
StatePublished - Jan 1 2019
Event2019 Theory of Modeling and Simulation, TMS 2019, Part of the 2019 Spring Simulation Multi-Conference, SpringSim 2019 - Tucson, United States
Duration: Apr 29 2019May 2 2019

Publication series

NameSimulation Series
Number2
Volume51
ISSN (Print)0735-9276

Conference

Conference2019 Theory of Modeling and Simulation, TMS 2019, Part of the 2019 Spring Simulation Multi-Conference, SpringSim 2019
CountryUnited States
CityTucson
Period4/29/195/2/19

Fingerprint

Design of experiments
Experiments

Keywords

  • K-d tree
  • Latin hypercube
  • Neighbor exploratory
  • Sequential experimental design
  • Simulation metamodel

ASJC Scopus subject areas

  • Computer Networks and Communications

Cite this

Lei, Y., Dong, W., Zhu, Z., & Sarjoughian, H. (2019). A sequential neighbor exploratory experimental design method for complex simulation metamodeling. In Simulation Series (2 ed.). (Simulation Series; Vol. 51, No. 2). The Society for Modeling and Simulation International. https://doi.org/10.23919/SpringSim.2019.8732886

A sequential neighbor exploratory experimental design method for complex simulation metamodeling. / Lei, Yonglin; Dong, Wei; Zhu, Zhi; Sarjoughian, Hessam.

Simulation Series. 2. ed. The Society for Modeling and Simulation International, 2019. (Simulation Series; Vol. 51, No. 2).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Lei, Y, Dong, W, Zhu, Z & Sarjoughian, H 2019, A sequential neighbor exploratory experimental design method for complex simulation metamodeling. in Simulation Series. 2 edn, Simulation Series, no. 2, vol. 51, The Society for Modeling and Simulation International, 2019 Theory of Modeling and Simulation, TMS 2019, Part of the 2019 Spring Simulation Multi-Conference, SpringSim 2019, Tucson, United States, 4/29/19. https://doi.org/10.23919/SpringSim.2019.8732886
Lei Y, Dong W, Zhu Z, Sarjoughian H. A sequential neighbor exploratory experimental design method for complex simulation metamodeling. In Simulation Series. 2 ed. The Society for Modeling and Simulation International. 2019. (Simulation Series; 2). https://doi.org/10.23919/SpringSim.2019.8732886
Lei, Yonglin ; Dong, Wei ; Zhu, Zhi ; Sarjoughian, Hessam. / A sequential neighbor exploratory experimental design method for complex simulation metamodeling. Simulation Series. 2. ed. The Society for Modeling and Simulation International, 2019. (Simulation Series; 2).
@inproceedings{761bddd6519846088a868a5b479e5197,
title = "A sequential neighbor exploratory experimental design method for complex simulation metamodeling",
abstract = "Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.",
keywords = "K-d tree, Latin hypercube, Neighbor exploratory, Sequential experimental design, Simulation metamodel",
author = "Yonglin Lei and Wei Dong and Zhi Zhu and Hessam Sarjoughian",
year = "2019",
month = "1",
day = "1",
doi = "10.23919/SpringSim.2019.8732886",
language = "English (US)",
series = "Simulation Series",
publisher = "The Society for Modeling and Simulation International",
number = "2",
booktitle = "Simulation Series",
edition = "2",

}

TY - GEN

T1 - A sequential neighbor exploratory experimental design method for complex simulation metamodeling

AU - Lei, Yonglin

AU - Dong, Wei

AU - Zhu, Zhi

AU - Sarjoughian, Hessam

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

AB - Since complex simulation contains many factors and responses that interact in a nonlinear manner, it is important to use metamodeling for representing the causal relationships within the simulation models in a compact way. With the selected mathematical structure, the effectiveness of metamodeling depends on the comprehensiveness of the training data that is closely related to the size of the scenario space and available computing resources. Generally, sequential experimental design methods are more efficient than one-shot ones, but the later depend on the domain knowledge of the experimenters and are uneasy to be conducted automatically. This paper proposes a sequential neighbor exploratory experimental design (SNEED) method for metamodeling purpose. Through the peaks function example, we compare this new method to Latin hypercube with a support vector regression metamodel trained by their training data respectively. The result shows that under the same experiment sample count, the SNEED method produces better regression performance.

KW - K-d tree

KW - Latin hypercube

KW - Neighbor exploratory

KW - Sequential experimental design

KW - Simulation metamodel

UR - http://www.scopus.com/inward/record.url?scp=85073698474&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073698474&partnerID=8YFLogxK

U2 - 10.23919/SpringSim.2019.8732886

DO - 10.23919/SpringSim.2019.8732886

M3 - Conference contribution

AN - SCOPUS:85068595975

T3 - Simulation Series

BT - Simulation Series

PB - The Society for Modeling and Simulation International

ER -