Robustness of recovery in locating array-based screening experiments

Stephen A. Seidel, Charles Colbourn, Violet Syrotiuk

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Locating arrays (LAs) are experimental designs for screening interactions in engineered systems. LAs are often highly unbalanced, requiring advanced techniques to recover the terms that significantly influence system performance. While perfect recovery is achieved in the absence of noise, real systems are noisy. Therefore, in this paper, we study the robustness of recovery in the presence of noise. Using known models to generate synthetic data, we investigate recovery accuracy as a function of noise. Separation is introduced into LAs to allow more coverage for each t-way interaction; when separation is higher, recovery in noisy scenarios should improve. We find that locating arrays are able to recover the influential terms even with high levels of noise and that separation appears to improve recovery. Under the pessimistic assumption that noise depends on the range of responses, it is no surprise that terms with small coefficients become indistinguishable from noise.

Original languageEnglish (US)
Title of host publication2019 Spring Simulation Conference, SpringSim 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781510883888
DOIs
StatePublished - Apr 1 2019
Event2019 Spring Simulation Conference, SpringSim 2019 - Tucson, United States
Duration: Apr 29 2019May 2 2019

Publication series

Name2019 Spring Simulation Conference, SpringSim 2019

Conference

Conference2019 Spring Simulation Conference, SpringSim 2019
CountryUnited States
CityTucson
Period4/29/195/2/19

Fingerprint

Screening Experiment
Screening
Recovery
Robustness
Experiments
Term
Synthetic Data
Experimental design
Interaction
Design of experiments
System Performance
Coverage
Scenarios
Coefficient
Range of data

Keywords

  • Analysis
  • Locating arrays
  • Recover
  • Robustness
  • Screening engineered networks

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Control and Optimization
  • Modeling and Simulation

Cite this

Seidel, S. A., Colbourn, C., & Syrotiuk, V. (2019). Robustness of recovery in locating array-based screening experiments. In 2019 Spring Simulation Conference, SpringSim 2019 [8732911] (2019 Spring Simulation Conference, SpringSim 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SpringSim.2019.8732911

Robustness of recovery in locating array-based screening experiments. / Seidel, Stephen A.; Colbourn, Charles; Syrotiuk, Violet.

2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8732911 (2019 Spring Simulation Conference, SpringSim 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Seidel, SA, Colbourn, C & Syrotiuk, V 2019, Robustness of recovery in locating array-based screening experiments. in 2019 Spring Simulation Conference, SpringSim 2019., 8732911, 2019 Spring Simulation Conference, SpringSim 2019, Institute of Electrical and Electronics Engineers Inc., 2019 Spring Simulation Conference, SpringSim 2019, Tucson, United States, 4/29/19. https://doi.org/10.23919/SpringSim.2019.8732911
Seidel SA, Colbourn C, Syrotiuk V. Robustness of recovery in locating array-based screening experiments. In 2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8732911. (2019 Spring Simulation Conference, SpringSim 2019). https://doi.org/10.23919/SpringSim.2019.8732911
Seidel, Stephen A. ; Colbourn, Charles ; Syrotiuk, Violet. / Robustness of recovery in locating array-based screening experiments. 2019 Spring Simulation Conference, SpringSim 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 Spring Simulation Conference, SpringSim 2019).
@inproceedings{7b3c851ff5b44b5b8aef5aaa46c5b848,
title = "Robustness of recovery in locating array-based screening experiments",
abstract = "Locating arrays (LAs) are experimental designs for screening interactions in engineered systems. LAs are often highly unbalanced, requiring advanced techniques to recover the terms that significantly influence system performance. While perfect recovery is achieved in the absence of noise, real systems are noisy. Therefore, in this paper, we study the robustness of recovery in the presence of noise. Using known models to generate synthetic data, we investigate recovery accuracy as a function of noise. Separation is introduced into LAs to allow more coverage for each t-way interaction; when separation is higher, recovery in noisy scenarios should improve. We find that locating arrays are able to recover the influential terms even with high levels of noise and that separation appears to improve recovery. Under the pessimistic assumption that noise depends on the range of responses, it is no surprise that terms with small coefficients become indistinguishable from noise.",
keywords = "Analysis, Locating arrays, Recover, Robustness, Screening engineered networks",
author = "Seidel, {Stephen A.} and Charles Colbourn and Violet Syrotiuk",
year = "2019",
month = "4",
day = "1",
doi = "10.23919/SpringSim.2019.8732911",
language = "English (US)",
series = "2019 Spring Simulation Conference, SpringSim 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 Spring Simulation Conference, SpringSim 2019",

}

TY - GEN

T1 - Robustness of recovery in locating array-based screening experiments

AU - Seidel, Stephen A.

AU - Colbourn, Charles

AU - Syrotiuk, Violet

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Locating arrays (LAs) are experimental designs for screening interactions in engineered systems. LAs are often highly unbalanced, requiring advanced techniques to recover the terms that significantly influence system performance. While perfect recovery is achieved in the absence of noise, real systems are noisy. Therefore, in this paper, we study the robustness of recovery in the presence of noise. Using known models to generate synthetic data, we investigate recovery accuracy as a function of noise. Separation is introduced into LAs to allow more coverage for each t-way interaction; when separation is higher, recovery in noisy scenarios should improve. We find that locating arrays are able to recover the influential terms even with high levels of noise and that separation appears to improve recovery. Under the pessimistic assumption that noise depends on the range of responses, it is no surprise that terms with small coefficients become indistinguishable from noise.

AB - Locating arrays (LAs) are experimental designs for screening interactions in engineered systems. LAs are often highly unbalanced, requiring advanced techniques to recover the terms that significantly influence system performance. While perfect recovery is achieved in the absence of noise, real systems are noisy. Therefore, in this paper, we study the robustness of recovery in the presence of noise. Using known models to generate synthetic data, we investigate recovery accuracy as a function of noise. Separation is introduced into LAs to allow more coverage for each t-way interaction; when separation is higher, recovery in noisy scenarios should improve. We find that locating arrays are able to recover the influential terms even with high levels of noise and that separation appears to improve recovery. Under the pessimistic assumption that noise depends on the range of responses, it is no surprise that terms with small coefficients become indistinguishable from noise.

KW - Analysis

KW - Locating arrays

KW - Recover

KW - Robustness

KW - Screening engineered networks

UR - http://www.scopus.com/inward/record.url?scp=85068602479&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068602479&partnerID=8YFLogxK

U2 - 10.23919/SpringSim.2019.8732911

DO - 10.23919/SpringSim.2019.8732911

M3 - Conference contribution

T3 - 2019 Spring Simulation Conference, SpringSim 2019

BT - 2019 Spring Simulation Conference, SpringSim 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -