TY - GEN
T1 - Coverage, Location, Detection, and Measurement
AU - Colbourn, Charles
AU - Syrotiuk, Violet
N1 - Funding Information:
This material is based in part upon work supported by the National Science Foundation under Grant No. 1421058.
Publisher Copyright:
© 2016 IEEE.
Copyright:
Copyright 2017 Elsevier B.V., All rights reserved.
PY - 2016/8/1
Y1 - 2016/8/1
N2 - Complex engineered systems arise throughout computing, communications, and networking. Many factors, each having a finite number of levels, impact the behaviour of the system either singly or in interaction with one another. Testing or evaluating such a system involves formulating a set of tests, when executed, responses or outcomes from the tests are analyzed. A single round of testing is conducted. To witness the effect of an interaction, some test must cover it, this does not suffice in general to locate the interaction or to measure its effect. When there are few factors or many tests, experimental designs can measure (and hence locate) the interactions. When there are many factors and few tests, can we locate the interaction(s)? Can we efficiently detect them? Combinatorial arrays, locating and detecting arrays, are introduced to address such location and detection in the context of combinatorial testing. Locating and detecting arrays are contrasted with covering arrays and with experimental designs. An application to a 75 factor protocol stack for file transfer is given to demonstrate their practical use. Finally, their place in the literature of combinatorial testing is discussed and some directions are outlined.
AB - Complex engineered systems arise throughout computing, communications, and networking. Many factors, each having a finite number of levels, impact the behaviour of the system either singly or in interaction with one another. Testing or evaluating such a system involves formulating a set of tests, when executed, responses or outcomes from the tests are analyzed. A single round of testing is conducted. To witness the effect of an interaction, some test must cover it, this does not suffice in general to locate the interaction or to measure its effect. When there are few factors or many tests, experimental designs can measure (and hence locate) the interactions. When there are many factors and few tests, can we locate the interaction(s)? Can we efficiently detect them? Combinatorial arrays, locating and detecting arrays, are introduced to address such location and detection in the context of combinatorial testing. Locating and detecting arrays are contrasted with covering arrays and with experimental designs. An application to a 75 factor protocol stack for file transfer is given to demonstrate their practical use. Finally, their place in the literature of combinatorial testing is discussed and some directions are outlined.
KW - covering array
KW - detecting array
KW - experimental design
KW - locating array
UR - http://www.scopus.com/inward/record.url?scp=84992183966&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84992183966&partnerID=8YFLogxK
U2 - 10.1109/ICSTW.2016.38
DO - 10.1109/ICSTW.2016.38
M3 - Conference contribution
AN - SCOPUS:84992183966
T3 - Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016
SP - 19
EP - 25
BT - Proceedings - 2016 IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 9th IEEE International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2016
Y2 - 10 April 2016 through 15 April 2016
ER -