TY - GEN
T1 - Stochastic voting algorithms for web services group testing
AU - Tsai, W. T.
AU - Zhang, Dawei
AU - Paul, Raymond
AU - Chen, Yinong
PY - 2005
Y1 - 2005
N2 - This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.
AB - This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.
KW - Clustering
KW - Simulated annealing
KW - Voting
KW - Web services testing
UR - http://www.scopus.com/inward/record.url?scp=33947380241&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33947380241&partnerID=8YFLogxK
U2 - 10.1109/QSIC.2005.58
DO - 10.1109/QSIC.2005.58
M3 - Conference contribution
AN - SCOPUS:33947380241
SN - 0769524729
SN - 9780769524726
T3 - Proceedings - International Conference on Quality Software
SP - 99
EP - 106
BT - Proceedings - Fifth International Conference on Quality Software, QSIC 2005
T2 - 5th International Conference on Quality Software, QSIC 2005
Y2 - 19 September 2005 through 20 September 2005
ER -