Stochastic voting algorithms for web services group testing

W. T. Tsai, Dawei Zhang, Raymond Paul, Yinong Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.

Original languageEnglish (US)
Title of host publicationProceedings - International Conference on Quality Software
Pages99-106
Number of pages8
Volume2005
DOIs
StatePublished - 2005
Event5th International Conference on Quality Software, QSIC 2005 - Melbourne, Australia
Duration: Sep 19 2005Sep 20 2005

Other

Other5th International Conference on Quality Software, QSIC 2005
CountryAustralia
CityMelbourne
Period9/19/059/20/05

Fingerprint

Web services
Testing
Simulated annealing

Keywords

  • Clustering
  • Simulated annealing
  • Voting
  • Web services testing

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Tsai, W. T., Zhang, D., Paul, R., & Chen, Y. (2005). Stochastic voting algorithms for web services group testing. In Proceedings - International Conference on Quality Software (Vol. 2005, pp. 99-106). [1579125] https://doi.org/10.1109/QSIC.2005.58

Stochastic voting algorithms for web services group testing. / Tsai, W. T.; Zhang, Dawei; Paul, Raymond; Chen, Yinong.

Proceedings - International Conference on Quality Software. Vol. 2005 2005. p. 99-106 1579125.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tsai, WT, Zhang, D, Paul, R & Chen, Y 2005, Stochastic voting algorithms for web services group testing. in Proceedings - International Conference on Quality Software. vol. 2005, 1579125, pp. 99-106, 5th International Conference on Quality Software, QSIC 2005, Melbourne, Australia, 9/19/05. https://doi.org/10.1109/QSIC.2005.58
Tsai WT, Zhang D, Paul R, Chen Y. Stochastic voting algorithms for web services group testing. In Proceedings - International Conference on Quality Software. Vol. 2005. 2005. p. 99-106. 1579125 https://doi.org/10.1109/QSIC.2005.58
Tsai, W. T. ; Zhang, Dawei ; Paul, Raymond ; Chen, Yinong. / Stochastic voting algorithms for web services group testing. Proceedings - International Conference on Quality Software. Vol. 2005 2005. pp. 99-106
@inproceedings{b023d7de0edd43bc91f5c05297bc18da,
title = "Stochastic voting algorithms for web services group testing",
abstract = "This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.",
keywords = "Clustering, Simulated annealing, Voting, Web services testing",
author = "Tsai, {W. T.} and Dawei Zhang and Raymond Paul and Yinong Chen",
year = "2005",
doi = "10.1109/QSIC.2005.58",
language = "English (US)",
isbn = "0769524729",
volume = "2005",
pages = "99--106",
booktitle = "Proceedings - International Conference on Quality Software",

}

TY - GEN

T1 - Stochastic voting algorithms for web services group testing

AU - Tsai, W. T.

AU - Zhang, Dawei

AU - Paul, Raymond

AU - Chen, Yinong

PY - 2005

Y1 - 2005

N2 - This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.

AB - This paper proposes a stochastic voting for testing a large number of Web Services (WS) under group testing. In the future, a large number of WS will be available and they need to be tested and evaluated in real time. While numerous test input generation techniques are available to generate test inputs, the oracle or the expected output of these test input is often difficult to obtain. One way to obtain the oracle in this case is to give the same input to multiple WS and to establish the oracle by a majority voting. This is based on the assumption that faulty WS often will not produce consistent results, and thus if a majority can be reached, the oracle can be established statistically. However, even correct WS may still produce slightly different outputs, and thus the majority-voting scheme must be carefully designed to distinguish correct but slightly variant output from truly incorrect output. This paper proposes a hierarchical classification based on simulated annealing and multi-dimensional Chisquare statistical techniques to analyze data to see if a majority can be reached. The algorithm is evaluated by a comprehensive simulated data as well as actual data. The data show that the proposed algorithm is effective even in a difficult situation where clusters of WS produce clusters of output.

KW - Clustering

KW - Simulated annealing

KW - Voting

KW - Web services testing

UR - http://www.scopus.com/inward/record.url?scp=33947380241&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33947380241&partnerID=8YFLogxK

U2 - 10.1109/QSIC.2005.58

DO - 10.1109/QSIC.2005.58

M3 - Conference contribution

SN - 0769524729

SN - 9780769524726

VL - 2005

SP - 99

EP - 106

BT - Proceedings - International Conference on Quality Software

ER -