Concurrent test algebra execution with combinatorial testing

Wei Tek Tsai, Jie Luo, Guanqiu Qi, Wenjun Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

18 Citations (Scopus)

Abstract

Software-as-a-Service (SaaS), a new software delivery model, plays an important role in daily life. In SaaS, mission-critical applications are composed, deployed, and executed on cloud platforms. SaaS applications needed to have high reliability and availability before publishing. Testing SaaS applications becomes important, as the large number of testing prior to their deployment. Test Algebra (TA), a algebraic system, identifies faults in combinatorial testing for SaaS applications using existing test results and eliminates those related faults. Although TA eliminates a large number of configurations from considerations, it is still difficult to finish testing enormous combinations of services in a reasonable time. To improve TA analysis, this paper proposes a concurrent TA analysis. It allocates workloads into different clusters of computers and performs TA analysis from 2-way to 6-way configurations. Different database designs are used to store the test results of various configurations. Faulty and operational table search algorithms are proposed to retrieve existing test results. One 25-component experiment is simulated using the proposed solutions. The same experiment is also simulated on multiple processors for concurrent TA analysis.

Original languageEnglish (US)
Title of host publicationProceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014
PublisherIEEE Computer Society
Pages35-46
Number of pages12
ISBN (Print)9781479925049
DOIs
StatePublished - 2014
Event8th IEEE International Symposium on Service Oriented System Engineering, SOSE 2014 - Oxford, United Kingdom
Duration: Apr 7 2014Apr 11 2014

Other

Other8th IEEE International Symposium on Service Oriented System Engineering, SOSE 2014
CountryUnited Kingdom
CityOxford
Period4/7/144/11/14

Fingerprint

Algebra
Testing
Experiments
Availability

Keywords

  • algebra
  • Combinatorial testing
  • concurrent
  • SaaS

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering

Cite this

Tsai, W. T., Luo, J., Qi, G., & Wu, W. (2014). Concurrent test algebra execution with combinatorial testing. In Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014 (pp. 35-46). [6825959] IEEE Computer Society. https://doi.org/10.1109/SOSE.2014.11

Concurrent test algebra execution with combinatorial testing. / Tsai, Wei Tek; Luo, Jie; Qi, Guanqiu; Wu, Wenjun.

Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014. IEEE Computer Society, 2014. p. 35-46 6825959.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tsai, WT, Luo, J, Qi, G & Wu, W 2014, Concurrent test algebra execution with combinatorial testing. in Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014., 6825959, IEEE Computer Society, pp. 35-46, 8th IEEE International Symposium on Service Oriented System Engineering, SOSE 2014, Oxford, United Kingdom, 4/7/14. https://doi.org/10.1109/SOSE.2014.11
Tsai WT, Luo J, Qi G, Wu W. Concurrent test algebra execution with combinatorial testing. In Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014. IEEE Computer Society. 2014. p. 35-46. 6825959 https://doi.org/10.1109/SOSE.2014.11
Tsai, Wei Tek ; Luo, Jie ; Qi, Guanqiu ; Wu, Wenjun. / Concurrent test algebra execution with combinatorial testing. Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014. IEEE Computer Society, 2014. pp. 35-46
@inproceedings{bdcc7402de684939a58d95a5fcf25a1c,
title = "Concurrent test algebra execution with combinatorial testing",
abstract = "Software-as-a-Service (SaaS), a new software delivery model, plays an important role in daily life. In SaaS, mission-critical applications are composed, deployed, and executed on cloud platforms. SaaS applications needed to have high reliability and availability before publishing. Testing SaaS applications becomes important, as the large number of testing prior to their deployment. Test Algebra (TA), a algebraic system, identifies faults in combinatorial testing for SaaS applications using existing test results and eliminates those related faults. Although TA eliminates a large number of configurations from considerations, it is still difficult to finish testing enormous combinations of services in a reasonable time. To improve TA analysis, this paper proposes a concurrent TA analysis. It allocates workloads into different clusters of computers and performs TA analysis from 2-way to 6-way configurations. Different database designs are used to store the test results of various configurations. Faulty and operational table search algorithms are proposed to retrieve existing test results. One 25-component experiment is simulated using the proposed solutions. The same experiment is also simulated on multiple processors for concurrent TA analysis.",
keywords = "algebra, Combinatorial testing, concurrent, SaaS",
author = "Tsai, {Wei Tek} and Jie Luo and Guanqiu Qi and Wenjun Wu",
year = "2014",
doi = "10.1109/SOSE.2014.11",
language = "English (US)",
isbn = "9781479925049",
pages = "35--46",
booktitle = "Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - Concurrent test algebra execution with combinatorial testing

AU - Tsai, Wei Tek

AU - Luo, Jie

AU - Qi, Guanqiu

AU - Wu, Wenjun

PY - 2014

Y1 - 2014

N2 - Software-as-a-Service (SaaS), a new software delivery model, plays an important role in daily life. In SaaS, mission-critical applications are composed, deployed, and executed on cloud platforms. SaaS applications needed to have high reliability and availability before publishing. Testing SaaS applications becomes important, as the large number of testing prior to their deployment. Test Algebra (TA), a algebraic system, identifies faults in combinatorial testing for SaaS applications using existing test results and eliminates those related faults. Although TA eliminates a large number of configurations from considerations, it is still difficult to finish testing enormous combinations of services in a reasonable time. To improve TA analysis, this paper proposes a concurrent TA analysis. It allocates workloads into different clusters of computers and performs TA analysis from 2-way to 6-way configurations. Different database designs are used to store the test results of various configurations. Faulty and operational table search algorithms are proposed to retrieve existing test results. One 25-component experiment is simulated using the proposed solutions. The same experiment is also simulated on multiple processors for concurrent TA analysis.

AB - Software-as-a-Service (SaaS), a new software delivery model, plays an important role in daily life. In SaaS, mission-critical applications are composed, deployed, and executed on cloud platforms. SaaS applications needed to have high reliability and availability before publishing. Testing SaaS applications becomes important, as the large number of testing prior to their deployment. Test Algebra (TA), a algebraic system, identifies faults in combinatorial testing for SaaS applications using existing test results and eliminates those related faults. Although TA eliminates a large number of configurations from considerations, it is still difficult to finish testing enormous combinations of services in a reasonable time. To improve TA analysis, this paper proposes a concurrent TA analysis. It allocates workloads into different clusters of computers and performs TA analysis from 2-way to 6-way configurations. Different database designs are used to store the test results of various configurations. Faulty and operational table search algorithms are proposed to retrieve existing test results. One 25-component experiment is simulated using the proposed solutions. The same experiment is also simulated on multiple processors for concurrent TA analysis.

KW - algebra

KW - Combinatorial testing

KW - concurrent

KW - SaaS

UR - http://www.scopus.com/inward/record.url?scp=84903640107&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84903640107&partnerID=8YFLogxK

U2 - 10.1109/SOSE.2014.11

DO - 10.1109/SOSE.2014.11

M3 - Conference contribution

AN - SCOPUS:84903640107

SN - 9781479925049

SP - 35

EP - 46

BT - Proceedings - IEEE 8th International Symposium on Service Oriented System Engineering, SOSE 2014

PB - IEEE Computer Society

ER -