Autonomous Decentralized Combinatorial Testing

Wei Tek Tsai, Guanqiu Qi, Kai Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

Testing-as-a-Service (TaaS) is a software testing service in a cloud that can leverage the computation power provided by the cloud. Specifically, a TaaS can be scaled to large and dynamic workloads, executed in a distributed environment with hundreds of thousands of processors, and these processors may support concurrent and distributed test execution and analysis. This paper proposes an autonomous decentralized combinatorial testing system based on Adaptive Reasoning (AR) and Test Algebra (TA) for Combinatorial Testing (CT). AR performs testing and identifies faulty interactions, and TA eliminates related configurations from testing and there can be carried out concurrently. By combining these two, it is possible to perform large CT. We performed experiments with 2<sup>10</sup> components and 98:34% of configurations have been eliminated out of total number of configurations by AR and TA analysis.

Original languageEnglish (US)
Title of host publicationProceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages40-47
Number of pages8
ISBN (Print)9781479982615
DOIs
StatePublished - Apr 29 2015
Event2015 12th IEEE International Symposium on Autonomous Decentralized Systems, ISADS 2015 - Taichung, Taiwan, Province of China
Duration: Mar 25 2015Mar 27 2015

Other

Other2015 12th IEEE International Symposium on Autonomous Decentralized Systems, ISADS 2015
CountryTaiwan, Province of China
CityTaichung
Period3/25/153/27/15

Fingerprint

Testing
Algebra
Software testing
Experiments

Keywords

  • and Adaptive Reasoning
  • Combinatorial Testing
  • Concurrent Testing
  • TaaS
  • Test Algebra

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering

Cite this

Tsai, W. T., Qi, G., & Hu, K. (2015). Autonomous Decentralized Combinatorial Testing. In Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015 (pp. 40-47). [7098236] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISADS.2015.53

Autonomous Decentralized Combinatorial Testing. / Tsai, Wei Tek; Qi, Guanqiu; Hu, Kai.

Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015. Institute of Electrical and Electronics Engineers Inc., 2015. p. 40-47 7098236.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tsai, WT, Qi, G & Hu, K 2015, Autonomous Decentralized Combinatorial Testing. in Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015., 7098236, Institute of Electrical and Electronics Engineers Inc., pp. 40-47, 2015 12th IEEE International Symposium on Autonomous Decentralized Systems, ISADS 2015, Taichung, Taiwan, Province of China, 3/25/15. https://doi.org/10.1109/ISADS.2015.53
Tsai WT, Qi G, Hu K. Autonomous Decentralized Combinatorial Testing. In Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 40-47. 7098236 https://doi.org/10.1109/ISADS.2015.53
Tsai, Wei Tek ; Qi, Guanqiu ; Hu, Kai. / Autonomous Decentralized Combinatorial Testing. Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 40-47
@inproceedings{0012e16071a34d2eafcd894b060e4fc3,
title = "Autonomous Decentralized Combinatorial Testing",
abstract = "Testing-as-a-Service (TaaS) is a software testing service in a cloud that can leverage the computation power provided by the cloud. Specifically, a TaaS can be scaled to large and dynamic workloads, executed in a distributed environment with hundreds of thousands of processors, and these processors may support concurrent and distributed test execution and analysis. This paper proposes an autonomous decentralized combinatorial testing system based on Adaptive Reasoning (AR) and Test Algebra (TA) for Combinatorial Testing (CT). AR performs testing and identifies faulty interactions, and TA eliminates related configurations from testing and there can be carried out concurrently. By combining these two, it is possible to perform large CT. We performed experiments with 210 components and 98:34{\%} of configurations have been eliminated out of total number of configurations by AR and TA analysis.",
keywords = "and Adaptive Reasoning, Combinatorial Testing, Concurrent Testing, TaaS, Test Algebra",
author = "Tsai, {Wei Tek} and Guanqiu Qi and Kai Hu",
year = "2015",
month = "4",
day = "29",
doi = "10.1109/ISADS.2015.53",
language = "English (US)",
isbn = "9781479982615",
pages = "40--47",
booktitle = "Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Autonomous Decentralized Combinatorial Testing

AU - Tsai, Wei Tek

AU - Qi, Guanqiu

AU - Hu, Kai

PY - 2015/4/29

Y1 - 2015/4/29

N2 - Testing-as-a-Service (TaaS) is a software testing service in a cloud that can leverage the computation power provided by the cloud. Specifically, a TaaS can be scaled to large and dynamic workloads, executed in a distributed environment with hundreds of thousands of processors, and these processors may support concurrent and distributed test execution and analysis. This paper proposes an autonomous decentralized combinatorial testing system based on Adaptive Reasoning (AR) and Test Algebra (TA) for Combinatorial Testing (CT). AR performs testing and identifies faulty interactions, and TA eliminates related configurations from testing and there can be carried out concurrently. By combining these two, it is possible to perform large CT. We performed experiments with 210 components and 98:34% of configurations have been eliminated out of total number of configurations by AR and TA analysis.

AB - Testing-as-a-Service (TaaS) is a software testing service in a cloud that can leverage the computation power provided by the cloud. Specifically, a TaaS can be scaled to large and dynamic workloads, executed in a distributed environment with hundreds of thousands of processors, and these processors may support concurrent and distributed test execution and analysis. This paper proposes an autonomous decentralized combinatorial testing system based on Adaptive Reasoning (AR) and Test Algebra (TA) for Combinatorial Testing (CT). AR performs testing and identifies faulty interactions, and TA eliminates related configurations from testing and there can be carried out concurrently. By combining these two, it is possible to perform large CT. We performed experiments with 210 components and 98:34% of configurations have been eliminated out of total number of configurations by AR and TA analysis.

KW - and Adaptive Reasoning

KW - Combinatorial Testing

KW - Concurrent Testing

KW - TaaS

KW - Test Algebra

UR - http://www.scopus.com/inward/record.url?scp=84937200357&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84937200357&partnerID=8YFLogxK

U2 - 10.1109/ISADS.2015.53

DO - 10.1109/ISADS.2015.53

M3 - Conference contribution

AN - SCOPUS:84937200357

SN - 9781479982615

SP - 40

EP - 47

BT - Proceedings - 2015 IEEE 12th International Symposium on Autonomous Decentralized Systems, ISADS 2015

PB - Institute of Electrical and Electronics Engineers Inc.

ER -