Approaches for computing test‐case‐aware covering arrays. (16th September 2018)

• Record Type: Journal Article
• Authors: Koc, Ugur; Yilmaz, Cemal
• Is Part Of: Software testing, verification & reliability. Volume 28:Number 7(2018)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-09-16
• Subjects: combinatorial interaction testing -- covering arrays -- simulated annealing -- software quality assurance -- software testing -- test‐case‐aware covering arrays; Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1689
• Languages: English
• ISSNs: 0960-0833

Abstract

Summary: Test‐case‐aware covering arrays have been recently introduced to overcome the shortcomings of standard covering arrays, which prevent some combinations of option settings from being exercised in the presence of test‐case‐specific constraints. A number of proof‐of‐concept approaches for computing test‐case‐aware covering arrays have also been presented in the aforementioned work. The main concern in the development of these approaches was neither their efficiency nor their effectiveness, but their correctness. On the other hand, efficient and effective ways of computing test‐case‐aware covering arrays are of great practical importance. To improve the applicability of test‐case‐aware covering arrays in practice, this work presents a number of efficient and effective approaches for computing them. Furthermore, the proposed approaches are evaluated by conducting a set of experiments on widely‐used highly‐configurable software systems and comparing their efficiency and effectiveness to those of the existing approaches in various practical testing scenarios. Abstract : 16 constructors for computing test case‐aware covering arrays. Empirical evaluations on widely‐used highly‐configurable systems using 3 practical scenarios. Significantly smaller covering arrays at comparable or lower costs. Making test case‐aware covering arrays more practical.