Prioritising abstract test cases: an empirical study. Issue 4 (1st August 2019)

• Record Type: Journal Article
• Authors: Huang, Rubing; Zong, Weiwen; Chen, Tsong Yueh; Towey, Dave; Zhou, Yunan; Chen, Jinfu
• Is Part Of: IET software. Volume 13:Issue 4(2019)
• Page Start: 313
• Page End: 326
• Publication Date: 2019-08-01
• Subjects: program testing -- software tools; comprehensive empirical study -- testing effectiveness -- test-case prioritisation -- TCP -- test-case execution -- regression testing -- fault localisation -- model-based testing -- combinatorial interaction testing -- ATC prioritisation techniques -- ATCP techniques; Computer software -- Periodicals; Software engineering -- Periodicals; 005.1
• DOI: 10.1049/iet-sen.2018.5199
• Languages: English
• ISSNs: 1751-8806

Abstract

Abstract : Test‐case prioritisation (TCP) attempts to schedule the order of test‐case execution such that faults can be detected as quickly as possible. TCP has been widely applied in many testing scenarios such as regression testing and fault localisation. Abstract test cases (ATCs) are derived from models of the system under test and have been applied to many testing environments such as model‐based testing and combinatorial interaction testing. Although various empirical and analytical comparisons for some ATC prioritisation (ATCP) techniques have been conducted, to the best of the authors' knowledge, no comparative study focusing on the most current techniques has yet been reported. In this study, they investigated 18 ATCP techniques, categorised into four classes. They conducted a comprehensive empirical study to compare 16 of the 18 ATCP techniques in terms of their testing effectiveness and efficiency. They found that different ATCP techniques could be cost‐effective in different testing scenarios, allowing us to present recommendations and guidelines for which techniques to use under what conditions.