Mutation operators for feature‐oriented software product lines. (26th July 2018)

• Record Type: Journal Article
• Authors: Krüger, Jacob; Al‐Hajjaji, Mustafa; Leich, Thomas; Saake, Gunter
• Other Names: Just René guestEditor.; Krinke Jens guestEditor.; Li Nan guestEditor.; Rojas José Miguel guestEditor.
• Is Part Of: Software testing, verification & reliability. Volume 29:Number 1/2(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-07-26
• Subjects: composition -- feature‐oriented programming -- mutation operator -- mutation testing -- software product line -- unit test; Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1676
• Languages: English
• ISSNs: 0960-0833

Abstract

Summary: Mutation testing is an approach to assess the quality of test cases. Mutants are modified versions of a system that ideally compose faulty behaviour. Test cases for a system are effective if they kill these mutants. For software product lines, several works have addressed mutation testing to inject variability faults, which may only exist in some variants. These works focus on variability models or specific implementation techniques. In contrast, feature‐oriented programming has been rarely investigated, wherefore, we (1) derive corresponding mutation operators, (2) investigate the feasibility of our proposed and conventional operators on 4 software product lines, and (3) discuss open challenges in mutation testing of software product lines. The results show that our proposed operators are suitable to cause variability faults and extend the capabilities of conventional operators. Nonetheless, mutation testing of software product lines is comparably expensive, due to a high number of variants and mutants—resulting in equivalence and redundancy. Abstract : This article proposes a set of variability‐aware mutation operators to assess test cases of configurable systems (ie, implemented with feature‐oriented programming). The results show that the proposed operators are more suitable to assess the ability of tests to find variability faults, but they can also result in an increased number of redundant and equivalent mutants. Several open challenges of mutation testing for configurable systems are discussed to guide further research.