Killing strategies for model‐based mutation testing. (3rd February 2014)

• Record Type: Journal Article
• Authors: Aichernig, Bernhard K.; Brandl, Harald; Jöbstl, Elisabeth; Krenn, Willibald; Schlick, Rupert; Tiran, Stefan
• Is Part Of: Software testing, verification & reliability. Volume 25:Number 8(2015)
• Page Start: 716
• Page End: 748
• Publication Date: 2014-02-03
• Subjects: test case generation -- model‐based testing -- mutation testing -- random testing -- ioco -- action systems -- Unified Modeling Language -- UML; Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1522
• Languages: English
• ISSNs: 0960-0833

Abstract

Summary: This article presents the techniques and results of a novel model‐based test case generation approach that automatically derives test cases from UML state machines. The main contribution of this article is the fully automated fault‐based test case generation technique together with two empirical case studies derived from industrial use cases. Also, an in‐depth evaluation of different fault‐based test case generation strategies on each of the case studies is given and a comparison with plain random testing is conducted. The test case generation methodology supports a wide range of UML constructs and is grounded on the formal semantics of Back's action systems and the well‐known input–output conformance relation. Mutation operators are employed on the level of the specification to insert faults and generate test cases that will reveal the faults inserted. The effectiveness of this approach is shown and it is discussed how to gain a more expressive test suite by combining cheap but undirected random test case generation with the more expensive but directed mutation‐based technique. Finally, an extensive and critical discussion of the lessons learnt is given as well as a future outlook on the general usefulness and practicability of mutation‐based test case generation. Copyright © 2014 John Wiley & Sons, Ltd. Abstract : This paper presents a model‐based test case generation approach that automatically derives test cases from UML state machines. The technique is based on the mutation analysis of test models. In the two case studies, different fault‐based test case generation strategies are compared.