Fault‐based test generation for regular expressions by mutation. (8th March 2018)

• Record Type: Journal Article
• Authors: Arcaini, Paolo; Gargantini, Angelo; Riccobene, Elvinia
• Other Names: Just René guestEditor.; Krinke Jens guestEditor.; Li Nan guestEditor.; Rojas José Miguel guestEditor.
• Is Part Of: Software testing, verification & reliability. Volume 29:Number 1/2(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-03-08
• Subjects: distinguishing string -- fault class -- mutation testing -- mutation score -- regular expression; Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1664
• Languages: English
• ISSNs: 0960-0833

Abstract

Summary: Regular expressions are used to characterize sets of strings (ie, languages) using a pattern‐based syntax. They are applied in different contexts as, for example, data validation in Web forms. However, writing a regular expression that exactly captures the desired set of strings could be particularly difficult, and techniques are sought to validate regular expressions or test their use in applications. A common means to regular expression validation and testing is the generation of a set of labelled strings (ie, strings together with their evaluation). We here propose a fault‐based approach for generating strings usable as tests for regular expressions. We define some fault classes representing mistakes that could be made when writing a regular expression, and we introduce the notion of distinguishing string, ie, a string that is able to expose a fault. Given a regular expression, our approach generates a test suite composed of distinguishing strings that are able to detect possible faults in the regular expression. We present different versions of the approach, which provide different results in terms of test suite size and generation time. Experiments show that the proposed approach can generate compact test suites and that, using suitable optimizations, the generation time is reasonable. Exploiting the proposed fault classes, we use the notion of mutation score to assess the ability of a generic set of strings in exposing possible faults contained in the regular expression under test. A comparison with other test generation tools in terms of mutation score, size, and generation time shows the advantages and limits of our approach. Abstract : We propose a fault‐based approach for generating strings usable as tests for regular expressions. We define fault classes for regular expressions, and we introduce the notion of distinguishing string, ie, a string able to expose a fault. Given a regular expression, our approach generates a test suite of distinguishing strings able to detect possible faults in the regular expression. Experiments show that the approach can generate compact test suites and that, using suitable optimizations, the generation time is reasonable.