Advances in noise‐based testing of concurrent software. (5th September 2014)

• Record Type: Journal Article
• Authors: Fiedor, J.; Hrubá, V.; Křena, B.; Letko, Z.; Ur, S.; Vojnar, T.; Farchi, Eitan; Hierons, Robert M.; Lourenço, João
• Is Part Of: Software testing, verification & reliability. Volume 25:Number 3(2015:Jul.)
• Page Start: 272
• Page End: 309
• Publication Date: 2014-09-05
• Subjects: Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1546
• Languages: English
• ISSNs: 0960-0833

Abstract

<abstract abstract-type="main" id="stvr1546-abs-0001"> <title>Summary</title> <p id="stvr1546-para-0001">Testing of concurrent software written in programming languages like Java and C/C++ is a highly challenging task owing to the many possible interactions among threads. A simple, cheap, and effective approach that addresses this challenge is testing with <italic>noise injection</italic>, which influences the scheduling so that different interleavings of concurrent actions are witnessed. In this paper, multiple results achieved recently in the area of noise‐injection‐based testing by the authors are presented in a unified and extended way. In particular, various <italic>concurrency coverage metrics</italic> are presented first. Then, multiple heuristics for solving the <italic>noise placement problem</italic> (i.e. where and when to generate noise) as well as the <italic>noise seeding problem</italic> (i.e. how to generate the noise) are introduced and experimentally evaluated. In addition, several new heuristics are proposed and included into the evaluation too. Recommendations on how to set up noise‐based testing for particular scenarios are then given. Finally, a novel use of the genetic algorithm for finding suitable combinations of the many parameters of tests and noise techniques is presented. Copyright © 2014 John Wiley &amp; Sons, Ltd.</p> </abstract>