Effective grey‐box testing with partial FSM models. (17th January 2022)

• Record Type: Journal Article
• Authors: Sachtleben, Robert; Peleska, Jan
• Is Part Of: Software testing, verification & reliability. Volume 32:Number 2(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-01-17
• Subjects: complete test suites -- conformance testing -- grey‐box testing -- model‐based testing -- partial finite state machines; Computer software -- Testing -- Periodicals; Computer software -- Verification -- Periodicals; Computer software -- Reliability -- Periodicals; 005.14
• DOI: 10.1002/stvr.1806
• Languages: English
• ISSNs: 0960-0833

Abstract

Summary: For partial, nondeterministic, finite state machines, a new conformance relation called strong reduction is presented. It complements other existing conformance relations in the sense that the new relation is well suited for model‐based testing of systems whose inputs are enabled or disabled, depending on the actual system state. Examples of such systems are graphical user interfaces and systems with interfaces that can be enabled or disabled in a mechanical way. We present a new test generation algorithm producing complete test suites for strong reduction. The suites are executed according to the grey‐box testing paradigm: it is assumed that the state‐dependent sets of enabled inputs can be identified during test execution, while the implementation states remain hidden, as in black‐box testing. We show that this grey‐box information is exploited by the generation algorithm in such a way that the resulting best‐case test suite size is only linear in the state space size of the reference model. Moreover, examples show that this may lead to significant reductions of test suite size in comparison to true black‐box testing for strong reduction. Abstract : We present a new conformance relation called strong reduction for partial, nondeterministic, finite state machines. It is well suited for model‐based testing of systems whose inputs are enabled or disabled depending on the actual system state, such as GUIs. We introduce a new test generation algorithm for this relation and execute test suites according to the grey‐box testing paradigm by querying the state‐dependent sets of enabled inputs, which may lead to significant reductions of test suite size compared to black‐box testing.