FaultTracer: a spectrum‐based approach to localizing failure‐inducing program edits. Issue 12 (7th October 2013)

• Record Type: Journal Article
• Authors: Zhang, Lingming; Kim, Miryung; Khurshid, Sarfraz
• Is Part Of: Journal of software. Volume 25:Issue 12(2013)
• Page Start: 1357
• Page End: 1383
• Publication Date: 2013-10-07
• Subjects: Software engineering -- Periodicals; Computer software -- Development -- Periodicals; Software maintenance -- Periodicals; 005.1
• DOI: 10.1002/smr.1634
• Languages: English
• ISSNs: 2047-7473

Abstract

<abstract abstract-type="main"> <title>SUMMARY</title> <p>Detecting faults in evolving systems is important. Change impact analysis has been shown to be effective for finding faults during software evolution. For example, Chianti represents program edits as atomic changes, selects affected tests, and determines a subset of affecting changes that might have caused test failures. However, the number of affecting changes related to each test failure in practice may still be overwhelming for manual inspection. In this paper, we present a novel approach, <sc>FaultTracer</sc>, which ranks program edits according to their suspiciousness to reduce developer effort in manually inspecting affecting changes. <sc>FaultTracer</sc> adapts spectrum‐based fault localization techniques, which assume the statements that are primarily executed by failed tests are more suspicious, and applies them in tandem with an enhanced change impact analysis to identify failure‐inducing edits more precisely. We conducted an experimental study using 23 real versions of four real‐world Java programs from the Software Infrastructure Repository. The experimental results show that <sc>FaultTracer</sc> localizes a real regression fault within top three atomic changes for 14 out of 22 studied real failures. When ranking only method‐level changes, compared to the existing ranking heuristic, <sc>FaultTracer</sc> reduces the number of changes to be manually inspected by more than 50% on the data set of real regression faults, and by more than 60% on the data set of seeded faults. The fault localization component of <sc>FaultTracer</sc> is 80% more effective than traditional spectrum‐based fault localization, and enables similar benefits when using either our enhanced change impact analysis or Chianti. The runtime overhead for <sc>FaultTracer</sc> to collect extended call graphs is 49.83 s for each subject on average and is only 8.26% more than that for Chianti to collect traditional call graph information. Copyright © 2013 John Wiley & Sons, Ltd.</p> </abstract>