Combining metrics for software evolution assessment by means of Data Envelopment Analysis. Issue 3 (31st January 2012)

• Record Type: Journal Article
• Authors: Chatzigeorgiou, Alexander; Stiakakis, Emmanouil
• Is Part Of: Journal of software. Volume 25:Issue 3(2013)
• Page Start: 303
• Page End: 324
• Publication Date: 2012-01-31
• Subjects: Software engineering -- Periodicals; Computer software -- Development -- Periodicals; Software maintenance -- Periodicals; 005.1
• DOI: 10.1002/smr.584
• Languages: English
• ISSNs: 2047-7473

Abstract

<abstract abstract-type="main"> <title>SUMMARY</title> <p>Research and practice in software engineering have led to an extensive set of metrics for the evaluation of almost every aspect of software development. One of the major challenges for any quality model is the combination of metrics, which are complementary to each other. In this paper, we propose the use of Data Envelopment Analysis (DEA), a non‐parametric technique employed in economics, as a means of providing a unified view of selected design metrics. The proposed application of DEA aims at assessing the overall trend of quality during the evolution of software systems, by considering releases of a project as units to be ranked. An important benefit derived from the use of DEA is the ability to "normalize" the evaluation over the size characteristics of the examined systems, which is vital when comparing projects of different scale. Results are presented for successive versions of two open‐source, one industrial and one research project, whereas validation, whereas validation is performed by comparing the findings with the results obtained by Analytic Hierarchy Process, which is an acknowledged multi‐criteria decision analysis approach. According to the results, DEA enables the perception of global trends in qualitative characteristics, which would be otherwise difficult to recognize and interpret. Copyright © 2012 John Wiley &amp; Sons, Ltd.</p> </abstract>