Quantitative software project management with mixed data: A comparison of radial, nonradial, and ensemble data envelopment analysis models. Issue 6 (7th May 2021)

• Record Type: Journal Article
• Authors: Pendharkar, Parag C.; Rodger, James A.
• Is Part Of: Journal of software. Volume 33:Issue 6(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-05-07
• Subjects: data envelopment analysis -- software engineering -- software project measurement -- software project ranking; Software engineering -- Periodicals; Computer software -- Development -- Periodicals; Software maintenance -- Periodicals; 005.1
• DOI: 10.1002/smr.2348
• Languages: English
• ISSNs: 2047-7473

Abstract

Abstract: Data envelopment analysis (DEA) models are often used for benchmarking software projects, and traditional DEA models only allow for the use of continuous variables. This study considers the use of DEA for datasets with mixed continuous and discrete variables to ranking software projects. It uses the existing radial DEA model and extends the nonradial DEA model to allow for the use of mixed variables. Further efficiency scores from the two DEA models are averaged in an ensemble DEA score. Using three real‐world software engineering datasets, this study finds that the nonradial DEA and the ensemble DEA models have better discriminating power (lower tied efficiency scores) to rank software projects, and the radial DEA model generates more general ranking distribution (higher entropy) of normalized efficiency scores. The choice between selecting radial and nonradial DEA models for ranking software projects appears to depend on the extent to which managers want to introduce bias into the efficiency score ranking distribution. Radial models appear to have a lower bias than nonradial models. The ensemble DEA model appears to be the best performing DEA model for datasets containing two or more discrete and continuous variables. Abstract : The paper uses mixed continuous and discrete variables for DEA‐based software project analysis. The analysis is conducted for both radial and nonradial DEA models. Models are averaged into an ensemble DEA score.