Systems performance prediction using requirements quality attributes classification. Issue 4 (November 2016)

• Record Type: Journal Article
• Authors: Dargan, John; Wasek, James; Campos-Nanez, Enrique
• Is Part Of: Requirements engineering. Volume 21:Issue 4(2016)
• Page Start: 553
• Page End: 572
• Publication Date: 2016-11
• Subjects: Poor requirements -- Requirements definition -- Requirements engineering -- Requirements quality attributes -- Natural language requirements; Requirements engineering -- Periodicals; Software engineering -- Periodicals; Computer software -- Development -- Periodicals; Logiciels -- Développement -- Périodiques; Génie logiciel -- Périodiques; 005.12
• DOI: 10.1007/s00766-015-0232-4
• Languages: English
• ISSNs: 0947-3602

Abstract

Abstract Poor requirements definition can adversely impact system cost and performance for government acquisition programs. This can be mitigated by ensuring requirements statements are written in a clear and unambiguous manner with high linguistic quality. This paper introduces a statistical model that uses requirements quality factors to predict system operational performance. This work explores four classification techniques (Logistic Regression, Naïve Bayes Classifier, Support Vector Machine, and K-Nearest Neighbor) to develop the predictive model. This model is created using empirical data from current major acquisition programs within the federal government. Operational Requirements Documents and Operational Test Reports are the data sources, respectively, for the system requirements statements and the accompanying operational test results used for model development. A commercial-off-the-shelf requirements quality analysis tool is used to determine the requirements linguistic quality metrics used in the model. Subsequent to model construction, the predictive value of the model is confirmed through execution of a sensitivity analysis, cross-validation of the data, and an overfitting analysis. Lastly, Receiver Operating Characteristics are examined to determine the best performing model. In all, the results establish that requirements quality is indeed a predictive factor for end-system operational performance, and the resulting statistical model can influence requirements development based on likelihood of successful operational performance.