Benchmarking factor selection and sensitivity: a case study with nursing courses. Issue 9 (2nd September 2018)

• Record Type: Journal Article
• Authors: Langan, A. M.; Harris, W. E.; Barrett, N.; Hamshire, C.; Wibberley, C.
• Is Part Of: Studies in higher education. Volume 43:Issue 9(2018)
• Page Start: 1586
• Page End: 1596
• Publication Date: 2018-09-02
• Subjects: Metric benchmarks -- machine learning -- RandomForest -- factor selection -- sensitivity; Education, Higher -- Periodicals; 378.005
• DOI: 10.1080/03075079.2016.1266613
• Languages: English
• ISSNs: 0307-5079

Abstract

ABSTRACT: There is an increasing requirement in higher education (HE) worldwide to deliver excellence. Benchmarking is widely used for this purpose, but methodological approaches to the creation of benchmark metrics vary greatly. Approaches require selection of factors for inclusion and subsequent calculation of benchmarks for comparison. We describe an approach using machine learning to select input factors based on their value to predict completion rates of nursing courses. Data from over 36, 000 students, from nine institutions over three years were included and weighted averages provided a dynamic baseline for year on year and within year comparisons between institutions. Anonymised outcomes highlight the variation in benchmarked performances between institutions and we demonstrate the value of accompanying sensitivity analyses. Our methods are appropriate worldwide, for many forms of data and at multiple scales of enquiry. We discuss our results in the context of HE management, highlighting the value of scrutinising benchmark calculations.