Frameworks for evaluating education programmes and work related learning: a scoping review. Issue 6 (8th April 2021)

• Record Type: Journal Article
• Authors: Caley, Lynne; Williams, Sharon J.; Spernaes, Izabela; Thomas, David; Behrens, Doris; Willson, Alan
• Is Part Of: Journal of workplace learning. Volume 33:Issue 6(2021)
• Page Start: 486
• Page End: 501
• Publication Date: 2021-04-08
• Subjects: Evaluation -- Education -- Scoping review -- Work-related learning -- Education programmes; Employees -- Training of -- Periodicals; Employees -- Counseling of -- Periodicals; 658.3124
• DOI: 10.1108/JWL-09-2020-0157
• Languages: English
• ISSNs: 1366-5626

Abstract

Abstract : Purpose: It has become accepted practice to include an evaluation alongside learning programmes that take place at work, as a means of judging their effectiveness. There is a tendency to focus such evaluations on the relevance of the intervention and the amount of learning achieved by the individual. The aim of this review is to examine existing evaluation frameworks that have been used to evaluate education interventions and, in particular, assess how these have been used and the outcomes of such activity. Design/methodology/approach: A scoping review using Arskey and O'Malley's five stage framework was undertaken to examine existing evaluation frameworks claiming to evaluate education interventions. Findings: Forty five articles were included in the review. A majority of papers concentrate on learner satisfaction and/or learning achieved. Rarely is a structured framework mentioned, or detail of the approach to analysis cited. Typically, evaluations lacked baseline data, control groups, longitudinal observations and contextual awareness. Practical implications: This review has implications for those involved in designing and evaluating work-related education programmes, as it identifies areas where evaluations need to be strengthened and recommends how existing frameworks can be combined to improve how evaluations are conducted. Originality/value: This scoping review is novel in its assessment and critique of evaluation frameworks employed to evaluate work-related education programmes.