Assessing competency-based evaluation course impacts: A mixed methods case study. (April 2020)

• Record Type: Journal Article
• Authors: Poth, Cheryl N.; Searle, Michelle; Aquilina, Alexandra M.; Ge, Jenny; Elder, Alexa
• Is Part Of: Evaluation and program planning. Volume 79(2020)
• Publication Date: 2020-04
• Subjects: Case study -- Competency-based approach -- Evaluator education -- Mixed methods research; Health planning -- Periodicals; Medical care -- Evaluation -- Periodicals; 362.1068
• DOI: 10.1016/j.evalprogplan.2020.101789
• Languages: English
• ISSNs: 0149-7189

Abstract

Highlights: A competency-based evaluation course supports individualized learning. A systems perspective reveals new insights. Greater competency gains were associated with experiential learning opportunities. This mixed methods case study generated novel insights useful for instructional guidance. Abstract: The contexts in which evaluators develop and apply their expertise are increasingly complex; evaluator education needs to provide robust opportunities to support and assess the progressive, lifelong development of relevant knowledge and skills. This mixed methods case study begins to address the dearth of empirical evidence assessing the impacts and learner experiences of competency-based approaches to evaluator education. A decade-in-the-making doctoral evaluation course based on the Canadian Evaluation Society's Competencies for Canadian Evaluation Practice created an opportune study setting. We applied a systems perspective to Stufflebeam's Context, Input, Process, and Product (CIPP) model to frame the case study analysis and presentation of the complex impacts generated by pre/post course competency self-assessments and reflections, integrated with an end-of-course focus group. Seven insights shed new light on the effective course design and implementation features for developing intended and unintended evaluator competencies. We conclude with a discussion of the theoretical, practical, and methodological implications for effective competency-based evaluator education. Keywords: Case study; Competency-based approach; Evaluator education; Mixed methods research