Whose feedback? A multilevel analysis of student completion of end-of-term teaching evaluations. Issue 6 (17th August 2016)

• Record Type: Journal Article
• Authors: Macfadyen, Leah P.; Dawson, Shane; Prest, Stewart; Gašević, Dragan
• Is Part Of: Assessment & evaluation in higher education. Volume 41:Issue 6(2016)
• Page Start: 821
• Page End: 839
• Publication Date: 2016-08-17
• Subjects: student evaluation of teaching -- course evaluation -- response rate -- response bias -- multilevel analysis; Education, Higher -- Evaluation -- Periodicals; 378
• DOI: 10.1080/02602938.2015.1044421
• Languages: English
• ISSNs: 0260-2938

Abstract

Abstract : Student evaluation of teaching (SET) is now common practice across higher education, with the results used for both course improvement and quality assurance purposes. While much research has examined the validity of SETs for measuring teaching quality, few studies have investigated the factors that influence student participation in the SET process. This study aimed to address this deficit through the analysis of an SET respondent pool at a large Canadian research-intensive university. The findings were largely consistent with available research (showing influence of student gender, age, specialisation area and final grade on SET completion). However, the study also identified additional influential course-specific factors such as term of study, course year level and course type as statistically significant. Collectively, such findings point to substantively significant patterns of bias in the characteristics of the respondent pool. Further research is needed to specify and quantify the impact (if any) on SET scores. We conclude, however, by recommending that such bias does not invalidate SET implementation, but instead should be embraced and reported within standard institutional practice, allowing better understanding of feedback received, and driving future efforts at recruiting student respondents.