An investigation of the validity of a speaking assessment for adolescent English language learners. (July 2021)

• Record Type: Journal Article
• Authors: Huang, Becky H.; Bailey, Alison L.; Sass, Daniel A.; Shawn Chang, Yung-hsiang
• Other Names: Timpe-Laughlin Veronika guest-editor.; Cho Yeonsuk guest-editor.
• Is Part Of: Language testing. Volume 38:Number 3(2021)
• Page Start: 401
• Page End: 428
• Publication Date: 2021-07
• Subjects: Adolescent EFL learners -- assessment use argument -- construct validity -- English language learners -- interpretation argument framework -- speaking assessments -- test validity -- TOEFL Junior® test -- interactional competence; Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 407.6
• DOI: 10.1177/0265532220925731
• Languages: English
• ISSNs: 0265-5322

Abstract

Given the increasing emphasis of communicative competence in English as a foreign language (EFL) contexts and the lack of validation research on speaking assessments for adolescent EFL learners, in the current study we examined the validity of the TOEFL Junior ® speaking test, a relatively new speaking assessment developed by Educational Testing Service. We utilized Messick's integrative view of construct validity (1996) and Kane's interpretation argument framework (Kane, 2013), and focused on two sources of validity evidence: internal structure and external relations to other variables (AERA, APA, and NCME, 2014). We used a cross-sectional design with 252 seventh-to-ninth graders in Taiwan, which aligns with the spectrum of the TOEFL Junior ®'s target age group. All adolescent participants took the TOEFL Junior ® speaking test and two researcher-developed speaking tests. They also completed a survey reporting their history of English learning experiences from kindergarten to present and evaluating their own English language skills. Adolescent participants' teachers provided evaluations of participants' English language skills. Results from correlational tests and confirmatory factor analysis showed robust evidence for the test's internal structure. Correlation and multiple regression models also demonstrated strong positive relationships between TOEFL Junior ® test scores and external variables, providing evidence for TOEFL Junior ®'s construct validity.