Development of a situational judgment test for global engineering competency. Issue 3 (24th June 2020)

• Record Type: Journal Article
• Authors: Jesiek, Brent K.; Woo, Sang Eun; Parrigon, Scott; Porter, Caitlin M.
• Is Part Of: Journal of engineering education. Volume 109:Issue 3(2020:Jul.)
• Page Start: 470
• Page End: 490
• Publication Date: 2020-06-24
• Subjects: assessment -- global engineering -- intercultural competence -- situational judgment test -- survey; Engineering -- Study and teaching (Higher) -- Periodicals; 620.00711
• DOI: 10.1002/jee.20325
• Languages: English
• ISSNs: 1069-4730

Abstract

Abstract: Background: As globalization continues to impact the engineering profession, many programs aim to prepare current and future engineers to work across national and cultural boundaries. Yet there remains a lack of quality tools for assessing global competency among engineers and other technical professionals, including their behavioral tendencies in global work situations. Purpose: We introduce development of a situational judgment test (SJT) covering three dimensions of global engineering competency (GEC) in Chinese national/cultural context. The main aim of this article is to describe how the SJT was developed through a systematic multistep process. Secondarily, we explore relationships between SJT performance and other theoretically relevant variables. Methods: After generating a large initial pool of SJT scenarios and behavioral response items, we used ratings from subject matter experts (SMEs) to select six SJT scenarios and create scoring keys for 26 response items. To further explore the instrument's validity, we deployed the SJT items, other relevant measures, and a demographic survey to a sample of practicing engineers ( n = 400). Results: SME ratings provide strong evidence for the content relevance of the GEC–SJT tool. Survey results also suggest positive relationships between SJT performance and Chinese cultural knowledge, age, and years of work experience. However, more validity and reliability evidence is needed before recommending wider use of the instrument. Conclusions: Our findings suggest the SJT format as a promising behavior‐based approach to measuring global competency and other professional attributes in engineering. We also discuss directions for future research and training efforts related to assessing and developing global competency.