ERIC Number: EJ1261209
Record Type: Journal
Publication Date: 2020-Jul
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1069-4730
EISSN: N/A
Available Date: N/A
Development of a Situational Judgment Test for Global Engineering Competency
Jesiek, Brent K.; Woo, Sang Eun; Parrigon, Scott; Porter, Caitlin M.
Journal of Engineering Education, v109 n3 p470-490 Jul 2020
Background: As globalization continues to impact the engineering profession, many programs aim to prepare current and future engineers to work across national and cultural boundaries. Yet there remains a lack of quality tools for assessing global competency among engineers and other technical professionals, including their behavioral tendencies in global work situations. Purpose: We introduce development of a situational judgment test (SJT) covering three dimensions of global engineering competency (GEC) in Chinese national/cultural context. The main aim of this article is to describe how the SJT was developed through a systematic multistep process. Secondarily, we explore relationships between SJT performance and other theoretically relevant variables. Methods: After generating a large initial pool of SJT scenarios and behavioral response items, we used ratings from subject matter experts (SMEs) to select six SJT scenarios and create scoring keys for 26 response items. To further explore the instrument's validity, we deployed the SJT items, other relevant measures, and a demographic survey to a sample of practicing engineers (n = 400). Results: SME ratings provide strong evidence for the content relevance of the GEC-SJT tool. Survey results also suggest positive relationships between SJT performance and Chinese cultural knowledge, age, and years of work experience. However, more validity and reliability evidence is needed before recommending wider use of the instrument. Conclusions: Our findings suggest the SJT format as a promising behavior-based approach to measuring global competency and other professional attributes in engineering. We also discuss directions for future research and training efforts related to assessing and developing global competency.
Descriptors: Situational Tests, Test Construction, Engineering Education, Student Evaluation, College Students, Foreign Countries, Cultural Awareness, Test Validity, Test Reliability
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: 1254323; 1160455
Author Affiliations: N/A