To investigate whether the type of keyboard used in exams introduces any construct-irrelevant variance to the TOEFL iBT Writing scores, we surveyed 17,040 TOEFL iBT examinees from 24 countries on their keyboard-related perceptions and preferences and analyzed the survey responses together with their test scores. Results suggest that controlling…

In this article, we address the issue of participation in adult education building on the cultural capital framework. This theoretical framework suggests that (educational) practices are affected by one's social background and, more precisely, by the cultural resources handed down in the family context. To examine the validity of this theoretical…

It is common practice for K-12 schools to assess multilingual students' language proficiency to determine language support program placement. Because such programs can provide essential scaffolding, the policies guiding these assessments merit careful consideration. It is well accepted that quality assessments must be valid (representative of the…

In this study, we investigated how empirical indicators of test-taking engagement can be defined, empirically validated, and used to describe group differences in the context of the Programme of International Assessment of Adult Competences (PIAAC). The approach was to distinguish between disengaged and engaged response behavior by means of…

A critical assumption in cross-cultural comparative research is that the instrument measures the same construct(s) in exactly the same way across all groups (i.e., the instrument is measurement and structurally equivalent). Structural equation modeling (SEM) procedures are commonly used in testing these assumptions of multigroup equivalence.…

In this article, we have examined how historical events shape the research process, even when research is carefully planned and rigorously executed. Through an examination of our experiences conducting international data collection during a three-year SSHRC funded period in which the War on Terrorism and the War in Iraq began, we suggest that…