Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

TIMSS (Third International Mathematics and Science Study) is the largest, most ambitious study of comparative education ever attempted. Despite the TIMSS Subject Matter Advisory Committee's best efforts, not all test items truly reflect student math and science achievement. Some items have more than one correct response; some are not grounded in…

Despite Commissioner Pascal Forgione's claims (in the June 1998 "Kappan"), the final-year Third International Mathematics and Science Study obviates comparison of achievement across nations. Comparers are engaging in a political exercise. There are problems with age, cultural, and enrollment-rate differences; definition of the U.S.…