Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

Until recently, there were four sources of large-scale self-report survey data on victim rates, cross-nationally: EU Kids Online, Global School Health Survey, Trends in International Mathematics and Science Study, and Health Behaviour of School-aged Children. Smith, Robinson, and Marchi (2016) examined the internal validity and external validity…

In this study, we analyzed and compared reasoning and proving opportunities in geometry lessons from American standard-based textbooks and Korean textbooks to understand how these textbooks provide student opportunities to engage in reasoning and proving activities. Overall, around 40% of exercise problems in Core Plus Mathematics Project (CPMP)…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

A variety of differential item functioning (DIF) methods have been proposed and used for ensuring that a test is fair to all test takers in a target population in the situations of, for example, a test being translated to other languages. However, once a method flags an item as DIF, it is difficult to conclude that the grouping variable (e.g.,…

For the international Trends in International Mathematics and Science Study (TIMSS2007) math and science motivation scales (self-concept, positive affect, and value), we evaluated the psychometric properties (factor structure, method effects, gender differences, and convergent and discriminant validity) in 4 Arab-speaking countries (Saudi Arabia,…

Due to the scarcity of cross-cultural comparative studies in exploring students' self-efficacy in science learning, this study attempted to develop a multi-dimensional science learning self-efficacy (SLSE) instrument to measure 316 Singaporean and 303 Taiwanese eighth graders' SLSE and further to examine the differences between the two student…

Five interrelated papers that explore the theme of validity within the context of cross-national assessments are grouped in this collection. These papers were presented at a symposium at the annual meeting of the American Educational Research Association. These papers draw on data from the Third International Mathematics and Science Study (TIMSS).…

International comparisons in educational research can be difficult to accomplish because the findings of individual countries may not be comparable due to study design or inherent country features that cannot be manipulated. Quantitative meta-analysis techniques have great potential in improving international comparisons. In this paper,…