International large-scale assessments (ILSA) are an important source of information for education policymakers across the globe. Despite sponsors' warnings, when results are published, media attention focuses on country rankings and changes in scores. Score changes are evaluated using a two-sided z-statistic, with statistical significance declared…

A school's emphasis on academic success (SEAS) is a crucial aspect of school climate that can be rated by different informants, such as teachers or principals, and with respect to their perception of different groups' emphasis on academic success, such as parents or students. We know little about whether there is agreement between these ratings.…

When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated, particularly regarding their application at different levels of the model. Yet, no consensus has been reached on the best…

Background: Artificial intelligence (AI) is rapidly changing communication and technology-driven content creation and is also being used more frequently in education. Despite these advancements, AI-powered automated scoring in international large-scale assessments (ILSAs) remains largely unexplored due to the scoring challenges associated with…

Background: In recent years, data derived from international large-scale assessments have significantly influenced the discourse surrounding educational equity. However, the use of such data has often neglected the full spectrum of dimensions that equity encompasses, while being limited to exploring the relationship between achievement variations…

This paper extends existing work on teacher weighting in student-centered surveys by looking into aspects of practical implementation of deriving and using weights for teacher-centered analysis in the Trends in International Mathematics and Science Study (TIMSS) and the Progress in International Reading Literacy Study (PIRLS). The formal…

In low-income countries, there exists a common concern about the effect of hunger and food insecurity on educational outcomes. However, income inequalities, economic slowdown, conflict, and climate change have raised those concerns globally. Yet, little is known about how widespread the problem of hunger in schools is worldwide. This study…

Background: A solid foundation in science is critical to students' success in the 21st century workforce, especially in fields related to science, technology, engineering, and mathematics (STEM). Therefore, high-quality science education is critical to prepare students for the challenges of the future. However, Emirati students have consistently…

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

Background: Stakeholders' interpretations of the findings of large-scale educational assessments can influence important decisions. In the context of educational assessment, standard-setting remains an especially critical element, because it is complex and largely unstandardized. Instruments established by means of standard-setting procedures such…

This study investigated the status of equity in mathematics education in Hong Kong based on data from TIMSS 2011 to 2019 and the changes in education equity across the three cycles. The effects of various student-, family-, and school-level variables on students' mathematics achievement were examined and compared using multilevel modeling. Results…

School-level inefficiencies and mismanagement can have serious repercussions for human resource development and labor market outcomes. This paper investigates the extent and consequences of existing technical inefficiency of schools with respect to their resource- and people-management aspects at a cross-country level across Organisation for…

Background: Socioeconomic characteristics are persistently and systematically related to academic outcomes, despite long-standing efforts to reduce educational inequality. Ireland has a strong policy focus on alleviating educational disadvantage and has seen significant improvements in mathematics and science performance in recent years. This…

In cognitive diagnosis assessment (CDA), the impact of misspecified item-attribute relations (or "Q-matrix") designed by subject-matter experts has been a great challenge to real-world applications. This study examined parameter estimation of the CDA with the expert-designed Q-matrix and two refined Q-matrices for international…

A general validity and survey quality concern with student questionnaires under low-stakes assessment conditions is that some responders will not genuinely engage with the questionnaire, often with more random response patterns as a result. Using a mixture IRT approach and a meta-analytic lens across 22 educational systems participating in TIMSS…