The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

This paper extends existing work on teacher weighting in student-centered surveys by looking into aspects of practical implementation of deriving and using weights for teacher-centered analysis in the Trends in International Mathematics and Science Study (TIMSS) and the Progress in International Reading Literacy Study (PIRLS). The formal…

Focusing on the variables that can affect both academic achievement and the well-being of students has been crucial for their development, making schools effective and designing educational policy as well as curriculum. The study has aimed to investigate the effect of peer bullying on academic achievement and to determine moderators in the…

In this article, we extend Liao's test for across-group comparisons of the fixed effects from the generalized linear model to the fixed and random effects of the generalized linear mixed model (GLMM). Using as our basis the Wald statistic, we developed an asymptotic test statistic for across-group comparisons of these effects. The test can be…

International Large-Scale Assessments (ILSAs) have had significant impact on education policy across the globe. But has interest in ILSAs now started to wane? This paper presents new evidence on this issue, exploring how the amount of attention three major ILSAs receive compares across countries, between studies and over time. Using information on…

In international large-scale assessments, students may not be compelled to answer every test item: a student can decide to skip a seemingly difficult item or may drop out before the end of the test is reached. The way these missing responses are treated will affect the estimation of the item difficulty and student ability, and ultimately affect…

The Progress in International Reading Literacy Study (PIRLS) has been monitoring international trends in reading achievement among fourth-grade students for 25 years. As a critical point in a student's education, the fourth year of schooling establishes the foundations of literacy, with reading becoming increasingly central to learning across all…

Over the past three decades Australia has developed an increasingly advanced national system of student assessments, results from which have been used to identify areas of growth, stagnation or decline in student learning. For the most part, trends in different standardised assessments have been considered in isolation. By examining literacy and…

This paper informs users of data collected in international large-scale assessments (ILSA), by presenting argumentsunderlining the importance of considering two design features employed in these studies. We examine a commonmisconception stating that the uncertainty arising from the assessment design is negligible compared with that arisingfrom the…

Engagement in digital reading assessments has been underexplored in spite of its importance for assessment and instructional design. In this study, we used different engagement indicators in two ePIRLS tasks (n[subscript 1] = 14,324, n[subscript 2] = 15,026) to identify engagement profiles, and interpreted them using the three-dimensional model of…

Standardised International Large-Scale Assessments (ILSAs) have gained prominence in global and national educational discussions. ILSAs claim to offer valuable insights for improving education systems, but their impact on educational policy varies and has become a contested arena. This article analyses how these assessments fed educational…

The participation of countries in various international large-scale assessments (ILSA) is motivated by different factors. In recent years however, there has been a growing popularity and importance placed on the results of ILSA. Recognising the significance of ILSA as a valuable source of feedback for enhancing the basic education system, the…

Students living in poverty tend to perform worse in school than their peers from better-off families. This paper examines whether computer availability helps narrow down educational inequalities in Slovakia, using TIMSS and PIRLS data. The results show that computer availability in reading lessons improves reading scores and that the effect is…

Questionnaire scales that are mixed-worded, i.e. include both positively and negatively worded items, often suffer from issues like low reliability and more complex latent structures than intended. Part of the problem might be that some responders fail to respond consistently to the mixed-worded items. We investigated the prevalence and impact of…