Precise item categorisation is essential in aligning exam questions with content domains outlined in assessment blueprints. Traditional methods, such as manual classification or supervised machine learning, are often time-consuming, error-prone, or limited by the need for large training datasets. This study presents a novel approach using…

Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for…

Combining methods from earlier content validity and more contemporary content alignment studies may allow a more complete evaluation of the meaning of test scores than if either set of methods is used on its own. This article distinguishes item relevance indices in the content validity literature from test representativeness indices in the…

A common belief underlying the dimensional comparison theory is that reading self-concept has a positive relation to reading achievement but a negative relation to math achievement. However, this belief is incomplete and potentially misleading as supporting evidence is usually derived from studies without simultaneously considering the mediated…

In this investigation, we examined differences in performance on the Texas state-mandated reading assessment for Emergent Bilingual students by their economic status (i.e., in poverty, not in poverty). Archival data were obtained from the Texas Education Agency Public Education Information Management System for Grade 8 students for the two…

Globalization and its impact on contemporary societies have gained new impetus with the notions of global citizenship education (GCED) and education for sustainable development (ESD), considered, together with civic and citizenship education (CCE), as a means for promoting students' engagement in global/local issues and providing them with the…

This study investigates the effect of survey order in measuring self-reported cognitive load. Understanding how survey order influences responses is crucial, but it has been largely overlooked in the context of cognitive load. Using a 2 × 2 experimental design with 319 high school students, the study manipulated intrinsic cognitive load (ICL)…

Background: Theoretical frameworks excel in conceptualising reading literacy, yet their value hinges on their applicability for real-world purposes, such as assessment. By combining diverse theoretical frameworks, the Programme for International Student Assessment (PISA) 2018 designed an assessment framework for assessing the reading literacy of…

ChatGPT, an artificial intelligence powered chat tool that accomplishes essential work with its language understanding and text generation capabilities, has started to benefit education and many other areas with new updates. This study predicted the ability to create a number sense achievement test with ChatGPT version 3.5. It showed that the test…

Students change their responses during tests, and these revisions are often correct. Some studies have suggested that decisions regarding revisions are informed by metacognitive monitoring. We investigated whether assessing and reporting response confidence increases the accuracy of revisions and the final test score, and whether confidence in a…

Universal screening in reading is a common, and often required, practice in early elementary school. Computer-adaptive screening tools, such as "Istation's Indicators of Progress-Early Reading" (ISIP-ER), are often chosen for this purpose in schools. In our present study, we examine the validity evidence between the ISIP-ER in…

Stratification is an important design feature of many studies using complex sampling designs and it is often used in large-scale assessment (LSA) studies, such as the "Programme for International Student Assessment" (PISA), for two main reasons. First, stratification variables that achieve a high between and low within strata variance…

The Programme for International Student Assessment (PISA) has instigated educational changes and reforms globally, in particular, introducing and intensifying neoliberal logic and governance in test-taking countries and beyond. PISA outcome impacted upon the educational governance of South Korea as well, however, the changes deviated from what…

Positive teacher feedback plays a crucial role in student learning. While previous studies on positive teacher feedback have primarily focused on its relationship with student achievement, much less attention has been given to how such feedback associates with student self-efficacy, particularly reading self-efficacy--a key predictor of both…

This study examined the adherence of Senior High School teachers to the principles of test construction, administration, and scoring. Achievement tests play a critical role in assessing student learning and guiding instructional decisions, yet challenges in their effective implementation persist. Using a descriptive research design, data were…