Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

International large-scale assessments have gained much attention since the beginning of the twenty-first century, influencing education legislation in many countries. This includes Spain, where they have been used by successive governments to justify education policy change. Unfortunately, there was a problem with the PISA 2018 reading scores for…

International large-scale assessments provide cross-national data on students' cognitive and non-cognitive characteristics. A critical methodological issue that often arises in comparing data from cross-national studies is ensuring measurement invariance, indicating that the construct under investigation is the same across the compared groups.…

This study aims to develop a valid and reliable achievement test to measure the achievement of eighth-grade students in the "Seasons and Climate" unit of the science course. The research was carried out using a survey model. The study group consists of 298 eighth-grade students studying in various cities in Turkey in the 2020-2021…

This study aims to develop a test to measure sixth grade students' success in 'Circulatory System'. For this purpose, a draft test containing 22 questions was prepared by the researchers. And then, the draft test was submitted to expert opinion and examined in terms of language and content. Following expert opinions, the 22 multiple-choice…

Mathematics modelling is a vital competency for students of all ages. In this study, we aim to fill the research gap about valid and reliable tools for assessing and grading mathematical modeling problems, particularly those reflecting multiple steps of the modelling cycle. We present in this paper the design of a reliable and valid assessment…

Early diagnosis of children with reading disorders is essential for intervention and academic success. Many children with reading difficulties have a deficit in phonemic awareness. A web-based, group-administered screening vehicle, the Risk Factor Screen for Reading (RiFS-Reading), was developed to quickly identify students who are "At…

This study examined the psychometric properties of the Positive and Negative Affect Schedule for Children-Short Form (PANAS-C-SF) in a diverse sample of 15-year-olds in the United States [N = 4382]. Multiple measurement models, including a one-factor model, two-factor orthogonal and oblique models, a three-factor model (PA, Fear, and Distress),…

This study aimed to develop a comprehensive tool to assess underachievement in gifted students, incorporating input from parents, teachers, and students themselves. A total of 285 participants, including 95 gifted students, their parents, and teachers, were involved in the study. The results have revealed a four-factor structure for the Gifted…

This research aims to develop a tool to measure the school readiness of children who will start primary school. Changes have occurred in the primary school starting age following the developments that took part in the Turkish Education System. This change has caused parents to have intense hesitations about enrolling their children in school. As a…

The paper focuses on findings from research that investigated teachers' and key stakeholders' perspectives on the use of Reception Baseline Assessment. Data collection was carried out in 2021-2022, which was the year this assessment was introduced into Reception classes in England. In total, 70 teachers and key stakeholders from 47 Local…

We examined the performance of coefficient alpha and its potential competitors (ordinal alpha, omega total, Revelle's omega total [omega RT], omega hierarchical [omega h], greatest lower bound [GLB], and coefficient "H") with continuous and discrete data having different types of non-normality. Results showed the estimation bias was…

This study aims at identifying the effect of multiple-choice test items' difficulty degree on the reliability coefficient and the standard error of measurement depending on the item response theory IRT. To achieve the objectives of the study, (WinGen3) software was used to generate the IRT parameters (difficulty, discrimination, guessing) for four…

This paper reviews overall student performance as well as the performance of student subgroups on the assessment system developed in response to the Massachusetts Education Reform Act of 1993 (MERA), the Massachusetts Comprehensive Assessment System (MCAS). Comparing students in Massachusetts to students in the rest of the United States or against…

The Content Proximity Project was designed to improve the content validity of the MAP® Growth™ assessments while retaining the ability for the test to adapt off-grade and meet students wherever they are in their learning. Two main features of the project were the development of an enhanced item selection algorithm, and a spring pilot study…