The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

The purpose of this study was to conduct a conceptual replication of Pendergast et al.'s (2018) study that examined the diagnostic accuracy of a nomogram procedure, also known as a naive Bayesian approach. The specific naive Bayesian approach combined academic and social-emotional and behavioral (SEB) screening data to predict student performance…

Previous studies measured flow states using students' self-reported experiences, resulting in issues regarding nonobjective and nonreal-time data. Thus, this study used an electroencephalogram (EEG) to measure the EEG-detected real-time flow states (EEG-Fs) of 30 students from the 4th and 5th grades. Their EEG measurements, self-reported…

At an international level, teachers' work is increasingly circumscribed and regulated. Notions of accountability have shifted from primarily inputs to primary outcomes, and investment in strengthening teacher performance evaluation has expanded. At the same time, investment in enhancing the quality of teacher education programs is contested in…

This study defines subpopulation item parameter drift (SIPD) as a change in item parameters over time that is dependent on subpopulations of examinees, and hypothesizes that the presence of SIPD in anchor items is associated with bias and/or lack of invariance in three psychometric outcomes. Results show that SIPD in anchor items is associated…

The last two decades have seen fast-moving and wholescale changes in the ways that education is now provided in French schools, in the nature of learner assessment, and in the form and scale of system evaluation. Innovation and reform have in part followed international trends, themselves triggered by the global impact of the international…

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by…

There is no comprehensive database of U.S. district-level test scores that is comparable across states. We describe and evaluate a method for constructing such a database. First, we estimate linear, reliability-adjusted linking transformations from state test score scales to the scale of the National Assessment of Educational Progress (NAEP). We…

This article examines key lessons learned by Russia while developing national assessment system in education. It shows that reforms are more likely to succeed backed with sustained political support, clearly defined goals or priorities, gradual introduction, and open discussion with stakeholders. [This article was translated by Lucy Gunderson.]

It is often assumed that a vertical scale is necessary when value-added models depend upon the gain scores of students across two or more points in time. This article examines the conditions under which the scale transformations associated with the vertical scaling process would be expected to have a significant impact on normative interpretations…

Romania's education system has made impressive strides over the past two decades, with an increasing share of students mastering the basic competencies that they need for life and work. But these average improvements mask significant disparities in learning outcomes and attainment, with an increasing share of students leaving education early…

The commentary (1) uses the U. S. National Assessment of Educational Progress (NAEP) as a prototype for examining standardized reading achievement tests at the item level, and (2) sketches an alternative based on an initiative underway in the United Kingdom.

In accordance with the federal No Child Left Behind (NCLB) law of 2001, 100% of students were expected to become proficient on state assessments of reading and mathematics by the end of 2013-2014 academic year. Schools that consistently failed to meet the NCLB's Adequate Yearly Progress requirements were subject to penalties. In 2011, the U.S.…

This dissertation examines a vital catalyst in the globalization of education: international assessments--that involve testing and rankings--of student achievement in academic subjects. Nearly all high-income countries participate in international assessments such as Trends in International Mathematics and Science Study (TIMSS), Progress in…

This report provides a systematic review and empirical evidence related to the experiences of middle-income countries and economies participating in the Programme for International Student Assessment (PISA), 2000 to 2015. PISA is a triennial survey that aims to evaluate education systems worldwide by testing the skills and knowledge of 15-year-old…