The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

At an international level, teachers' work is increasingly circumscribed and regulated. Notions of accountability have shifted from primarily inputs to primary outcomes, and investment in strengthening teacher performance evaluation has expanded. At the same time, investment in enhancing the quality of teacher education programs is contested in…

On international comparisons, the development of Oman's education system in terms of the increase in educational enrolment rates and in the level of teacher qualifications has been remarkably rapid. Almost 100% access to basic education has been achieved, and almost all students progress onto post-basic education. A report from the World Bank in…

The last two decades have seen fast-moving and wholescale changes in the ways that education is now provided in French schools, in the nature of learner assessment, and in the form and scale of system evaluation. Innovation and reform have in part followed international trends, themselves triggered by the global impact of the international…

In this article I advocate for a new discussion in the field of international large-scale assessments; one that calls for a reexamination of international large-scale assessments (ILSAs) and their use. Expanding on the high-quality work in this special issue I focus on three inherent limitations to international large-scale assessments noted by…

This article examines key lessons learned by Russia while developing national assessment system in education. It shows that reforms are more likely to succeed backed with sustained political support, clearly defined goals or priorities, gradual introduction, and open discussion with stakeholders. [This article was translated by Lucy Gunderson.]

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

Romania's education system has made impressive strides over the past two decades, with an increasing share of students mastering the basic competencies that they need for life and work. But these average improvements mask significant disparities in learning outcomes and attainment, with an increasing share of students leaving education early…

International large-scale assessments of achievement often have a large degree of differential item functioning (DIF) between countries, which can threaten score equivalence and reduce the validity of inferences based on comparisons of group performances. It is important to understand potential sources of DIF to improve the validity of future…

This dissertation examines a vital catalyst in the globalization of education: international assessments--that involve testing and rankings--of student achievement in academic subjects. Nearly all high-income countries participate in international assessments such as Trends in International Mathematics and Science Study (TIMSS), Progress in…

The purpose of the present study was to examine validity aspects of teachers' judgements of pupils' reading skills. Data come from Sweden's participation in the Progress in International Reading Literacy Study (PIRLS) 2001, for Grades 3 and 4. For pupils at the same achievement levels, as measured by PIRLS 2001 test, teachers' judgements of…

This study, through multilevel analyses of the data of four English-speaking nations (i.e., Canada, England, New Zealand and the United States) from the Progress in International Reading Literacy Study (PIRLS) 2001 database, investigated the relationship between teachers' uses of various types of classroom assessments and their fourth-graders'…

In international achievement studies, questionnaires typically ask about the presence of particular household assets in students' homes. Responses to the assets questions are used to compute a total score, which is intended to represent household wealth in models of test performance. This study uses item analysis and confirmatory factor analysis…

This report provides a systematic review and empirical evidence related to the experiences of middle-income countries and economies participating in the Programme for International Student Assessment (PISA), 2000 to 2015. PISA is a triennial survey that aims to evaluate education systems worldwide by testing the skills and knowledge of 15-year-old…