The purpose of this document is to provide information and advice to support states in meeting USED Peer Review Requirements related to demonstrating the comparability of test scores across various devices used for technology-based testing. The document is divided into four main sections. In the first section, we discuss and define the…

Any body of research evolves over time. Previous understandings become more nuanced, ideas are supported or rebuked, and, eventually we arrive at a clearer view of the issue. The research on score comparability across computerized devices is no exception. CCSSO [Council of Chief State School Officers] and the Center for Assessment have published…

The literature on student evaluations of teaching (SETs) generally presents two opposing camps: those who believe in the validity and usefulness of SETs, and those who do not. Some researchers have suggested that 'SET deniers' resist SETs because of their own poor SET results. To test this hypothesis, I analysed essays by 230 SET researchers (170…

In 1881, Donald MacAlister posed a problem in the "Educational Times" that remains relevant today. The problem centers on the statistical evidence for the effectiveness of a treatment based on a comparison between two proportions. A brief historical sketch is followed by a discussion of two default Bayesian solutions, one based on a…

The testing effect is a well-known concept referring to gains in learning and retention that can occur when students take a practice test on studied material before taking a final test on the same material. Research demonstrates that students who take practice tests often outperform students in nontesting learning conditions such as restudying,…

In the present paper, the application of a parametric bootstrap procedure, as described by van de Schoot, Hoijtink, and Dekovic (2010), will be applied to demonstrate that a direct test of an informative hypothesis offers more informative results compared to testing traditional null hypotheses against catch-all rivals. Also, more power can be…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

Online education is rapidly becoming a significant method of course delivery in higher education. Consequently, instructors analyze student performance in an attempt to better scaffold student learning. Learning analytics can provide insight into online students' course behaviors. Archival data from 167 graduate level education students enrolled…

In the spring and fall of 2013, the Center on Education Policy (CEP) convened two meetings of researchers, policymakers, and practitioners to discuss ideas for a more relevant and coordinated research agenda on the Common Core State Standards. Participants in these meetings identified several needs and made a number of thoughtful suggestions. Many…

Teachers need knowledge and skills to make effective use of the growing variety of media and technology texts and tools available for use in elementary and secondary education. For this reason, pedagogical media competencies are highly relevant for teachers' professional development. The theory of media pedagogical competencies is first defined…

Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…

This article describes the ICAP framework that defines cognitive engagement activities on the basis of students' overt behaviors and proposes that engagement behaviors can be categorized and differentiated into one of four modes: "Interactive," "Constructive," "Active," and "Passive." The ICAP hypothesis…

The 2011 study, "Benefits of Practicing 4 = 2 + 2: Nontraditional Problem Formats Facilitate Children's Understanding of Mathematical Equivalence," examined the effects of addition practice using nontraditional problem formats on students' understanding of mathematical equivalence. In nontraditional problem formats, operations appear on…

The ability to purposefully access, reflect, and use evidence from educational research (Educational Research Literacy) is expected of future professionals in educational practice. Based on the presented conceptual framework, a test instrument was developed to assess the different competency aspects: Information Literacy, Statistical Literacy, and…

For almost two decades, there has been growing interest in what design-based research (DBR) can contribute to both educational practice and theory. Since its introduction into the literature, this orientation to educational research has repeatedly been likened to aeronautical engineering as a way to clarify its nature and argue its potential. This…