With the advent of big data and advances in technology, psychological assessments have become increasingly sophisticated and complex. Nevertheless, traditional psychometric issues concerning the validity, reliability, and measurement bias of such assessments remain fundamental in determining whether score inferences of human attributes are…

This article aims to provide a theoretical framework for computerized adaptive tests (CAT) and item response theory models for polytomous items. Besides that, it aims to introduce the simulation and live CAT software to the related researchers. Computerized adaptive test algorithm, assumptions of item response theory models, nominal response…

About 45 R packages to analyze data using item response theory (IRT) have been developed over the last decade. This article introduces these 45 R packages with their descriptions and features. It also describes possible advanced IRT models using R packages, as well as dichotomous and polytomous IRT models, and R packages that contain applications…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

In the spring and fall of 2013, the Center on Education Policy (CEP) convened two meetings of researchers, policymakers, and practitioners to discuss ideas for a more relevant and coordinated research agenda on the Common Core State Standards. Participants in these meetings identified several needs and made a number of thoughtful suggestions. Many…

This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

This handbook describes the responsibilities of district and school assessment coordinators in the administration of the Pennsylvania System of School Assessment (PSSA). This updated guidebook contains the following sections: (1) General Assessment Guidelines for All Assessments; (2) Writing Specific Guidelines; (3) Reading and Mathematics…

In recent years there have been increasing efforts to use accountability systems based on large-scale tests of students as a mechanism for improving student achievement. The federal No Child Left Behind Act (NCLB) is a prominent example of such an effort, but it is only the continuation of a steady trend toward greater test-based accountability in…

The National Assessment of Educational Progress (NAEP) is a continuing and nationally representative assessment of what this nation's students know and can do. NAEP has often been called the "gold standard" of assessments because it is developed using the best thinking of assessment and content specialists, education experts, and…

This book meets a demand in the science education community for a comprehensive and introductory measurement book in science education. It describes measurement instruments reported in refereed science education research journals, and introduces the Rasch modeling approach to developing measurement instruments in common science assessment domains,…

Research evidence indicates that formative assessment is one of the most effective ways of enhancing student learning. It is, however, difficult to implement successfully, principally because what is tested through summative assessment has such a powerful influence on teacher and student actions. This book scrutinizes the relationship between…

The purpose of this paper is to identify and discuss some of the problems presented by the use of computerized adaptive testing (CAT) in an instructional programs environment versus large scale testing applications, and to describe an actual implementation of CAT in an instructional programs setting. This particular application is in the…

The 3D cube figures used by Shepard and Metzler [Shepard, R. N., & Metzler, J. (1971). "Mental rotation of three-dimensional objects." "Science," 171, 701-703] have been applied in a broad range of studies on mental rotation. This note provides a brief background on these figures, their general use in cognitive psychology and their role in…

This paper examines long-range problems caused by test-controlled schooling. It looks at the demands of both curricular and accountability uses of tests from the point of view of the urban school district's testing office. On the basis of interviews with 12 New Orleans teachers and the experiences of the authors in working in two large city…

Careful management of a testing program can greatly limit a teacher's opportunity to cheat while administering standardized tests to students and can increase the likelihood that such cheating will be detected. The Austin Independent School District's systemwide testing staff's plan for controlling cheating has three basic premises: (1) plan and…