Module Overview: In this digital ITEMS module, Dr. Jodi M. Casabianca provides a primer on the "hierarchical rater model" (HRM) framework and the recent expansions to the model for analyzing raters and ratings of constructed responses. In the first part of the module, she establishes an understanding of the nature of constructed…

Data mining methods for classification and regression are becoming increasingly popular in various scientific fields. However, these methods have not been explored much in educational measurement. This module first provides a review, which should be accessible to a wide audience in education measurement, of some of these methods. The module then…

There is significant potential for error in long production processes that consist of sequential stages, each of which is heavily dependent on the previous stage, such as the SER (Scoring, Equating, and Reporting) process. Quality control procedures are required in order to monitor this process and to reduce the number of mistakes to a minimum. In…

This National Council on Measurement in Education (NCME) instructional module compares classical test theory and item response theory and describes their applications in test development. Related concepts, models, and methods are explored; and advantages and disadvantages of each framework are reviewed. (SLD)

This module describes some common standard-setting procedures used to derive performance levels for achievement tests in education, licensure, and certification. Upon completing the module, readers will be able to: describe what standard setting is; understand why standard setting is necessary; recognize some of the purposes of standard setting;…

The development and validation of professional development resource materials for teachers by the National Council on Measurement in Education and associated professional groups is described. The developed module contains a context-orienting vignette, instruction, practice exercises, hands-on experiences, small group topics, and homework problems.…

This instructional module presents and illustrates rules for designing performance assessments in a step-by-step strategy through: (1) reason for the assessment; (2) type of performance evaluated; (3) exercises to elicit performance; and (4) systematic rating procedures. Guidelines for maximizing reliability, validity, and economy are presented.…

An instructional module is presented to promote a conceptual understanding of test form equating using traditional methods. Equating is distinguished from scaling. The equating methods described are: (1) mean; (2) linear; and (3) equipercentile. The module includes a self-test. (SLD)

This instructional module discusses the one-, two-, and three-parameter logistic item response theory (IRT) models. Mathematical formulas are given for each model and they are compared, with figures illustrating the effects of changing parameters. A single data set is used to demonstrate the effects of changing parameter values. (SLD)