Background/Context: Impact evaluations of schooling reforms in developing countries typically focus on tests of student achievement that are designed and implemented by researchers. Are these tests any good? What practical and principled guidance should researchers in the field follow? We aim to answer these questions. Test scores have, of course,…

In this essay, we describe the construction and use of the Cut-Score Operating Function in aiding standard setting decisions. The Cut-Score Operating Function shows the relation between the cut-score chosen and the consequent error rate. It allows error rates to be defined by multiple loss functions and will show the behavior of each loss…

This chapter gives an overview of the design and statistical and psychometric analysis methods of the National Assessment of Educational Progress (NAEP). The evolution of the NAEP continues to provide challenges to statisticians and psychometricians, as demonstrated in the expansion of the NAEP to the assessment of individual states. (SLD)

Some unresolved methodological and philosophical issues in the assessment of performance trends are discussed as they relate to the National Assessment of Educational Progress (NAEP). How to measure performance change while remaining responsive to advances in curriculum and the technology of assessment is a central dilemma. (SLD)

Data from 10,000 17-year-old respondents to the National Assessment of Educational Progress (NAEP) 1975-76 Special Mathematics Probe (Basic Mathematics Assessment) were analyzed. The primary purpose was to identify respondents' background characteristics associated with basic mathematics achievement. The achievement items and 241 background…