In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement…

In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

Since the inception of mandated testing in reading and mathematics, social studies instruction has been marginalized in elementary and middle schools. After the genesis of several state-mandated testing programs and nearly a decade after the launch of the No Child Left Behind legislation, the effects of limited K-8 social studies instruction are…

This paper provides a history of ETS's role in developing assessment instruments and psychometric procedures for measuring change in large-scale national assessments funded by the Longitudinal Studies branch of the National Center for Education Statistics. It documents the innovations developed during more than 30 years of working with…

The economic and employment outlook for individuals without a high school diploma is bleak. For many of these individuals, passing the General Educational Development (GED) Test is the first step in competing in the increasingly demanding job market. GED test-taking policies vary across test centers and jurisdictions, and have the potential to…

An evolved form of the Edwards and Beckworth (1989) model for probability selection for Scholastic Achievement Test takers using truncated normal distributions is presented. It is shown that the arguments of Holland and Wainer are not sufficient to reject this model. (SLD)

A model for summarizing test scores and using them to modify instructional programs is presented. The proposed model consists of two types of summaries of the data gathered through standardized tests. The first summary contains individual and single class results. Information in a "Class Item Response Record" chart provides individual student…

An example application of portfolio assessment was developed and the model and estimates of reliability derived from the literature were then used to estimate the characteristics of an operational large-scale portfolio assessment program. Costs were estimated to put results in a realistic context. (SLD)

More attention is currently being paid to the distractors of a multiple-choice test item (Thissen, Steinberg, and Fitzpatrick, 1989). A systematic relationship exists between the keyed response and distractors in multiple-choice items (Levine and Drasgow, 1983). New scoring methods have been introduced, computer programs developed, and research…

Psychometricians continue to develop and evaluate methods for linking test scores, both horizontally and vertically. This article describes a social moderation process for articulating (i.e., linking) performance standards across grade levels for an operational state assessment program. The researchers used generated data to evaluate the likely…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

The major elements of a test interpretation model which would assist school personnel in presenting standardized test information to the public are presented. The model is a prototype based upon the testing program used in the Oakland, California Public Schools. An outline and sequence of the test score presentation are suggested, including notes…

Options are suggested for using and expanding upon the RMC models for evaluating the effectiveness of Title I mastery learning programs with planned high turnover of students. Examples are given of uses of the diagnostic and reporting systems for program planning and decision making. It is suggested that consideration be given to: (1) determining…