The Adequate Yearly Progress (AYP) Model has been used to make many high-stakes decisions concerning schools, though it does not provide a complete assessment of student academic achievement and school effectiveness. To provide a clearer perspective, many states have implemented various Growth and Value Added Models, in addition to AYP. The…

An approach to scoring reading comprehension based on the concept of the testlet is described, using models developed for items in multiple categories. The model is illustrated using data from 3,866 examinees. Application of testlet scoring to multiple category models developed for individual items is discussed. (SLD)

To determine if Rasch Model procedures have any utility for equating pre-existing tests, data from the equating phase of the Anchor Test Study (ATS) were reanalyzed. This management report summarizes the work completed in the project, describes the differences in this project and that of the ATS, and presents recommendations and conclusions to the…

For many reasons, students do not always perform on tests in ways that are congruent with their true abilities or achievement levels. Problems of this sort may be especially common on Title I evaluations where the tests administered are too difficult for a large percentage of the students. Such considerations raise the questions of whether…

A comparison was made between four different scoring procedures for the 45-item Reading Comprehension subtest, Level I, of the Comprehensive Test of Basic Skills, Form S, for a sample of 1,000 third grade students. These students were selected to have been among those who omitted from 3 to 22 of the 45 items. Another representative sample of 1,300…

The one parameter latent trait theory of Georg Rasch has two assumptions: that student abilities can be measured on an equal interval scale, and that the success of a student with a given item is a function of student achievement and item difficulty. The grade four Michigan Educational Assessment Program reading test was designed to measure…

National Assessment of Educational Progress reading data were scaled using a unidimensional item response theory model. Bock's full-information factor analysis and Rosenbaum's test of unidimensionality were applied. Conclusions about unidimensionality for balanced incomplete block spiralled data were the same as for complete data. (Author/GDC)

The validity of the equipercentile hypothesis of the Title I Evaluation and Reporting System norm-referenced evaluation model was examined using 3,224 seventh- and ninth-grade students. Findings from confidence interval procedures contradicted the equipercentile hypothesis. There was a pattern of large gains for students not receiving any special…

The Rasch model was used to equate reading comprehension tests of widely different difficulty for three groups of fifth grade students of widely different ability. Under these extreme circumstances, the Rasch model equating was unsatisfactory. (Author/CTM)

A logistic model was used to generate data to serve as a proxy for an immediate retest from item responses to a fourth grade standardized reading comprehension test of 45 items. Assuming that the actual test may be considered a pretest and the proxy data may be considered a retest, the effect of regression was investigated using a percentage of…

The Rasch model is described as a latent trait model which meets the five criteria that characterize reasonable and objective measurements of an individual's ability independent of the test items used. The criteria are: (1) calibration of test items must be independent of particular norming groups; (2) measurement of individuals must be…

The psychometric research done by G. Rasch between 1951 and 1959, which is explained and illustrated in this book, takes psychometrics from being purely descriptive to being a science of objective measurement. Individual centered statistics require models in which each individual is characterized separately and from which, given adequate data,…

The purpose of this study was to determine which equating models are appropriate for the Alabama High School Graduation Examination (AHSGE) by equating two previously administered fall forms for each subject area of the AHSGE and determining whether differences exist in the test score distributions or passing scores resulting from the equating…

This study investigated the adequacy of the Rasch model in equating existing standardized tests with groups of examinees not widely separated in ability. With the exception of one test pair and one grade level, the Rasch model using the anchor test procedure provided a reasonably satisfactory means of equating. (Author/CTM)

Though item bias statistics are widely recommended for use in test development and analysis, problems arise in their interpretation. This research evaluates logistic test models and computer simulation methods for providing a frame of reference for interpreting item bias statistics. Specifically, the intent was to produce simulated sampling…