This study explores classification consistency and accuracy for mixed-format tests using real and simulated data. In particular, the current study compares six methods of estimating classification consistency and accuracy for seven mixed-format tests. The relative performance of the estimation methods is evaluated using simulated data. Study…

We examined how ACT® Aspire® (from grades 8 to 10), PreACT® (from grade 10), and ACT® test scores (from grades 10 and 11) relate to students' chances of scoring a 3 or higher as well as 4 or higher on selected Advanced Placement (AP) exams. Data for the study was available for 49,220 students from 318 high schools who had taken at least one AP…

The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

Scores on the multiple-choice sections of alternate forms are equated through anchor-test equating for the Advanced Placement Program (AP) examinations. There is no linkage of free-response sections since different free-response items are given yearly. However, the free-response and multiple-choice sections are combined to produce a composite.…