Technical difficulties and other unforeseen events occasionally lead to incomplete data on educational tests, which necessitates the reporting of imputed scores to some examinees. While there exist several approaches for reporting imputed scores, there is a lack of any guidance on the reporting of the uncertainty of imputed scores. In this paper,…

Item nonresponses are prevalent in standardized testing. They happen either when students fail to reach the end of a test due to a time limit or quitting, or when students choose to omit some items strategically. Oftentimes, item nonresponses are nonrandom, and hence, the missing data mechanism needs to be properly modeled. In this paper, we…

In this article we develop a methodology for the joint value added analysis of multiple outcomes that takes into account the inherent correlation between them. This is especially crucial in the analysis of higher education institutions. We use a unique Colombian database on universities, which contains scores in five domains tested in a…

Many standardized tests are now administered via computer rather than paper-and-pencil format. The computer-based delivery mode brings with it certain advantages. One advantage is the ability to adapt the difficulty level of the test to the ability level of the test taker in what has been termed computerized adaptive testing (CAT). A second…

This article demonstrates the use of a new class of model-free cumulative sum (CUSUM) statistics to detect person fit given the responses to a linear test. The fundamental statistic being accumulated is the likelihood ratio of two probabilities. The detection performance of this CUSUM scheme is compared to other model-free person-fit statistics…

Methods are presented for comparing grades obtained in a situation where students can choose between different subjects. It must be expected that the comparison between the grades is complicated by the interaction between the students' pattern and level of proficiency on one hand, and the choice of the subjects on the other hand. Three methods…

Data from the Center for the Study of Evaluation's Secondary School Test Evaluations were analyzed to explore the present adequacy and propose a future direction of formal procedures for evaluating standardized tests. (Author/RC)

Old socioeconomic data is useful for defining norm samples since a high degree of stability is demonstrated for census data over a 10-year period. (TA)

The standardization method for assessing unexpected differential item performance or differential item functioning is introduced. Findings of five studies are summarized, in which the statistical method of standardization is used to look for unexpected differences in item performance across different subpopulations of the Scholastic Aptitude Test.…

A method for obtaining criterion-references information from standardized tests is proposed. (TA)

While major test publishers randomly select school districts for their national norming studies, a survey of "accepting" and "declining" districts supports the hypothesis that self-selection bias results in overrepresentation of districts which already use a specific publisher's tests or instructional materials. (Author/BW)

Out-of-level'' testing is the assigning of pupils to levels of a standardized test on the basis of previous test scores rather than their present grade assignment. Test results of 1500 children were reviewed to see if their performance supported the rationale behind the practice. (Author/CB)

Six statistical methods for identifying possible sources of bias in standardized test items are presented. The relationship between chi-squared methods and item-response theory methods are also discussed. (Author/BW)