Based on a review of the literature, this paper examines criticisms leveled against the communication audit developed by the International Communication Association (ICA) and then offers a modified version of the audit designed to meet those criticisms. Following a brief introduction, the first section of the paper reviews criticisms of the audit,…

This paper evaluates the magnitude of the total error in estimates of the difference between an examinee's domain score and the cutoff score. An observed score based on a random sample of items from the domain, and an estimated cutoff score derived from a judgmental standard setting procedure are assumed. The work of Brennan and Lockwood (1980) is…

In January 1982, the College Board and Educational Testing Service implemented a technical change in the procedures used to equate scores on the Scholastic Aptitude Test (SAT). For previous editions of the SAT, a linear equating procedure was used to establish the comparability of scores on different editions. Beginning in January 1982, this…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

The reliability of a criterion referenced test was defined as a measure of the degree to which the test discriminates between an individual's level of performance and a predetermined criterion level. The variances of observed and true scores were defined as the squared deviation of the score from the criterion. Based on these definitions and the…

Examined stability of the Kaufman Assessment Battery for 53 at-risk preschool children. Over 9 months the stability coefficients for the global scales ranged from .78 to .88, and for the subtests from .65 to .79. Concluded that scores display adequate stability, but the Simultaneous scale is less stable than the Sequential or Achievement scales.…

This study examined three statistical methods for selecting items for mastery tests: (1) pretest-posttest; (2) latent trait; and (3) agreement statistics. The correlation between the latent trait method and agreement statistics, proposed here as an alternative, was substantial. Results for the pretest-posttest method confirmed its reputed…

Methods of estimating the standard error at different ability levels were compared. Overall, it was found that at a given ability level the standard errors calculated using different formulas are not appreciably different. Further, for most situations the traditional method of calculating a standard error probably provides sufficient precision.…

This article investigates positional response bias, testwiseness, and guessing strategy as components of variance in test responses on multiple-choice tests. University students responded to two content exams, a testwiseness measure, and a guessing strategy measure. The proportion of variance in test scores accounted for by positional response…

Asymptotic formulas are derived for the bias in the maximum likelihood estimators of the item parameters in the logistic item response model when examinee abilities are known. Numerical results are given for a typical verbal test for college admission. (Author)

On the basis of the characteristics of criterion-referenced tests, the contribution of German research to the development and application of criterion-referenced tests is discussed. (PN)

Educational assessments that exploit advances in technology and cognitive psychology can produce observations and pose student models that outstrip familiar test-theoretic models and analytic methods. Bayesian inference networks (BINs), which include familiar models and techniques as special cases, can be used to manage belief about students'…

The unique conceptual framework and language of generalizability theory are presented. While this chapter is relevant to any area in which generalizability theory is applicable, it emphasizes evaluation research, and most examples come from that area. (Author/PN)

The high failure rate of Black prospective teachers in the southern states raises the challenge to change the quality of education for all Americans. (MLF)

Discusses use of item banks in preparing local tests, using as an example the construction of a college mathematics placement test. Compares recommended placements with course results at the end of the quarter. Students who placed themselves above recommendation did better than expected, perhaps because of strong self-selection factors. (PAS)