Single-administration procedures for estimating the coefficient of agreement, a reliability index for criterion referenced tests, were recently developed by Subkoviak. The procedures require a distributional assumption for errors of measurement and an estimate of each examinee's true score. A computer simulation of tests composed of items that…

The problem of demonstrating replicability of factor structure across random variables is addressed. Procedures are outlined which combine the use of random subsample replication strategies with the correlations between factor score estimates across replicate pairs to generate a coefficient of replicability and confidence intervals associated with…

A statistical test for cheating is developed. The case of a single examinee who has taken parallel forms of the same selection test on three occasions, obtaining scores x, y, z, is used to illustrate the development. It is assumed that each score is normally distributed with the same known variance, that is, the variance of the errors of…

Four procedures are discussed for obtaining a confidence interval when answer-until-correct scoring is used in multiple choice tests. Simulated data show that the choice of procedure depends upon sample size. (GDC)

A numerical procedure is outlined for obtaining an interval estimate of the regression of true score or observed score, utilizing only the frequency distribution of observed scores. The procedure assumes that the conditional distribution of observed scores for fixed true scores is binomial. Several illustrations are given. (Author/HG)

This study investigated the number-correct scoring method based on different theories (classical true-score theory and multidimensional item response theory) when a standardized test requires more than one ability for an examinee to get a correct response. The number-correct scoring procedure that is widely used is the one that is defined in…

A new model for measuring misinformation is suggested. A modification of Wilcox's strong true-score model, to be used in certain situations, is indicated, since it solves the problem of correcting for guessing without assuming guessing is random. (Author/GK)

A procedure is described for determining the minimal length of a mastery test given certain constraints. The procedure assumes that the testor is indifferent to misclassifying some testees who score within a specified range about the passing score. An example and table are provided. (JKS)

The paradox that a Student t-test based on pretest-posttest differences can attain its greatest power when the difference score reliability is zero was explained by demonstrating that power is not a mathematical function of reliability unless either true score variance or error score variance is constant. (SLD)

Classical test theory findings can be derived from the concepts of conditional expectation, conditional independence, and related notions. It is shown that these concepts provide precisely the formalism needed to obtain the classical results with minimal assumptions and with greatest economy in the methods of proof. (RC)

From a decision theoretic viewpoint, a general coefficient (delta) for tests is derived. The coefficient is applied to three kinds of decision situations. The first situation involves a true score estimated by a function of the observed score of a subject on a test (point estimation). Using the squared error loss function and Kelley's formula for…

To resolve a recent controversy between Klein and Cleary and Levy, a model for dichotomous congeneric items is presented which has mean errors of zero, dichotomous true scores that are uncorrelated with errors, and errors that are mutually uncorrelated. (Author)

Aggregation, or grouping, is a statistical procedure through which all members of a study within a specified range of scores (usually observed scores) are assigned a common or "group" score (for example, the group mean). The various social science methodology literatures agree on the costs of grouping: not only does one always lose…

Ordinal measurement is the rank ordering of individuals in a population. For ordinal measurement, the concept of an individual propensity distribution is his or her true score. Estimation of, as well as other aspects of the distribution, are discussed. (Author/JKS)

The usual formulas for the reliability of differences between two test scores are based on the assumption that the error scores are uncorrelated. Formulas are presented for the general case where this assumption is unnecessary. (Author/JKS)