This study was an investigation of the relation between the reliability of difference scores, considered as a parameter characterizing a population of examinees, and the reliability estimates obtained from random samples from the population. The parameters in familiar equations for the reliability of difference scores were redefined in such a way…

Grading on the curve is a common practice in higher education. While there are many critics of the practice it still finds wide spread acceptance particularly in science classes. Advocates believe that in large classes student ability is likely to be normally distributed. If test scores are also normally distributed instructors and students tend…

The power functions of Student t tests performed on initial scores, ordinary ranks, 3 kinds of modular ranks, and dichotomies were investigated for 1 normal and 3 nonnormal distributions using 2 samples of 26 simulated scores each. Advantages of extending the rank transformation concept are discussed. (SLD)

Previous research examining the effects of reducing the number of score groups used in the matching criterion of the Mantel-Haenszel procedure, when screening for differential item functioning, has produced ambiguous results. The goal of this study was to resolve the ambiguity by examining the problem with a simulated data set. The main results…

Large-sample standard errors of linear equating for the counterbalanced design are derived using the general delta method. Computer simulations found that standard errors derived without the normality assumption were more accurate than those derived with the normality assumption in a large sample with moderately skewed score distributions. (SLD)

Assuming errors of measurement are distributed binomially, this article reviews various procedures for constructing an interval for an individual's true number-correct score; presents two general interval estimation procedures for an individual's true scale score (i.e., normal approximation and endpoints conversion methods); compares various…

A simple scheme is proposed for smoothly approximating the ability distribution for relatively long tests, assuming that the item characteristic curves (ICCs) are known or well estimated. The scheme works for a general class of ICCs and is guaranteed to completely recover the theta distribution as the test length increases. The proposed method of…

Inference is considered for the marginal distribution of "X" when ("X", "Y") has a truncated bivariate normal distribution. The "Y" variable is truncated, but only the "X" values are observed. A sample of 87 Otis test scores is shown to be well described by this model. (SLD)

Three methods of estimating test score distributions that may improve on using the observed frequencies (OBFs) as estimates of a population test score distribution are considered: the kernel method (KM); the polynomial method (PM); and the four-parameter beta binomial method (FPBBM). The assumption each method makes about the smoothness of the…

A popular method of analyzing test items for differential item functioning (DIF) is to compute a statistic that conditions samples of examinees from different populations on an estimate of ability. This conditioning or matching by ability is intended to produce an appropriate statistic that is sensitive to true differences in item functioning,…