Under the assumption of normalcy, a formula is derived for the reliability of the maximum score. It is shown that the maximum score is more reliable than each of the single observations but less reliable than their composite score. (Author/LMO)

Most currently used measures of inter-rater agreement for the nominal case incorporate a correction for "chance agreement." The definition of chance agreement is not the same for all coefficients, however. Three chance-corrected coefficients are Cohen's Kappa; Scott's Pi; and the S index of Bennett, Goldstein, and Alpert, which has…

Psychometricians working in factor analysis and econometricians working in regression with measurement error in all variables are both interested in the rank of dispersion matrices under variation of diagonal elements. This paper reviews both fields; points out various small errors; and presents a methodological comparision of factor analysis and…

Determination of statistical power for analysis of variance procedures requires five elements: (1) significance level; (2) effect size; (3) number of means; (4) error variance; and (5) sample size. Significance levels are traditionally chosen to be 0.5, .01, or .001. Effect size is not discussed in this paper. The number of means is determined by…

The mixed model analysis of variance assumes a mathematical property known as sphericity. Several preliminary tests have been proposed to detect departures from the sphericity assumption. The logic of the preliminary testing procedure is to conduct the mixed model analysis of variance if the preliminary test suggests that the sphericity assumption…

Meta-analysis has become an important supplement to traditional methods of research reviewing, although many problems must be addressed by the reviewer who carries out a meta-analysis. These problems include identifying and obtaining appropriate studies, extracting estimates of effect size from the studies, coding or classifying studies, analyzing…

This report is about the problem of making transition or enrollment rate gains comparable. It is shown that measures based on the proportions themselves, i.e. the difference between proportions, the proportion ratio and the residual gain ratio do not make the gains comparable. Instead a non-linear transformation has to be done. Two such…

An equating design in which two groups of examinees from slightly different populations are administered a different test form with a subset of common items is widely used. This paper presents standard errors and a simulation that verifies the equation for large samples for an equipercentile equating procedure for this design. (Author/BS)

In research, data sets often occur in which the variance of the distribution of the dependent variable at given levels of the predictors is a function of the values of the predictors. In this situation, the use of weighted least-squares (WLS) or techniques is required. Weights suitable for use in a WLS regression analysis must be estimated. A…

This paper is part of a series of applied statistics monographs intended to provide supplementary reading for applied statistics students. In the present paper, derivations of the unbiased standard error of estimate for both the raw score and standard score linear models are presented. The derivations for raw score linear models are presented in…

Statistical methodologists have sometimes criticized the use of conventional statistics in meta-analysis, and in recent years a number of them have advocated the use of a special new statistical methodology for research synthesis. An examination of recent books describing this methodology shows that it is seriously limited in its applicability to…

This study examined how four commonly used test equating procedures (linear, equipercentile, Rasch Model, and three-parameter) would respond to situations in which the properties or the two tests being equated were different. Data for two tests plus an external anchor test were generated from a three parameter model in which mean test differences…

Six models for evaluating change are examined via a Monte Carlo study. All six models show a lack of power. A modified analysis of variance procedure is suggested as an alternative. (JKS)

This Monte Carlo study examined the validity of the chi-square test for model evaluation in different instances of misspecification and sample size. The usefulness of the chi-square difference statistic to compare competing structures and improvement in fit is also addressed. (Author/BS)

LISREL-type structural equation modeling is a powerful statistical technique that seems appropriate for social science variables which are complex and difficult to measure. The literature on the specification, estimation, and testing of such models is voluminous. The greatest proportion of this literature, however, focuses on the technical aspects…