Standard-setting methods are widely used to determine cut scores on a test that examinees must meet for a certain performance standard. Because standard setting is a measurement procedure, it is important to evaluate variability of cut scores resulting from the standard-setting process. Generalizability theory is used in this study to estimate…

This article addresses the characterization and circumvention of E. H. Simpson's paradox in designs involving two ordered variables and illustrates the recommended procedure using a two-sample application involving estimation of correlation and a single-subject application involving the estimation of lag(1) autocorrelation. (Author/SLD)

It is suggested that Levy's procedure for testing predicted trends in independent correlations should not produce grossly incorrect inferences when one is dealing with the sorts of correlations which are ordinarily encountered in empirical research. (Author/JKS)

lllustrates a link between the multiple-rater kappa of J. Fleiss (1971) or other analogues and the generalizability (G) coefficient for a single facet design, and discusses the use and interpretation of G theory in the study of interrater agreement when data are measured on a nominal scale. (SLD)

Examined Type I error rates and power for four tests for treatment control studies in which a larger treatment mean may be accompanied by a larger treatment variance and examined these aspects of the independent samples "t" test and the Welch test. Evaluated each test and suggested conditions for the use of each approach. (SLD)

Comparison of six procedures to test for location equality among two or more groups when population variances are heterogeneous suggests that, when the variance homogeneity and normality assumptions are not satisfied, and the design is unbalanced, the use of any of these test statistics with the usual least squares estimators is not recommended.…

A linear structural model for comparing quasi-Markov models across populations is demonstrated. A confirmatory factor analysis formulation of the simplex model is also developed for between group comparisons. A variety of possible applications of this approach are suggested. (Author)

Presents a procedure for determining the optimal number of conditions to use in multifaceted measurement designs when resource constraints are imposed. The procedure is illustrated for the case in which the costs per condition vary within the same facet. (Author)

The superiority of multiwave designs over two-wave designs in the measurement of individual growth and change is explored by examining the increase in reliability afforded by collecting additional waves of data. Results are discussed in terms of the impact on longitudinal studies of individual change. (SLD)

A methodology is presented for minimizing the mean error variance-covariance component in studies with resource constraints. The method is illustrated using a one-facet multivariate design. Extensions to other designs are discussed. (SLD)

A methodology for determining the optimal number of observations to use in a measurement design when resource constraints are imposed is presented. Two- and three-facet designs are outlined. Parallel closed form formulae can easily be determined for other designs. (TJH)

An efficient search procedure is presented for determining the optimal number of observations of facets in a design that maximize generalizability when resource constraints are imposed. The procedure is illustrated for three-facet and four-facet designs, with extensions for other configurations. (Author/SLD)

This paper delineates conditions under which the use of change scores will not produce misleading results, and may perhaps be preferable to other methods of analysis. The validity of change scores in randomized pretest-posttest designs is discussed along with situations where analysis of change scores should be used. (Author/GK)

A method is presented for determining the optimal number of conditions to use in measurement designs when resource constraints are imposed. The method is illustrated using a multivariate two-facet design, and extensions to other designs are discussed. (SLD)

This article argues that the 1981 work of Carbno presented unwarranted conclusions because its design included an improper operationalization of the object of measurement, given the problems addressed, and because the sample sizes employed were too small. (Author/PN)