Twenty Monte Carlo studies on multiple comparison (MC) techniques were conducted to examine which MC technique was the "method of choice." The results from these studies had several apparent contradictions when different techniques were investigated under varying sample size and variance conditions. Box's coefficient of variance…

An alternative derivation of Tryon's basic formula for the coefficient of domain validity or the coefficient of generalizability developed by Cronbach, Rajaratnam, and Glaser is provided. This derivation, which is also the generalized Kuder-Richardson coefficient, requires a relatively minimal number of assumptions compared with that in previously…

An empirical sampling study investigated six procedures for testing differences between means in the presence of unequal n's and variances. Support was obtained for previous research which found t robust to heterogeneous variances only when n's are equal and of moderate size. The procedure which emerged as providing the best control over Type I…

This study investigated the effects of non-normality of the marginal distributions of the bivariate surface upon the sampling distribution of certain tests of significance of differences for the product moment correlation coefficient. The effects of non-normality were found to be rather substantial and to be dependent upon: 1) the degree of…

Results indicate that scale values can be approximated satisfactorily through item-examinee sampling. Defining one observation as the response made by one examinee to one item, the similarity between the estimated scale values and normative scale values increased generally with increases in the number of observations acquired by the sampling plan.…

This article presents a fairly quick, easy way to decide what size sample is needed for a survey, given a desired level of confidence and degree of accuracy. The method proposed will work on any multiple response instrument. A technical mathematical explanation is also included. (GK)

The distributional characteristics of Kaiser's Measure of Sampling Adequacy (MSA) were investigated in sample matrices generated from multivariate normal populations of specified correlation levels. Systematic variation of sample size and number of variables revealed the overall MSA to be most influenced by the number of variables. (Author/JKS)

Two studies, both using Type 12 sampling, are presented in which the effects of violating the assumption of essential parallelism in setting confidence intervals are studied. Results indicate that as long as data manifest properties of essential parallelism, the two methods studied maintain precise Type I error control. (SLD)

The sample invariant properties of five anchor test equating methods are addressed. Equating results across two sampling conditions--representative sampling and new-form matched sampling--are compared for Tucker and Levine equally reliable linear equating, item response theory true-score equating, and two equipercentile methods. (SLD)

An approximate statistical test of the equality of two intraclass reliability coefficients based on the same sample of people is derived. Such a test is needed when a researcher wishes to compare the reliability of two measurement procedures, and both procedures can be applied to results from the same group. (SLD)

A sequential design utilizing identical samples was used to classify mixed methods studies via a two-dimensional model, wherein sampling designs were grouped according to the time orientation of each study's components and the relationship of the qualitative and quantitative samples. A quantitative analysis of 121 studies representing nine fields…

At present, although the percentages of students with disabilities (SDs) and/or students who are English language learners (ELL) excluded from a NAEP administration are reported, no statistical adjustment is made for these excluded students in the calculation of NAEP results. However, the exclusion rates for both SD and ELL students vary…