Standard statistical methods are used to analyze data that is assumed to be collected using a simple random sampling scheme. These methods, however, tend to underestimate variance when the data is collected with a cluster design, which is often found in educational survey research. The purposes of this paper are to demonstrate how a cluster design…

The question of least-squares weights versus equal weights has been a subject of great interest to researchers for over 60 years. Several researchers have compared the efficiency of equal weights and that of least-squares weights under different conditions. Recently, S. V. Paunonen and R. C. Gardner stressed that the necessary and sufficient…

The N=1 analysis differs from a typical analysis of variance in that there is no within-cell error term. Thus interaction terms are used as estimates of error variance. If the interaction term in question represents a significant interaction, the F tests will be conservative. Tukey's test for nonadditivity will detect a common form of interaction.…

Large sample standard errors for the Tucker method of linear equating under the common item nonrandom groups design are derived under normality assumptions as well as under less restrictive assumptions. Standard errors of Tucker equating are estimated using the bootstrap method described by Efron. The results from different methods are compared…

A formula is derived for the asymptotic standard error of a true-score equating by item response theory (IRT). The equating method is applicable when the two tests to be equated are administered to different groups along with an "anchor test." Numerical standard errors are shown for an actual equating 1) comparing the standard errors of…

Comparisons were made among various methods of estimating the reliability of pass-fail decisions based on mastery tests. The reliability indices that are considered are p, the proportion of agreements between two estimates, and kappa, the proportion of agreements corrected for chance. Estimates of these two indices were made on the basis of…

This note shows that, under conditions specified by Levin and Subkoviak (TM 503 420), it is not necessary to specify the reliabilities of observed scores when comparing completely randomized designs with randomized block designs. Certain errors in their illustrative example are also discussed. (Author/CTM)

Comments (TM 503 706) on an earlier article (TM 503 420) concerning the comparison of the completely randomized design and the randomized block design are acknowledged and appreciated. In addition, potentially misleading notions arising from these comments are addressed and clarified. (See also TM 503 708). (Author/CTM)

This note continues the discussion of earlier articles (TM 503 420, TM 503 706, and TM 503 707), comparing the completely randomized design with the randomized block design. (CTM)

A two-stage generalized least squares model is developed for estimating the linear regression of an individual outcome on a group characteristic in studies of multilevel data. Results of this model are compared to the results of analytic methods, and formulas are developed for assessing the accuracy of the traditional approaches. (Author/JAZ)

Problems in studying teacher effectiveness through the use of classroom observation are discussed. Four assumptions in the observation of classroom process are offered and ways in which these assumptions can be dealt with in designing an observation study are suggested. (DF)

This paper discusses the basic theory underlying confidence limits and presents reasons why psychologists should incorporate confidence ranges in their psychodiagnostic reports. Four methods for establishing confidence limits are compared. Three of the methods involve estimated true scores, and the fourth is the standard error of measurement…

Presents a table of cases requiring causal modeling or an equivalent technique. Reviews nine years of published research in communication journals to assess the adequacy of analysis in these situations. Offers standards for the conduct and reporting of causal modeling along with a review of their use in published causal modeling. (NKA)

Confirmatory factor analysis was applied to test second- and higher-order factor models in the areas of structure of abilities, allometry, and the separation of specific and error variance estimates. The estimation of validity and reliability, second-order models within factor analysis models, and the concept of discriminability were also studied.…

Computer sampling from a multivariate normal spherical population was used to evaluate the type one error rates for a test of sphericity based on the distribution of the determinant of the sample correlation matrix. (Author/LMO)