The utility and interpretation of a coefficient derived by use of the generalizability theory is discussed in this article. Then it is employed to assess the reliability of several school-level variables from the High School and Beyond study. (JD)

Three analyses of pretest and posttest data are considered: (1) posttest only designs; (2) two-way repeated measures of analysis of variance (ANOVA); and (3) one-way analysis of covariance (ANCOVA). Conditions that ensure legitimacy of inferences about the equality of treatment effects on the latent variable theta are discussed. (SLD)

Conditions under which interaction effects estimated from classical total scores, rather than item response theory trait scores, can be misleading are discussed with reference to analysis of variance (ANOVA). When no interaction effects exist on the true latent variable, spurious interaction effects can be observed from the total score scale. (SLD)

Computation of a one-way analysis of variance (ANOVA) "F" ratio from descriptive statistics in the absence of raw data is corrected from two sources. Means associated with inferential statistical hypotheses are identified as estimable population parameters. (Author)

The use of the arc-sine transformation in analysis of variance can lead to difficult inference situations and pose problems in interpretation. It can also produce tests of noticeably lower power when the null hypothesis is false, and is not recommended as a standard tool. Simulated illustrations are provided. (Author/GDC)

Investigates significance tests as a tool for helping to identify real effects in the face of random variation. Speculates that equivalence tests improve the logic of significance testing when demonstrating similarity is important. Reverse tests can help show that failure to reject a null hypothesis does not support that hypothesis. (Contains 30…

Describes a technique for statistically comparing bibliometric models and illustrates its use with two examples using Lotka's hypothesis of author productivity and one example using library circulation frequencies. Topics discussed include nested statistical models, analysis of variance, regression, log-linear models, and the likelihood ratio…

Four measurement designs are presented for use with correlation coefficients corrected, in one variable, for attenuation due to unreliability (partially disattenuated). Associated asymptotic variance/covariance expressions are presented. Empirical simulation results illustrate the satisfactory Type I error control and statistical power of the…

Two analyses of variance (ANOVA) models for item scores are compared. The first is an items by subject random effect ANOVA. The second is a mixed effects ANOVA with items fixed and subjects random. Comparisons regarding reliability, Cronbach's alpha coefficient, psychometric inference, and inter-item covariance structure are made between the…

Variance formulas of H. E. Daniels and M. G. Kendall (1947) are generalized to allow for the presence of ties and variance of the sample tau correlation. Applications of these generalized formulas are discussed and illustrated using data from a 1965 study of contraceptive use in 15 developing countries. (SLD)

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…

This monograph covers the theory, application, and interpretation of both descriptive and inferential statistical techniques in institutional research. Each chapter opens with a hypothetical case study, which is used to illustrate the application of one or more statistical procedures to typical research questions. Chapter 2 covers the comparison…