A jack knife is a pocket knife that is put to many tasks, because it's ready to hand. Often there could be a better tool for the job, such as a screwdriver, a scraper, or a can-opener, but these are not usually pocket items. In statistical terms, the expression implies making do with what's available. Another simile, of an extreme situation, is…

Adjustment methods such as propensity scores and analysis of covariance are often used for estimating treatment effects in nonexperimental data. Shadish, Clark, and Steiner used a within-study comparison to test how well these adjustments work in practice. They randomly assigned participating students to a randomized or nonrandomized experiment.…

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

The technique of generalizing sample results in a classification study to large subpopulations of unequal sizes was examined. The usual output from the discriminant analysis routine in the Statistical Package for the Social Sciences was extended to handle the present statistical problems. Advantages of the technique were discussed. (Author/DWH)

A formula for determining sample size, which originally appeared in 1960, has lacked a table for easy reference. This article supplies a graph of the function and a table of values which permits easy determination of the size of sample needed to be representative of a given population. (DG)

Kelly's formula estimates sampling variance of correlation corrected for attenuation by using split-half reliabilities. In some cases, coefficient alpha estimate of reliability is preferable. A simulation study suggests a variation of Kelly's formula can be used appropriately with coefficient alpha. Kelly's formula is modified to accept…

Researchers are often in a dilemma as to whether parametric or nonparametric procedures should be cited when assumptions of the parametric methods are thought to be violated. Therefore, the Kruskal-Wallis test and the ANOVA F-test were empirically compared in terms of probability of a Type I error and power under various patterns of mean…

In the present study Monte Carlo methods were employed to evaluate the degree to which canonical function and structure coefficients may be differentially sensitive to sampling error. Sampling error influences were investigated across variations in variable and sample (n) sizes, and across variations in average within-set correlation sizes and in…

The amount of variance accounted for by treatment can be estimated with omega squared or with the squared multiple correlation coefficient. Monte Carlo methods were employed to compare omega squared, the squared multiple correlation coefficient, and the squared multiple correlation coefficient to which a shrinkage formula had been applied, in…

The U.S. Army Research Institute for the Behavioral and Social Sciences has developed a wide range of statistical models to test hypotheses generated in relation to an equally wide range of measurement and evaluation situations. The randomized block (RB) design has traditionally been a preferred model for much psychological research. The RB has…

This is one of a series of eight short monographs intended to aid practicing educators in planning and conducting accountability programs in schools. This booklet discusses how to determine a sampling method that is appropriate to the objectives of a particular research or evaluation effort. Short sections focus in turn on why and when to sample,…

An empirical study of statistical overkill investigated the generalizability of multiple regression equations as a function of the subject/variable ratio. Data from various-sized groups of rehabilitation clients were used to develop the equations. Findings showed that equations developed on samples with less than a 10 to 1 ratio failed to…

This study developed and investigated an empirical sampling distribution of the congruence coefficient. The effects of sample size, number of variables, and population value of the congruence coefficient on the sampling distribution of the congruence coefficient were examined. Sample data were generated on the basis of the common factor model and…

The purpose of this study was to generate descriptive statistical estimates regarding the expected proportion of occurrence of each of the PROANA 5 (Process Analysis) variables (line usage, clique group, detrimental clique group, leadership, and dominance) in small group communication. A second purpose was to determine the expected pattern of…