It is common in regression discontinuity analysis to control for high order (third, fourth, or higher) polynomials of the forcing variable. We argue that estimators for causal effects based on such methods can be misleading, and we recommend researchers do not use them, and instead use estimators based on local linear or quadratic polynomials or…

Propensity score analysis (PSA) is a methodological technique which may correct for selection bias in a quasi-experiment by modeling the selection process using observed covariates. Because logistic regression is well understood by researchers in a variety of fields and easy to implement in a number of popular software packages, it has…

An empirical sampling approach was used to assess the accuracy of a Taylor approximation for the estimation of sampling errors. The sampling errors were in the statistics involved in estimating a path model based on medium-sized samples gathered using five sample designs commonly used in educational research. (TJH)

A Rasch measurement model can be constructed to meet the requirements of rank ordered data. If multiple rankings of the same objects are available, then the parameters of the objects can be estimated, along with their standard errors and also with statistics summarizing the fit of the data to the measurement model. This paper summarizes the…

Meta-analysis has become an important supplement to traditional methods of research reviewing, although many problems must be addressed by the reviewer who carries out a meta-analysis. These problems include identifying and obtaining appropriate studies, extracting estimates of effect size from the studies, coding or classifying studies, analyzing…

Faced with a nonstandard, complicated practical problem in statistical inference, the applied statistician sometimes must use asymptotic approximations in order to compute standard errors and confidence intervals and to test hypotheses. This usually requires that he derive formulas for one or more asymptotic sampling variances (and covariances)…

Tests the "holistic construal" method of validating constructs and testing organizational hypotheses, using examples from organizational theory and data on wholesale distribution companies. Holistic construal is meant to explicitly represent theoretical and empirical concepts, nonobservational hypotheses, and correspondence rules and…

Some of the methods originally used to find relationships between reliability and power associated with a single measurement are extended to difference scores. Results, based on explicit power calculations, show that augmenting the reliability of measurement by reducing error score variance can make significance tests of difference more powerful.…

Some approximate formulas are presented for standard errors of estimated regression coefficients in two-level designs. If the researcher can make a reasonable guess as to parameters occurring in the model, this approximation can be a guide to the choice of sample sizes at either level. (SLD)

A general Computer program is described that will compute asymptotic standard errors and carry out significance tests for an endless variety of (standard and) nonstandard large-sample statistical problems, without requiring the statistician to derive asymptotic standard error formulas. The program assumes that the observations have a multinormal…

A methodology is presented for minimizing mean error variance in generalizability studies when resource constraints are imposed. The optimal number of observations and conditions of facets for random model, fully crossed one- and two-facet designs can be decided. Parallel closed form formulas can be determined for other designs. (SLD)

The importance of regression diagnostics in detecting influential data points is discussed, and five statistics are recommended for the applied researcher. The suggested diagnostics were used on a dataset of 24 subjects, and effects were analyzed. Colinearity-based diagnostics and diagnostics for a variety of procedures are discussed. (SLD)

Often, all of the variables in a model are latent, random, or subject to measurement error, or there is not an obvious dependent variable. When any of these conditions exist, an appropriate method for estimating the linear relationships among the variables is Least Principal Components Analysis. Least Principal Components are robust, consistent,…

Techniques for adjusting census figures are discussed, with a focus on sampling error, uncertainty of estimates resulting from the luck of sample choice. Computer simulations illustrate the ways in which the smoothing algorithm may make adjustments less, rather than more, accurate. (SLD)

Statistical methodologists have sometimes criticized the use of conventional statistics in meta-analysis, and in recent years a number of them have advocated the use of a special new statistical methodology for research synthesis. An examination of recent books describing this methodology shows that it is seriously limited in its applicability to…