Arthur Levine's (2007) recent report on the academic preparation of education doctoral students, Educating Researchers, http://www.edschools.org/EducatingResearchers/educating_researchers.pdf is highly critical of both AERA and the scholarly training of education doctoral students. One criticism Levine (2007) offers is his view that educational…

Given some consensus that statistical significance tests are broken, misused, or at least have somewhat limited utility, the focus of discussion within the field ought to move beyond additional bashing of statistical significance tests, and toward more constructive suggestions for improved practice. Five suggestions for improved practice are…

The use of planned, or "a priori," and unplanned, or "post hoc," comparisons to isolate differences among means in analysis of variance research is discussed. Planned comparisons typically involve weighting data by sets of "contrasts." Planned comparison offer more power against Type II errors. In addition, they force…

A "doubly-centered" raw data matrix is one for which both columns and rows have both unit variance and means equal to zero. The factor scores from one analysis are the same as factor pattern coefficients from the other analysis except for a variance adjustment. This study explored an extension of the reciprocity principle which may have…

Conventional canonical methods distinguish between the two variable sets being analyzed, but the methods do not attempt to optimize the variance from a given variable set that will be contained in the final solution. In this respect canonical methods are said the be "symmetric." This paper proposes two non-symmetric, canonical-like…

This paper provides an introduction to basic issues concerning structural equation modeling (SEM), a research methodology increasingly being used in social science research. First, seven key issues that must be considered in any SEM analysis are explained. These include matrix of associations to analyze, model identification, parameter estimation…

Virtually all parametric statistical procedures have been shown to be special cases of canonical correlation analysis, which is a useful research methodology particularly when augmented by the calculation of canonical structure, index, and invariance coefficients. A logic for conducting stepwise canonical correlation analysis based upon evaluation…

Editorial practices revolving around tests of statistical significance are explored. The logic of statistical significance testing is presented in an accessible manner--many people who use statistical tests might not place such a premium on them if they knew what the tests really do, and what they do not do. The etiology of decades of misuse of…

This paper explains in user-friendly terms why multivariate statistics are so important in educational research. The basic logic of canonical correlation analysis is presented as a simple or bivariate Pearson "r" procedure. It is noted that all statistical tests implicitly involve the calculation of least squares weights, and that all…

After presenting a general linear model as a framework for discussion, this paper reviews five methodology errors that occur in educational research: (1) the use of stepwise methods; (2) the failure to consider in result interpretation the context specificity of analytic weights (e.g., regression beta weights, factor pattern coefficients,…

Stepwise methods are frequently employed in educational and psychological research, both to select useful subsets of variables and to evaluate the order of importance of variables. Three problems with stepwise applications are explored in some detail. First, computer packages use incorrect degrees of freedom in their stepwise computations,…

Use of the bootstrap method in a canonical correlation analysis to evaluate the replicability of a study's results is illustrated. More confidence may be vested in research results that replicate. (SLD)

The author contends that model misspecification can occur even after researchers have selected the generally most appropriate class of methods, or general linear model techniques. It is suggested specifically that canonical correlation analysis may provide more meaningful results, as compared with regression, particularly if analysis is augmented…

Given decades of lucid, blunt admonitions that statistical significance tests are often misused, and that the tests are somewhat limited in utility, what is needed is less repeated bashing of statistical tests, and some honest reflection regarding the etiology of researchers' denial and psychological resistance (sometimes unconscious) to improved…

Various realizations have led to less frequent use of the "OVA" methods (analysis of variance--ANOVA--among others) and to more frequent use of general linear model approaches such as regression. However, too few researchers understand all the various coefficients produced in regression. This paper explains these coefficients and their…