The rationale behind analysis of variance (including analysis of covariance and multiple analyses of variance and covariance) methods is reviewed, and unplanned and planned methods of evaluating differences between means are briefly described. Two advantages of using planned or a priori tests over unplanned or post hoc tests are presented. In…

The unique conceptual framework and language of generalizability theory are presented. While this chapter is relevant to any area in which generalizability theory is applicable, it emphasizes evaluation research, and most examples come from that area. (Author/PN)

The nature and appropriate application of the technique of multivariate analysis are discussed. More specifically, the intent of the paper is to demystify and explain the use of multivariate analysis as well as provide guidelines for selection of the most effective statistics for use in specific situations. For the purpose of this paper, the term…

A broad range of strategies in sampling, measurement, design, execution, implementation, and analysis are examined. Specific strategies are suggested that tend to be successful in the real world of psychiatric clinical research. (Author)

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…