The multivariate analysis of variance approach to the analysis of data from repeated measures designs that include covariates is reviewed and contrasted with univariate methods. Assumptions necessary for meaningful interpretation of the results of the multivariate analysis are discussed and contrasted to those of the univariate approaches. An…

The mathematical extension from scalars to matrices as a prerequisite for univariate to multivariate generalizations of statistical concepts and methods is discussed. One reason for several alternative techniques is the multitude of ways to generalize from univariate concepts to multivariate concepts. The additional complexity, and lack of…

The issue of power in exploratory single group repeated measures analysis of variance is explored under the condition of heterogeneous correlations across the repeated measures trials. Tables developed from 13 real and hypothetical data sets (70 cells) show how well both univariate and multivariate power is estimated under a variety of conditions…

Levin's (1975) sample-size determination procedure for completely randomized analysis of variance designs is extended to designs in which antecedent or blocking variables information is considered. In particular, a researcher's choice of designs is framed in terms of determining the respective sample sizes necessary to detect specified contrasts…

A study was conducted to evaluate six goodness-of-fit procedures using data simulation techniques. The procedures evaluated included the weighted average absolute deviation (WAAD), the mean absolute deviation (MAD), Bock's chi-square (BCHI), Yen's chi-square (YCHI), Wright and Mead's chi-square (WCHI), and the likelihood ratio chi-square (LCHI)…

The value of variance is emphasized, and the element of design, frequently not adequately understood, is clarified to underscore the importance of variance to the researcher. Two analytic methods, analysis of variance (ANOVA) and multiple regression, are discussed in terms of how each uses/applies variance. Advantages and major difficulties with…

The assumptions and consequences of applying conventional and newer statistical methods to meta-analytic data sets are reviewed. The application of the two approaches to a meta-analytic data set described by L. V. Hedges (1984) illustrates the differences. Hedges analyzed six studies of the effects of open education on student cooperation. The…

The multivariate general linear hypothesis (MGLH) has received relatively little utilization in educational research and evaluation. This is surprising in view of the fact that recent publications have made the MGLH tractable by practitioners. This paper seeks to stimulate interest in the MGLH by reviewing recent applications, emphasizing the…

Although there is a healthy trend toward employment of multivariate statistical methods in the analysis of data from experiments in psychology and education which involve multiple dependent variables, there remains a need to demonstrate the wide variety of data analytic techniques available for post hoc analysis of statistically significant…

What a multivariate contrast analysis should entail and how such an analysis should be conducted are discussed. The three questions encompassing a contrast analysis are: (1) whether the contrast effects are generalizable; (2) which variables contribute most to the contrast effects; and (3) what is the construct underlying the contrast effects.…

In order to examine the possible effects of violation of assumptions using parametric procedures, this study is an exploratory investigation into the use of parametric versus nonparametric procedures using a multiple case study design. The case study investigation guidelines outlined by Yin served as the methodology. The following univariate…

This introduction to the theory and application of multivariate analysis is designed to assist institutional researchers who are interested in using these techniques to analyze issues within their respective institutions. A brief introduction to multivariate theory, consisting of a rationale for multivariate statistics and an overview of selected…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…

The usefulness of studying thought processes in the construct validation of ability tests was examined using a sample consisting of 343 Canadian senior high school students. Four levels of probing were used by the interviewer to examine the students' thinking processes while taking the Test on Appraising Observations: (1) think aloud; (2)…

The effectiveness of multiple matrix sampling was examined in a study of 495 students' attitudes toward a computer education program. A post hoc analysis of variance was used, with the class as the unit of analysis. The Computer Attitude Scale, a 30-item rating scale, was used to measure attitudes toward learning about and working with computers.…