Multivariate methods are being used with increasing frequency in educational research because these methods control "experimentwise" error rate inflation, and because the methods best honor the nature of the reality to which the researcher wishes to generalize. This paper: explains the basic logic of canonical analysis; illustrates that…

Generalizability or invariance procedures have been known for over three decades. Through the years, these procedures have not been widely discussed or employed. One reason for the lack of use is that most of the articles on invariance procedures have been mathematically oriented. The mathematical orientation of research articles and the lack of…

Generalizability or invariance procedures have been known for over three decades. Through the years, these procedures have not been widely discussed or employed. One reason for the lack of use is that most of the articles on invariance procedures have been mathematically oriented. The mathematical orientation of research articles and the lack of…

The present paper suggests that multivariate techniques are very important in social science research, and that canonical correlation analysis may be particularly useful. The logic of canonical analysis is explained and discussed. The necessity of using replicability/generalizability analyses is argued. It is suggested that cross-validation…

Statistical invariance procedures provide a way of looking at the generalizability of research results from sample to sample when the research has not been validated by replication. This paper discusses the Procrustean Rotation invariance procedure following a canonical correlation analysis. The computer program RELATE is used to gauge the…

The need for using invariance procedures to establish the external validity or generalizability of statistical results has been well documented. Invariance analysis is a tool that can be used to establish confidence in the replicability of research findings. Several approaches to invariance analysis are available that are broadly applicable across…

In this study, the reliability of the American College Testing (ACT) Program's "Survey of Academic Advising" (SAA) was examined using both univariate and multivariate generalizability theory approaches. The primary purpose of the study was to compare the results of three generalizability theory models (a random univariate model, a mixed…

Psychometric theory has been one of psychology's stronger foundations and a major contributor to the recognition of psychology as a scientific discipline. Basic principles of psychometric theory led to the development of respected intelligence tests and large and comprehensive testing and assessment programs. This paper synthesizes major…

The multivariate generalizability of the Role Functioning Scale (RFS), which serves as a replacement for the global ratings of the Social Adjustment Scale, was studied with 396 severely disturbed clients of a public mental-health bureau. Generalizability of single subscales was less than that of the combined subscales. (SLD)