The paper has three major objectives. The first objective of the paper is to synthesize and define common categories of meta-analysis. The second objective is to propose a way to comprehend these common categories of meta-analysis through learning from their respective generic conceptual frameworks. The third objective is to point out which R…

Background: Power analyses for a cluster-randomized trial (CRT) require estimates of additional design parameters beyond those needed for an individually randomized trial. In a 2-level CRT, there are two sample sizes, the number of clusters and the number of individuals per cluster. The intraclass correlation (ICC), or the proportion of variance…

Clinical prediction models are widely used in modern clinical practice. Such models are often developed using individual patient data (IPD) from a single study, but often there are IPD available from multiple studies. This allows using meta-analytical methods for developing prediction models, increasing power and precision. Different studies,…

Multilevel models are an increasingly popular method to analyze data that originate from a clustered or hierarchical structure. To effectively utilize multilevel models, one must have an adequately large number of clusters; otherwise, some model parameters will be estimated with bias. The goals for this paper are to (1) raise awareness of the…

Examines the prevalence of inflated Type I error in counseling research and recommends wider use of multivariate statistics to correct the problem. Type I error becomes inflated beyond acceptable levels when researchers perform individual univariate statistics on each of several dependent variables within a single project. (Author)

The present article reviews the procedures that have been developed for measuring the reliability of human observers' judgments when making direct observations of behavior. These include the percentage of agreement, Cohen's Kappa, phi, and univariate and multivariate agreement measures that are based on quasi-equiprobability and quasi-independence…

Comments on some methodological limitations of the research base of "The Bell Curve": blind use of the normal distribution (bell curve); avoidance of nonnormal statistical distributions, which are more appropriate for some social and economic characteristics; copious use of percentiles and quintiles, inappropriate with nonnormal…

In the educational research literature alpha, the a priori level of significance, and p, the a posteriori probability of obtaining a test statistic of at least a certain value when the null hypothesis is true, are often confused. Explanations for this confusion are offered. Paradoxically, alpha retains a prominent place in textbook discussions of…

It has been increasingly realized that (1) multivariate methods are essential in most quantitative studies (Fish, 1988; Thompson, 1992), and (2) all conventional parametric analytic methods are correlational and invoke least squares weights (e.g., the beta weights in regression) (Knapp, 1978; Thompson, 1991). The present paper reviews one very…

Raymond Cattell's efforts to sort out the relationships of genetic or environmental patterns to personality factors have contributed to behavior genetics. Early writings on the projected decline of intelligence in Britain, studies using Multivariate Abstract Variance Analysis, and other miscellaneous studies on personality factors and mental…

Reviews the issue of outcome criteria in the light of the relevance-rigor dimension. Counseling psychologists must find a more liberalized approach to research methodology upon which to construct human understanding. Inappropriate methods of data anlaysis are often used in multivariate research. A model for such experiments is suggested. (JAC)

Reviews the knowledge utilization process by decision makers and examines how state agency officials in four areas (hazardous waste management, economic development, welfare, and education) use knowledge generated by policy analysis. Appendices include components of the 1988 knowledge utilization survey of state officials. (48 references) (LRW)

Dissertations are an important component of the effort to generate knowledge. Thus, dissertation quality may be seen by accreditation and coordinating-board reviewers as a noteworthy reflection on the quality of doctoral programs themselves. The present study reviews methodological errors within Ph.D. dissertations. The illustrative errors are…