The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

The purpose of this paper is to provide an easy template for the inclusion of the Bayes factor in reporting experimental results, particularly as a recommendation for articles in the "Journal of Problem Solving." The Bayes factor provides information with a similar purpose to the "p"-value--to allow the researcher to make…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Integrative analysis, or what is coming to be known as meta-analysis, is the integration of the findings of many empirical research studies of a topic. Meta-analysis differs from traditional narrative forms of research reviewing in that it is more quantitative and statistical. Thus, the methods of meta-analysis are merely statistical methods,…

Provides a set of guidelines for evaluating research using structural equation modeling (SEM). Offers insight into how someone familiar with SEM would judge the adequacy of a study using such methods. (Author/RH)

Three procedures that help to determine the degree of confidence we can place in any raw score are discussed: computing the standard error of measurement, computing the estimated true score, and constructing confidence intervals. These three procedures are easy to use and require only elementary mathematical skills. (Author/CL)

Suggestions are made on effective presentations by evaluators of research studies to audiences who are not statisticians. Examples of effective presentation methods are given: analogies in presenting statistics; graphs or pictorial presentations; summaries to highlight findings; concise reports based on a television newscast style; and judicial…

This article suggests ways in which the consumer of educational research can critically evaluate research reports in terms of sample and methodology, design and statistical treatment, and results and interpretation. The reader is alerted to sources of deliberate and nondeliberate bias and to fallacious use and/or interpretation of statistics.…

Statistical significance is not a sufficient condition for claiming a hypothesis has been supported. Constructive replications are more important. Statistically significant results may be meaningless while a sequence of nonsignificant results may be quite important. Gives advice on how to overcome some limitations of classifical statistical…

Discusses the problem of dichotomous-dependent variables in regression analysis in student attrition studies. Proposes a new method as an alternative to regression analysis. (Author/RC)

The way that graphs can be used to make calculations that are commonly used by institutional researchers is described using specific examples, and the technique of constructing computational graphs (and nomographs) is outlined. It is shown that once a calculation involving several variables has been represented by a computation diagram or a…

Meta-analysis has become an important supplement to traditional methods of research reviewing, although many problems must be addressed by the reviewer who carries out a meta-analysis. These problems include identifying and obtaining appropriate studies, extracting estimates of effect size from the studies, coding or classifying studies, analyzing…

Twenty-nine steps necessary for data file preparation for secondary analysis are discussed. Data base characteristics and planned use vary the complexity of the preparation. Required techniques (file verification, sample verification, file merger, data aggregation, file modification, and variable controls) and seven associated pitfalls are defined…

Several methods of assessing test item bias are described, and the concept of fair use of tests is examined. A test item is biased if individuals of equal ability have different probabilities of attaining the item correct. The following seven general procedures used to examine test items for bias are summarized and discussed: (1) analysis of…

Because of limitations on research controls, research designs in postsecondary education are often complex and can involve many independent and potentially confounding variables. What is needed to adequately address such research questions is a flexible and powerful data-analytic approach, and the general linear regression model is recommended.…