BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

Researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple testing procedures (MTPs) are statistical…

In education research and in many other fields, researchers are often interested in testing the effectiveness of an intervention on multiple outcomes, for multiple subgroups, at multiple points in time, or across multiple treatment groups. The resulting multiplicity of statistical hypothesis tests can lead to spurious findings of effects. Multiple…

The purpose of this paper is to provide an easy template for the inclusion of the Bayes factor in reporting experimental results, particularly as a recommendation for articles in the "Journal of Problem Solving." The Bayes factor provides information with a similar purpose to the "p"-value--to allow the researcher to make…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

In eight chapters, this document offers guidelines for school administrators on evaluating schools and school programs, based on a poll of administrators and consultants. The introduction discusses the purpose of evaluation, especially school improvement, and presents a list of evaluation standards. Chapter 1 outlines steps in evaluation planning,…

Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)

Social scientists have available a wide array of techniques for the analysis of complex contingency tables. Considerations in choosing from among the techniques are discussed. The theme emphasized here is that the analyst should evaluate the techniques within the context of the substantive questions of the study. (Author/JKS)

An extension of the discussion of loglinear models presents post hoc procedures for statistically evaluating treatment effects, contrasts, and confidence intervals, illustrating methods for main effect and interaction contrasts and paying special attention to odds ratios and their interval estimates. Procedures for treating variables as…

Three procedures that help to determine the degree of confidence we can place in any raw score are discussed: computing the standard error of measurement, computing the estimated true score, and constructing confidence intervals. These three procedures are easy to use and require only elementary mathematical skills. (Author/CL)

When reporting results, researchers must not change predetermined significance levels. Such attempts to make results more significant are statistically inaccurate, illogical, and unethical. American Psychological Association standards for reporting significance should be more explicit. (CP)

Describes how a combination of mapping and techniques can be used as a basis for measuring and analyzing student locational awareness of California. The case study analysis reveals that there was considerable variation in students' accuracy and precision in locating places. Includes tables and maps. (TRS)

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

Designed for use with Research for Better Schools' evaluation system, this guide focuses upon basic concepts and statistical procedures applicable to specific research hypotheses emerging from evaluation questions. The first of three sections presents a discussion of descriptive statistics in terms of frequency, central tendency, variability, and…