This study aims to introduce network meta-analysis (NMA) to provide educational researchers with an extended view of the reviewing educational research. Meta-analytic methods have been widely used in educational research reviews. However, weaknesses have emerged in the multi-group comparison analysis of educational studies where different…

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In…

With growing popularity of single subject design as a method to evaluate the efficacy of interventions, it is important to ensure that the analyses of these methods are rigorous and reliable. The purpose of this case study is to discuss the measures used to evaluate the efficacy of interventions in single subject design studies in the fields of…

This paper details the challenges encountered by authors summarizing evidence from a primary study to describe a treatment's effectiveness using an effect size (ES) estimate. Dilemmas that are encountered, including how to calculate and interpret the pertinent standardized mean difference ES for results from studies of various research designs,…

Presents an opinion on the appropriate use of significance tests, especially in the context of regression analysis, the most commonly encountered statistical technique in education and related disciplines. Briefly discusses the appropriate use of power analysis. Contains 47 references. (Author/SV)

Magnitude of effect measures (MEMs), when adequately understood and correctly used, are important aids for researchers who do not want to rely solely on tests of statistical significance in substantive result interpretation. The MEM tells how much of the dependent variable can be controlled, predicted, or explained by the independent variables.…

This article discusses alternative analyses that reflect the practical significance of test results and the role of sample size in the interpretation of results. It explores effect size reporting and using "what if" analyses to reflect on the role of sample size in the decision to accept the null hypothesis. (Contains references.) (Author/CR)

This study explored some practical issues for single-case researchers who rely on visual analysis of graphed data, but who also may consider supplemental use of promising statistical analysis techniques. The study sought to answer three major questions: (a) What is a typical range of effect sizes from these analytic techniques for data from…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…