Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

In light of the replication crisis in psychology, null-hypothesis significance testing (NHST) and "p"-values have been heavily criticized and various alternatives have been proposed, ranging from slight modifications of the current paradigm to banning "p"-values from journals. Since the physics education research community…

Statistical significance reporting and use in educational and psychological research is reviewed. An assessment of the use of statistical significance in articles published in MECD from 1990-1996 is presented. The elements of statistical significance (including sample size, effect size, and power), interpretation of results, common erroneous…

Presents an opinion on the appropriate use of significance tests, especially in the context of regression analysis, the most commonly encountered statistical technique in education and related disciplines. Briefly discusses the appropriate use of power analysis. Contains 47 references. (Author/SV)

Dismissing research that is not theory driven, hypothesis testing, or generalization producing does injustice to the variety of contributions that qualitative research can make. Studies conducted through qualitative approaches are reviewed to summarize the desirable outcomes that can result. No research model has a monopoly on quality. (SLD)