BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

While the use of inferential statistics is a nearly universal practice in the social sciences, there are instances where its application is unnecessary and potentially misleading. This is true for a portion of research using administrative data in educational research in the United States. Surveying all research articles using administrative data…

The use of big data in higher education has evolved rapidly with a focus on the practical application of new tools and methods for supporting learning. In this paper, we depart from the core emphasis on application and delve into a mostly neglected aspect of the big data conversation in higher education. Drawing on developments in cognate…

Experimental data are analysed statistically to allow researchers to draw conclusions from a limited set of measurements. The hard fact is that researchers can never be certain that measurements from a sample will exactly reflect the properties of the entire group of possible candidates available to be studied (although using a sample is often the…

Null hypothesis significance testing has dominated quantitative research in education and psychology. However, the statistical significance of a test as indicated by a p-value does not speak to the practical significance of the study. Thus, reporting effect size to supplement p-value is highly recommended by scholars, journal editors, and academic…

Statistical significance reporting and use in educational and psychological research is reviewed. An assessment of the use of statistical significance in articles published in MECD from 1990-1996 is presented. The elements of statistical significance (including sample size, effect size, and power), interpretation of results, common erroneous…

Presents an opinion on the appropriate use of significance tests, especially in the context of regression analysis, the most commonly encountered statistical technique in education and related disciplines. Briefly discusses the appropriate use of power analysis. Contains 47 references. (Author/SV)