The literature on student evaluations of teaching (SETs) generally presents two opposing camps: those who believe in the validity and usefulness of SETs, and those who do not. Some researchers have suggested that 'SET deniers' resist SETs because of their own poor SET results. To test this hypothesis, I analysed essays by 230 SET researchers (170…

In 1881, Donald MacAlister posed a problem in the "Educational Times" that remains relevant today. The problem centers on the statistical evidence for the effectiveness of a treatment based on a comparison between two proportions. A brief historical sketch is followed by a discussion of two default Bayesian solutions, one based on a…

Online education is rapidly becoming a significant method of course delivery in higher education. Consequently, instructors analyze student performance in an attempt to better scaffold student learning. Learning analytics can provide insight into online students' course behaviors. Archival data from 167 graduate level education students enrolled…

This article describes the ICAP framework that defines cognitive engagement activities on the basis of students' overt behaviors and proposes that engagement behaviors can be categorized and differentiated into one of four modes: "Interactive," "Constructive," "Active," and "Passive." The ICAP hypothesis…

In the present paper, the application of a parametric bootstrap procedure, as described by van de Schoot, Hoijtink, and Dekovic (2010), will be applied to demonstrate that a direct test of an informative hypothesis offers more informative results compared to testing traditional null hypotheses against catch-all rivals. Also, more power can be…

For almost two decades, there has been growing interest in what design-based research (DBR) can contribute to both educational practice and theory. Since its introduction into the literature, this orientation to educational research has repeatedly been likened to aeronautical engineering as a way to clarify its nature and argue its potential. This…

If you've upgraded to the second edition of the landmark book "Classroom Instruction That Works," you need this companion guide to help you use technology to support research-based instruction. The authors follow the revised Instructional Planning Guide that makes it easier for you to know when to emphasize each of the instructional strategies,…

Many school districts are using research-based strategies to increase student achievement. The "No Child Left Behind Act" of 2001 was created and implemented to assist all students becoming proficient in reading and mathematics by 2014. One strategy many school districts implemented includes an after-school program. One school district…

Given ongoing economic, political and social transformation, skill formation systems are under pressure to change. This is acknowledged in European declarations--Bologna for higher education and Copenhagen for vocational training--and various national reform processes. The omnipresent convergence hypothesis is that these international pressures…

There is a growing awareness that science education should center not just on knowledge acquisition but developing the foundation for lifelong learning. However, for intentional learning of science to occur in school, out of school, and after school, there needs to be a motivation to learn science. Prior research had shown that students'…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…

This paper briefly describes unplanned and planned methods of evaluating differences between means and explains orthogonal versus nonorthogonal contrasts to help the researcher understand a framework of planned comparisons. A small heuristic data set is generated to illustrate the superiority of planned comparisons over omnibus analysis of…

Multivariate and univariate analysis of variance methods (MANOVA and ANOVA, respectively) are compared for their relative value in educational research. The favoritism shown multivariate techniques is questioned. Criteria for the selection of the appropriate technique are outlined. The relationships among research hypotheses, statistical…

The meta-analytic techniques of G. V. Glass (1976) and J. E. Hunter and F. L. Schmidt (1977) were compared through their application to three meta-analytic studies from education literature. The following hypotheses were explored: (1) the overall mean effect size would be larger in a Hunter-Schmidt meta-analysis (HSMA) than in a Glass…