Clearinghouses set standards of scientific quality to vet existing research to determine how "evidence-based" an intervention is. This paper examines 12 educational clearinghouses to describe their effectiveness criteria, to estimate how consistently[underlined] they rate the same program, and to probe why their judgments differ. All the…

The purpose of this article is to examine the application of randomized controlled trial (RCT) methodology for determining the efficacy of school-based interventions in general and special education. In education science, RCTs are widely acknowledged as the gold standard of efficacy research, with other methodologies relegated to a lower level of…

Practitioner research should be sufficiently trustworthy "and" useful. We argue, however, that although criteria of trustworthiness are rather well developed, criteria of usefulness are not. As a result, the long-term impact of practitioner research is rather disappointing because, we contend, it tends to lack practicality. We used…

Gargani and Strong claim to have developed and validated an observation system that requires only 4 hr of training, but one that can identify effective teachers using just 20 min of one video-taped lesson. They further contend that their six-item inventory requires little judgment from those who use it. They describe their instrument, the Rapid…

Grit is a construct that is widely studied by educational researchers and that has generally been enthusiastically received by educational practitioners. This essay highlights that many of the core claims about grit have either been unexamined or are directly contradicted by the accumulated empirical evidence. Specifically, there appears to be no…

This article provides an illustrative description of the pre-post difference index (PPDI), a simple, nontechnical yet robust tool for examining the instructional sensitivity of assessment items. Extension educators often design pretest-posttest instruments to assess the impact of their curricula on participants' knowledge and understanding of the…

The Additive Factor Model (AFM) is a cognitive diagnostic model that can be used to predict student performance on items in a context that allows for student learning. Within AFM, "skills" have a learning rate, and student acquisition of a skill depends only on the number of opportunities a student has had to exercise that skill and the…

The Campbell and Cochrane Collaborations were created to reveal the evidentiary status of claims focusing especially on the effectiveness of specific interventions. Such reviews are constrained by the population of studies available and biases that may influence this availability such as preferred framing of problems. This highlights the…

This article advances the enlightened discussion of the nature, logic, and possible effects of the Programme for International Student Assessment (PISA). The purpose is to analyse the assumptions regarding how PISA is to achieve its intended effects, that is, to reconstruct PISA's programme theory (PT) and to probe the validity of its underlying…

In 2010, the Institute of Education Sciences commissioned a much-needed national evaluation of response to intervention (RTI). The evaluators defined their task very narrowly, asking "Does the use of universal screening, including a cut-point for designating students for more intensive Tier 2 and Tier 3 interventions, increase children's…

Qualifications provide evidence of students' achievements against subject content in a specification, giving students the confidence that the skills, knowledge and understanding that they will have acquired during the course of their study provides a strong foundation for further academic and vocational study, and for employment. United Kingdom…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

As part of the No Child Left behind Act of 2001 and the Individuals with Disabilities Education Improvement Act of 2004, schools are called upon to provide students with academic instruction using scientific, research-based methods whenever possible. One of these supposed research-based methods is a program by the name of Brain Gym®. Brain Gym® is…

This study reports on the validation of the language domain subtest of a developmental assessment scale for Cantonese Chinese preschool children. Three hundred and seventy eight multi-stage randomly selected children between 3;4 and 6;3 years of age were tested on the 104-item subtest. Fifty-four of these children, spreading across three age…

The Economic Actions in Education training module (EAE) teaches how to handle, use and judge external standardized tests in schools. The EAE programme was implemented in teacher training at the University of Kiel, because teachers are increasingly under external scrutiny and are being held accountable for student and school achievements. The EAE…