In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

Debate is occurring about which result interpretation aides focused on examining the experimental effect should be used in single-subject experimental research. In this study, we examined seven nonoverlap methods and compared results using each method to judgments of two visual analysts. The data sources for the present study were 36 studies…

Although brief experimental analysis (BEA) procedures have been effective for aiding instructional decision making in the area of reading, there is a paucity of research extending this technology to mathematics. This study extends the literature on mathematics BEA by using an abridged data series that compares skill- and performance-based…

Forty-seven states have adopted a pathway to teaching, alternative to the standard state certification otherwise required. But is alternative certification impairing student learning? That is ultimately the justification for traditional teacher certification. To see which states have established genuine alternative certification programs and which…

Testing previously studied information enhances long-term memory, particularly when the information is successfully retrieved from memory. The authors examined the effect of unsuccessful retrieval attempts on learning. Participants in 5 experiments read an essay about vision. In the test condition, they were asked about embedded concepts before…

Students in the United States spend much less time in school than do students in most other industrialized nations, and the school year has been essentially unchanged for more than a century. This is not to say that there is no interest in extending the school year. While there has been little solid evidence that doing so will improve learning…

In recent years, national policy experts have questioned the overall quality of educational research, and they have suggested that researchers strengthen their scientific methods by maximizing the use of experimental designs. To promote more rigorous methodology, we discuss several new and often-overlooked opportunities for incorporating…

Coshocton district in Ohio takes part in an unusual experiment that pays students who pass or scores high in the state exams. Pupils here in grades 3 through 6 earn $15 for every "proficient" score and $20 for "accelerated" or "advanced" scores. With annual tests given in five subjects, students can earn up to $100 if…

Value-added models, which rate schools for effectiveness while taking into account the poverty and other socioeconomic status of the students, are generating increased interest. This paper describes the use of one such model to evaluate whether school ratings changed when three new programs were introduced: the "Target Teach" curriculum…

Expresses the importance of scientifically based research in education reform and explains how to judge the validity of educational research. Describes control groups, randomized and matched experiments, statistical educational significance, sample size, and the difference between scientifically based and rigorously evaluated research. (Contains…

In this keynote address presented at the Mid-western Educational Research Association Annual Meeting in October, 2004, the author discusses the increasing interest of federal policy-makers in scientifically-based research. A comparison between education and other disciplines is offered, and a proposal for increased rigor in educational research is…