In evaluation and applied social research, focus groups may be used to gather different kinds of evidence (e.g., opinion, tacit knowledge). In this article, we argue that making focus group design choices explicitly in relation to the type of evidence required would enhance the empirical value and rigor associated with focus group utilization. We…

In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

Special educators are required to use evidence-based academic and behavioral interventions in their classrooms (U.S. Department of Education, 2010). No rigorous and comprehensive database currently exists to support educators. Within the field of special education, single-subject research is the primary research methodology (Horner, Carr, Halle,…

This article examines changes in the research design, sample size, and precision between the planning phase and implementation phase of group randomized trials (GRTs) funded by the Institute of Education Sciences. Thirty-eight GRTs funded between 2002 and 2006 were examined. Three studies revealed changes in the experimental design. Ten studies…

In the wake of an increasing political commitment to evidence-based decision making and evidence-based educational reform that emerged with the No Child Left Behind effort, the question of what counts as evidence has become increasingly important in the field of science education. In current public discussions, academics, politicians, and other…

Professionals mostly agree that scientific research should guide practice in education. The Individuals with Disabilities Education Improvement Act (IDEIA; 2004) and the No Child Left Behind Act (2002) require that students with disabilities receive research-based practices in the "least restrictive environment." Because the least…

The field of evaluation faces a number of serious challenges in light of No Child Left Behind legislation, among them feasibility, resources, and blurring lines among research, evaluation, and assessment. At the same time, these challenges open the door for opportunities in evaluation. Now more than ever, the expertise of evaluators is needed and…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

The recent emphasis on scientifically-based research (SBR) as the government's favored research paradigm has direct implications for career and technical education (CTE). From a practical standpoint, federal funds will now be appropriated exclusively on scholars' readiness and ability to engage the "right" research questions. While the…

A major tenet of both the Individuals with Disabilities Education Act and the No Child Left Behind Act is the identification and use of evidence-based practices, or those instructional techniques shown by research as most likely to improve student outcomes meaningfully. However, much confusion exists regarding the meaning and potential…

The central idea of evidence-based education--that education policy and practice ought to be fashioned based on what is known from rigorous research--offers a compelling way to approach reform efforts. Recent federal trends reflect a growing enthusiasm for such change. Most visibly, the 2002 No Child Left Behind Act requires that…

American educational leaders seek to educate children (regardless of race, class, or economic status) to become productive citizens. In order for our country to compete with other countries where students are well educated and highly motivated, we need to ensure that our educational system is equipped with the technology and tools that would allow…

To appreciate the true impact of scientifically based research on education, it may be useful first to understand the meaning of the various terms that the law employs as part of its definition of SBR (Scientifcally Based Research). The This article presents an explication from a Software & Information Industry Association publication titled…

This article addresses the problem of small nonprobability samples in research in the education of the deaf and hard of hearing in the face of a current and increasing emphasis on "scientifically based research" as required by recent No Child Left Behind (NCLB) federal legislation. The authors examine the gains and losses in information…

Will recent federal policy changes succeed in improving the quality of education policy research? One explanation for the limited supply to date of high-quality evaluation evidence in education is limited demand, owing perhaps, in part, to market failure for both education outcomes and education research. In the market for education outcomes, the…