In evaluation and applied social research, focus groups may be used to gather different kinds of evidence (e.g., opinion, tacit knowledge). In this article, we argue that making focus group design choices explicitly in relation to the type of evidence required would enhance the empirical value and rigor associated with focus group utilization. We…

In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

Special educators are required to use evidence-based academic and behavioral interventions in their classrooms (U.S. Department of Education, 2010). No rigorous and comprehensive database currently exists to support educators. Within the field of special education, single-subject research is the primary research methodology (Horner, Carr, Halle,…

The passage of the Individuals With Disabilities Education Improvement Act and the No Child Left Behind Act has highlighted the importance of all students having access to the general education curriculum. Because students with disabilities are being included in the general education classroom in greater numbers, teachers need to implement…

This article examines changes in the research design, sample size, and precision between the planning phase and implementation phase of group randomized trials (GRTs) funded by the Institute of Education Sciences. Thirty-eight GRTs funded between 2002 and 2006 were examined. Three studies revealed changes in the experimental design. Ten studies…

In the wake of an increasing political commitment to evidence-based decision making and evidence-based educational reform that emerged with the No Child Left Behind effort, the question of what counts as evidence has become increasingly important in the field of science education. In current public discussions, academics, politicians, and other…

Although implementation of evidence-based practice (EBP) has been strongly advocated by federal legislation as well as school districts in recent years, the concept has not been well accepted in adapted physical education (APE), perhaps due to a lack of understanding of the central notion of EBP. The purpose of this article is to discuss how APE…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

Professionals mostly agree that scientific research should guide practice in education. The Individuals with Disabilities Education Improvement Act (IDEIA; 2004) and the No Child Left Behind Act (2002) require that students with disabilities receive research-based practices in the "least restrictive environment." Because the least…

The field of evaluation faces a number of serious challenges in light of No Child Left Behind legislation, among them feasibility, resources, and blurring lines among research, evaluation, and assessment. At the same time, these challenges open the door for opportunities in evaluation. Now more than ever, the expertise of evaluators is needed and…

The authors of the "No Child Left Behind Act of 2001" anticipated that a majority of school districts or schools would not be able to attain state and national achievement standards without assistance. Consequently, the Act created a major tenet known as Supplemental Educational Services (SES) programs to improve the learning outcomes of…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

The recent emphasis on scientifically-based research (SBR) as the government's favored research paradigm has direct implications for career and technical education (CTE). From a practical standpoint, federal funds will now be appropriated exclusively on scholars' readiness and ability to engage the "right" research questions. While the…

A major tenet of both the Individuals with Disabilities Education Act and the No Child Left Behind Act is the identification and use of evidence-based practices, or those instructional techniques shown by research as most likely to improve student outcomes meaningfully. However, much confusion exists regarding the meaning and potential…

A core component of the No Child Left Behind Act (NCLB, 2001) is the provision of free after-school tutoring services, labeled "supplemental educational services" (SES), to eligible students. Importantly, an explicit NCLB requirement makes each state responsible for evaluating individual SES providers with regard to effectiveness in…