Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

The field of evaluation faces a number of serious challenges in light of No Child Left Behind legislation, among them feasibility, resources, and blurring lines among research, evaluation, and assessment. At the same time, these challenges open the door for opportunities in evaluation. Now more than ever, the expertise of evaluators is needed and…

This article argues with a literature review that a simplistic distinction between strong and weak evidence hinged on the use of randomized controlled trials (RCTs), the federal "gold standard" for generating rigorous evidence on social programs and policies, is not tenable with evaluative studies of complex, field interventions such as…

A core component of the No Child Left Behind Act (NCLB, 2001) is the provision of free after-school tutoring services, labeled "supplemental educational services" (SES), to eligible students. Importantly, an explicit NCLB requirement makes each state responsible for evaluating individual SES providers with regard to effectiveness in…

Background: Accountability demands are increasingly pushing school leaders to explore more data and do more sophisticated analyses. Data-driven decision making (DDDM) has become an emerging field of practice for school leadership and a central focus of education policy and practice. Purpose: This study examined principals' DDDM practices and…

This paper discusses different perspectives associated with the use of multiple measures in educational assessment and explores some of the technical considerations for selecting and combining multiple measures. The paper concludes with an example of the use of multiple measures with regard to the recent No Child Left Behind (NCLB) Act of 2002.…

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…

This article reports on the research design and implications stemming from a statewide evaluation developed during a Department of Education Title IID (EETT) grant. This article introduces critical issues to consider while developing research and evaluation methods for technology integration projects. The North Carolina IMPACT project, an…

Beginners in many disciplines learn that correlation never proves causation, but sometimes, even in public health, correlation, mistaken for causation, becomes the basis for policy and great expenditures of public and private money. "True experiments" with random assignment to experimental and control groups hold a special place in the…