Higher education professionals often are tasked with providing evidence to stakeholders that programs, services, and practices implemented on their campuses contribute to student success. Furthermore, in the absence of a solid base of evidence related to effective practices, higher education researchers and practitioners are left questioning what…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

To better comprehend the needs of your clientele and colleagues, it is essential to use survey website applications. Doing so will help you become more efficient in obtaining constructive, timely feedback in order to adjust programming, therefore optimizing the impacts of Extension activities. Citing the most influential survey experts both in and…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

Access to Head Start has been shown to improve children's preschool experiences and school readiness on selected factors through the end of 1st grade. Two more years of follow-up, through the end of 3rd grade, can now be examined to determine whether these effects continue into the middle elementary grades. The statistical design and impact…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Care Quality Rating and Improvement Systems (QRISs) have advanced and matured, a number of states and localities have undertaken evaluations to validate the systems. Such efforts stem from the desire to ensure that the system is designed and operating in the ways envisioned when the system was established. Given that a central component in a QRIS…

When attempting to determine if an intervention has a causal impact, the "gold standard" of program evaluation is the randomized controlled trial (RCT). In education studies random assignment is rarely feasible at the student level, making RCTs harder to conduct. School-level assignment is more common but this often requires considerable resources…

This article presents propensity score matching as a method to implement randomized conditions to analyze service effects using nonexperimental data. Most social work research is challenged to implement randomized clinical trials, whereas administrative and survey data are often available and can provide valuable information about services…

This handbook is intended to help educational evaluators use still photography in designing, conducting, and reporting evaluations of educational programs. It describes techniques for using a visual documentary approach to program evaluation that features data collected with a camera. The emphasis is on the aspects of educational evaluation…

Factors that influence the sample size necessary for longitudinal evaluations include the nature of the evaluation questions, nature of available comparison groups, consistency of the treatment in different sites, effect size, attrition rate, significance level for statistical tests, and statistical power. (Author/GDC)

Flexibility in evaluative research design does not necessitate the abandonment of randomly constructed comparison groups. Three designs are reviewed which provide at least the option of randomization while maintaining great flexibility. The strengths and weaknesses of the designs are discussed. (Author)

Limiting data collection to a sample group is one way to increase effectiveness in dealing with data. The paper describes how to draw a sample group (random sampling, stratified random sampling, purposeful sampling, and convenient or opportunity sampling) and discusses how to determine the size of the sample group. (SM)

Commentary is presented on the evaluation of the Emergency School Aid Act and on an article detailing that evaluation (TM 503 672). The use of randomization and pilot studies is emphasized. (J KS)