The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

The acceptance of the Scholarship of Teaching and Learning (SoTL) as a legitimate form of scholarly investigation and the shape that it takes in post-secondary education are inherently discipline-specific. This paper examines how the character and heritage of public administration influence the acceptance of SoTL, and the form that it takes. It…

Evaluation studies can provide feedback on implementation, support continuous improvement, and increase understanding of evaluation systems' impact on teaching and learning. Despite the importance of educator evaluation studies, states often need support to prioritize and fund them. Successful studies require expertise, time, and a shared…

Access to college has increased substantially over the last 50 years, but student success--defined as the combination of academic success and degree or certificate completion--has not kept pace. Student success, moreover, generally correlates with students' financial resources: Students from high-income families attend and complete college at…

In 2010, HCM Strategists received support from the Bill & Melinda Gates Foundation to engage academic researchers in identifying and discussing the best currently available ways to account for differences in college "inputs"--students, resources, and fixed characteristics--when evaluating postsecondary outcomes. The project, Context…

There is a growing body of research on the validity and reliability of value-added measures, but most of this research has focused on elementary grades. Driven by several federal initiatives such as Race to the Top, Teacher Incentive Fund, and ESEA waivers, however, many states have incorporated value-added measures into the evaluations not only…

The objective of this evaluation research was to assess the impact of programs intended to support the enforcement component of a comprehensive youth tobacco control. The research method was a survey of a randomly stratified cluster sample of law enforcement officers. Results of the evaluation showed that the enforcement behaviors of officers were…

Government policies designed to redress social inequality are often evaluated by qualitative methods, which prevents the establishment of a causal relationship between policy objectives and outcomes. Social programmes to broaden participation in higher education have been a feature of government policy in Europe, the US and Australia during the…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

The role of musical intelligence was investigated in grades K-3 at a central Florida elementary school. Teachers implemented the Theory of Multiple Intelligences (MI) of Howard Gardner in elementary curricula. The guiding question in this research was: What, if any, musical growth takes place as a result of a MI curriculum? The extent and quality…

The Project on State-Level Child Outcomes was initiated by the U.S. Department of Health and Human Services to examine the effects on children of waiver policies related to state welfare reform efforts prior to the passage of federal welfare reform legislation. This report details the project's examination of child well-being in the context of…

Many states have implemented high-stakes testing since the enactment of the No Child Left Behind Act of 2001. Yet the question remains whether high-stakes tests effectively measure student proficiency. This report describes a study that compared results on high-stakes tests with results on other standardized tests not used for accountability…

Measuring History complements the cases presented in Wise Social Studies Practices (Yeager & Davis, 2005). Yeager and Davis highlight the rich and ambitious teaching that can occur in the broad context of state-level testing. In this book, the chapter authors and I bring the particular state history tests more to the fore and examine how…