Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

Higher education has made impressive progress concerning student learning outcomes assessment practices. Yet--despite the assumption that better assessment would lead to better student learning--few examples of demonstrable student learning improvement exist at the academic degree or university levels. In 2014 Fulcher, Good, Coleman, and Smith…

Teachers are responsible for using evidence-based practices to improve students' academic and behavioral outcomes. Although teachers have access to a variety of resources on evidence-based practices, poor implementation can adversely affect their effectiveness. However, an inadequate student response to intervention may also be the result of…

Implementation refers to the process by which an intervention is put into practice. Research studies across multiple disciplines, including education, have consistently demonstrated that interventions are rarely implemented as designed and, crucially, that variability in implementation is related to variability in the achievement of expected…

Many leadership development programs are intended to improve individual leaders' skills and abilities to perform. Methods for measuring the effect of such programs range from simple metacognitive self-report surveys to 360-degree feedback, to instrumentation of psychological phenomena. However, the outcomes of some leadership development programs…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

The PISA project has steadily increased its influence on the educational discourse and educational policies in the now 70 participating countries. The educational debate has become global, and the race to improve PISA-rankings has become high priority in many countries. For governments the PISA-test is a high-stake test. Governments are blamed for…

The primary users of the current college ranking systems do not seem to be high-school students and families, but college presidents, board members, and development officers. As structured, the commercial ranking systems imply a precision that is not corroborated by research on what matters in college, nor can college quality be accurately summed…

Assessment serves many purposes in the elementary classroom. Formative assessment, often called assessment for learning, is characterized by its primary purpose--promoting learning. It takes place both formally and informally, is embedded in various stages of an instructional cycle, informs the teacher about appropriate next steps for instruction,…

New York's Cornell University spends millions of dollars and thousands of staff and volunteer hours to produce more than 1,400 events around the world each year. That's one event every six hours. Is it worth it? Do the 40,000 alumni, parents, and friends who attend feel closer to Cornell after these events? Do they disengage because Cornell didn't…

This study investigated whether active learning within computer-based training courses can be measured and whether it serves as a predictor of learner-perceived course quality. A major corporation participated in this research, providing access to internal employee training courses, training representatives, and historical course evaluation data.…

Over the last 10 to 15 years, each province and territory in Canada has introduced curriculum based on clearly defined learning goals. They use different labels--for example, "learning outcomes" in Manitoba and Alberta, "expectations" in Ontario--but all are intended to be "standards-based" systems where the focus is…

This article describes the Voluntary Support for Education (VSE) Survey, an instrument created by the Council for Aid to Education. Our objective is to explain VSE's potential value as a tool to inform both institutional and academic research regarding fund-raising activities at community colleges. Of particular interest is how the data available…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…