This executive summary presents results from a study that began in 2013-2014, and involves a longitudinal design to follow a sample of 1,169 children (139 Spanish-speaking DLLs) who attended 199 randomly-selected Georgia's Pre-K classrooms. These findings focus on results from the second year of the study, which included 1,034 of these children…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Several statewide evaluations of Tier 1/Universal Level Positive Behavior Support (PBS) implementation efforts have been conducted, adhering to the evaluation template developed by Horner, Sugai, and Lewis-Palmer in 2005. Building on these examples, Florida's Positive Behavior Support Project developed a comprehensive evaluation system that sought…

District implementation of the response to intervention (RTI) model has occurred at a surprising rate. It appears that implementation of RTI has occurred rapidly and is being implemented with all students. Rapid implementation of RTI is occurring alongside continued controversy over the model and its intended uses. Although significant research…

Education reform advocates who base policy decisions on empirical research often face the argument that because background variables explain so much of student outcomes, it follows that policy interventions cannot be effective. This policy brief explains the logical fallacy in the argument, illustrating with two examples, one taken from the…

There is a growing recognition of the value of measuring fidelity of implementation (FOI) as a necessary part of evaluating interventions. However, evaluators do not have a shared conceptual understanding of what FOI is and how to measure it. Thus, the creation of FOI measures is typically a secondary focus and based on specific contexts and…

Those who design admissions policies and procedures are the gatekeepers of higher education, and thereby play a role in shaping the direction of human society. Every year selective universities face the difficult challenge of sifting through the application materials of millions of high school graduates and deciding which applicants should be…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

Describes the success rate index and computer software utilized to evaluate the effectiveness of residential treatment programs. The program is sensitive to influences, provides for differential weighting of quantitative evidence, and provides information that can guide planners in improving the quality of treatment. (BL)

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

Purpose: Facing the multiplication of entrepreneurship education programmes (EEP) and the increasing resources allocated, there is a need to develop a common framework to evaluate the design of those programmes. The purpose of this article is to propose such a framework, based on the theory of planned behaviour (TPB). Design/methodology/approach:…

Describes an inductive approach to the evaluation of developmental studies programs using multiple regression analysis to explore variables that contribute to program success. (DR)

Proposes a systematic approach that focuses on student success and continual improvement in retention to assess college student retention programs Identifies three major components of retention research: (1) determining dropout predictors; (2) identifying critical points; and (3) validating outcomes assessment of retention endeavors. Also…

When studying different types of returns to education, educational reforms are commonly used in the economics literature as a source of exogenous variation in education. The Swedish compulsory school reform is one example; the reform extended compulsory education throughout the country, in different municipalities at different points in time. Such…

Some early childhood variables are examined to evaluate their predictive validity. The selection of children needing early childhood Title I services is complicated by the lack of criteria for defining who is educationally disadvantaged and the special problems of early childhood testing and measurement. The study used re-analysis of longitudinal…