Professional standards related to outcomes assessment call for student affairs professionals to use research to inform programming. If professionals are to rely on research to build programs that positively impact student learning outcomes, the research should be credible. We examined the quality of program effectiveness research available for…

One of the most widely used commercially available systems incorporating benchmark assessment and training in differentiated instruction is the Northwest Evaluation Association's (NWEA) Measures of Academic Progress (MAP) program. The MAP program involves two components: (1) computer-adaptive assessments administered to students three to four…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

In this article we give a systematic review of the nature and design of earlier research into the impact of instructional development in higher education. Studies are clustered on the basis of the level of outcome that was measured, meaning that another synthesis technique is used than in prior reviews related to the same topic. In addition, we…

Purpose: District effectiveness research (DER) is an emerging field concerned with identifying the organizational structures, administration, and leadership practices at the school district level that help districts find success with all of their students across the schools within the system. This work has mirrored much of the early school…

The last major review of the achievement outcomes of comprehensive school reform (CSR) models was conducted in 2003. Despite the growing evidence base supporting CSR, the program was discontinued by the federal government in 2007. Now, six years after the 2003 meta-analysis, the study's lead author, Geoffrey Borman, revisits the results and…

Evaluative statements from alumni have legitimacy with both internal and external stakeholders. Thus, alumni studies can provide valuable evidence of institutional effectiveness and lend themselves to both locally designed and commercial survey instruments for data collection. Under ideal conditions, the results of alumni studies equip faculty and…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

Evaluations of practice have often adopted experimental or quasi-experimental approaches and have focused heavily on outcomes of innovative programmes. This creates problems in replicating studies and effectively creates obstacles to the sharing of good practice. In this paper, ideas from Pawson and Tilley's (1997) approach to Realistic Evaluation…

This article presents evidence from a national evaluation of the effects of 21st Century Community Learning Center after-school programs. The study was conducted in 12 school districts and 26 after-school centers, at which 2,308 elementary school students who were interested in attending a center were randomly assigned either to the treatment or…

This paper examines how controlling statistically for baseline covariates (especially pretests) improves the precision of studies that randomize schools to measure the impacts of educational interventions on student achievement. Part I of the paper introduces the concepts, issues, and options involved. Parts II and III present empirical findings…

Problems when developing and operating a successful student assessment program are described. Potential problems and solutions in three major areas are examined: the purposes and definitions of assessment, program implementation, and assessment designs and methods. (Author/MLW)

This workbook, which accompanies An Evaluation Primer (TM 007 500) consists of 19 practical exercises for applying evaluation skills to hypothetical educational programs. Each chapter corresponds to a chapter in the primer, with answers keyed accordingly. Intended to provide an introduction to evaluation, the exercises include: identifying the…

The work of the Program Effectiveness Panel (PEP) of the United States Department of Education was examined. The PEP is the Department of Education's primary means of certifying or validating the effectiveness of educational programs. Thirty-three educational programs were validated by the PEP between January 1988 and December 1990. Over time,…

Intended for those who are concerned with evaluation but do not have an extensive background, this textbook helps students, scientists, evaluators, and administrators conduct and interpret evaluations. It deals with evaluations in all social action programs--health, education, and welfare. The focus is on basic procedures, rather than on theory,…