The purpose of this article is to identify proper uses for mixed methods in leadership research and assessment. This article will highlight research and assessment questions that are best served by mixed methods and will offer practitioner-friendly guides and examples for integrating quantitative and qualitative data to help eat the whole whale…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

Practitioners are not afforded the luxury of ideal laboratory conditions. The natural settings of the classroom, the school, or the school system place constraints on the type of data obtainable; hence, educators must work with less than an ideal experimental design. Four evaluation designs used in natural settings are described. Each involves an…

This final chapter summarizes the areas of consensus in the debate on method choice, including considering the nature of the primary evaluation questions, the nature of the phenomenon being evaluated, the constraints on the evaluation, and ethical issues. Pragmatic suggestions based on these areas as well as areas still in contention are offered.…

The U.S. Department of Education recently held a competition for grants to support states in their efforts to build longitudinal data systems to track and analyze student and school performance. The Value-Added Research Center (VARC) at the Wisconsin Center for Education Research, University of Wisconsin-Madison, proposed a Tri-State Partnership…

As the procedures of evaluation research have developed during recent years, it has become clear that the results of evaluation studies have failed to provide policy decision makers with useful information. An approach towards designing and implementing more useful evaluations--the stakeholder survey--is discussed. Stakeholders are individuals, or…

A candid appraisal of the difficulties faced in establishing a research and education division at John Adams High School. (Author)

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)

The need for competent formal evaluation programs, particularly for new federally assisted programs, is expressed. Problems in defining educational evaluation and its requirements, in designing such evaluations, and 3 possible sources of faulty conceptual bases for evaluations, are presented. An attempt is made to define evaluation in general, to…

Factors involved in pre-planned and post-planned evaluation of program effectiveness are compared: (1) reliability and cost of data; (2) internal and external validity; (3) obtrusiveness and threat; (4) goal displacement and program direction. A model to help program administrators decide which approach is more appropriate is presented. (Author/MH)

This report is arranged to display and explain the work of the Evaluation Design Project staff during the 1980-81 grant year. The intent of the entire project is to examine existing district policies, procedures and programs that appear to contribute to systematic use of evaluation and testing for educational improvement, and to make…

An internal evaluation was carried out on the governing procedures of the Center for Curriculum and Instruction at the University of Nebraska-Lincoln during the spring semester, 1985-86. The evaluation focused on the major governance committee within the Center (the Center Executive Committee) and its relationship with the two other forms of…