The term "peer consultation," like the term "teaching," encompasses many methods and strategies. Some confusion about peer consultation (often called "peer coaching") stems from lack of understanding about how these procedures use peers (fellow teachers) as observers, mentors, coaches, or collaborators. To dispel…

This special issue deals with the preparation of professional evaluators. Evaluation is considered as a profession that warrants specialized training. Aspects of necessary training and descriptions of current programs are discussed. (SLD)

Methods of probability modeling to analyze rater agreement are described, emphasizing their basic similarities and viewing them as variants of a common methodology. Statistical techniques for analyzing agreement data are described to address questions such as how many opinions are required to make a medical diagnosis with necessary accuracy. Kappa…

This eight chapters of this special issue introduce the use of a template to specify program components as a new tool for program evaluation. The template articulates the components needed for program delivery and provides a systematic method for assessing program implementation. (SLD)

The five articles of this sourcebook, organized around the five-component framework for evaluation described by W. Shadish, T. Cook, and L. Leviton (1991), present a new theory of realist evaluation that captures the sensemaking contributions of postpositivism and the sensitivity to values from the constructivist traditions. (SLD)

Two chapters of this issue consider critical multiplism as a research strategy with links to meta analysis and generalizability theory. The unifying perspective it can provide for quantitative and qualitative evaluation is discussed. The third chapter explores meta analysis as a way to improve causal inferences in nonexperimental data. (SLD)

This study examines 103 meta-analyses related to educational achievement published over 10 years to produce a meta-synthesis. Various characteristics of the meta-analyses are summarized to produce a methodological profile of research, and effect sizes are synthesized to assess an educational productivity model. (SLD)

The six chapters of this theme issue attempt to define conceptual and methodological issues in the evaluation of integrated services systems and to begin to synthesize some of these issues. An introduction to these evaluation issues is followed by case studies and a discussion of implications for program and policy development. (SLD)

A bargaining process, begun over 10 years ago, is based on problem-solving rather than on adversarial confrontation and uses elements of participative management. It has resulted in outstanding benefits for two school districts. Called "Theory Z bargaining," the process follows a procedure based on each side treating the other with…

The eight articles of this issue examine the nature of differences that arise between qualitative and quantitative researchers in program evaluation in terms of goals and epistemologies. The origins of these differences and their consequences are explored. Authors represent both perspectives but do not defend their ideological turfs. (SLD)

Assessment systems to measure high educational standards emerged as the major theme at the 1996 conference of the National Center for Research on Evaluation, Standards, and Student Testing (CRESST), "Moving Up to Complex Assessment." This feature article, providing a summation of the proceedings of the conference, reports that the…

Seven chapters present 31 propositions challenging traditional ideas about the nature and practice of program evaluation. Methods to improve evaluation models and approaches and ways to address intermediate and advanced evaluation issues are explored. The discussion also serves as an introduction to the most analytical and comprehensive of the…

The six articles of this theme issue relate the history of empirical research in education to its sociohistorical background, examining the proposition that the rise of empirical research in education was linked to complex factors such as the rise of positivism in the 19th century or the institutional growth of an educational market. (SLD)

The horizontal evaluation model was developed to remedy three major problems associated with competency-based approaches to teacher evaluation: there is no consensus regarding what competencies are essential to good teaching; teachers' behaviors may or may not be related to competencies they possess; and competency-based evaluation typically fails…

This issue contains articles on mathematical modeling of school arithmetic word problems; cognitive load theory; cognitive effects of practical experience for high and low achievers; perspectives of college-bound students on learning mathematics; and training-based assessment of school achievement. (SLD)