Reviews research on elementary school pupils' ratings of teacher effectiveness. Concludes adequate research exists to generalize that pupils can rate reliably, pupils may be no more vulnerable than others to rating leniency and halo, psychometric characteristics and factor structures of rating scales resemble those of college students,…

The five articles of this special section show that evaluations of corporate education range from state of the art to poorly conceived evaluation research. Several of the efforts reported here incorporate efficient and exemplary use of modern evaluation concepts and techniques and can serve as examples for future evaluations. (SLD)

This paper argues that efficacy of early intervention must be assessed in relation to both program and extra-program variables. A framework outlining five classes of independent variables and two classes of outcomes to be considered in efficacy research is presented, and regression and path analytic techniques are suggested as tools for addressing…

Reviews and analyzes criticisms of the design of media evaluation studies; suggests guidelines for future evaluation studies, including analyses of learning theories and desired learning outcomes; and describes the application of the evaluative guidelines to an interactive video in an English comprehensive school with 14-year-olds. (Contains 26…

A strategy is presented for using media exposure to increase evaluation use, including reasons for using media, suggestions about whether to use mass (print and electronic) or specialized (interest-group oriented trade) media, and 10 recommendations for effective use. Program change can be accelerated when media are used effectively. (SLD)

Outlines the policy context of New Zealand early childhood program evaluation and quality. Presents ethnographic research findings on key elements of program quality in relation to New Zealand National Early Childhood Curriculum; findings provide basis for self-evaluation framework through use of Teaching Stories as a focus for reflection and…

Describes the development of a multimedia Web-based assessment system for computer literacy at Hong Kong Baptist University. Presents findings of a study that investigated students' behavior, performance, and perception in the use of this assessment system and discusses future plans which include improving the user interface. (Author/LRW)

Introduction: Different people who have a stake or interest in a training course (stakeholders) may have markedly different definitions of what constitutes "training success" and how they will use evaluation results. Methods: Stakeholders at multiple levels within and outside of the organization guided the development of an evaluation plan for a…

Informal Reading Inventories (IRI) are often recommended as instructionally relevant measures of reading. However, they have also been criticized for inattention to technical quality. Examination of reliability evidence in nine recently revised IRIs revealed that fewer than half report reliability. Several appear to have sufficient reliability for…

Corporate universities have developed a variety of useful and creative methods for mission-specific evaluation. (Contains 3 figures.)

Mantel-Haenszel and SIBTEST, which have known difficulty in detecting non-unidirectional differential item functioning (DIF), have been adapted with some success for computerized adaptive testing (CAT). This study adapts logistic regression (LR) and the item-response-theory-likelihood-ratio test (IRT-LRT), capable of detecting both unidirectional…

Cudeck and Browne (1983) proposed using cross-validation as a model selection technique in structural equation modeling. The purpose of this study is to examine the performance of eight cross-validation indices under conditions not yet examined in the relevant literature, such as nonnormality and cross-validation design. The performance of each…

During the past 3 years, the Oral History Project Study Team, which comprises Jean King, Mel Mark, and Robin Miller, has conducted interviews with individuals who have made signal contributions to the program evaluation field. Their goal was to capture the professional evolution of those who have contributed to the way evaluation in the United…

Reflective peer coaching is a formative model for improving teaching and learning by examining intentions prior to teaching, then reflecting upon the experience. The goal of reflective peer coaching is to promote self-assessment and collaboration for better teaching and ultimately better learning. There are obvious benefits to colleagues…

This study charts the terrain of research on writing during the 6-year period from 1999 to 2004, asking "What are current trends and foci in research on writing?" In examining a cross-section of writing research, the authors focus on four issues: (a) What are the general problems being investigated by contemporary writing researchers? Which of the…