Researchers have explored a variety of topics related to identifying and distinguishing among specific types of rater effects, as well as the implications of different types of incomplete data collection designs for rater-mediated assessments. In this study, we used simulated data to examine the sensitivity of latent trait model indicators of…

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Racial and ethnic identity (REI) measures are in danger of becoming conceptually meaningless because of evaluators' insistence that they conform to measurement models intended to assess unidimensional constructs, rather than the multidimensional constructs necessary to capture the complexity of internalized racial or cultural socialization. Some…

Third stream evaluation, the fusing of the ecological perspective with experimental or quasi-experimental evaluation design, is described. The ecological perspective necessitates that the conceptualization and analysis of a setting and the design of the study emphasize the interdependent relations among organisms, behavior and environment in…

This paper provides an understanding of the conceptual and operational relationships between evaluation, content analysis, and microcomputers so that evaluation practitioners can better address applied content analysis problems used in their work. The first section presents a general model for conducting an evaluation effort that focuses on…

The politics of program evaluation are discussed from the personal perspective of the Director of the General Accounting Office's Program Evaluation and Methodology Division, which has produced reports for committees of the United States Congress. It is concluded that successful evaluations must be useful to others and must understand the…

As an introduction to the Program Evaluation Kit, this handbook serves as a general guide for the evaluator and provides a directory to the rest of the series (TM 008 703-710). Chapter 1 discusses the critical issues in program evaluation. Chapter 2 describes the diversified job of the evaluator. Chapters 3 through 5 contain step-by-step guides…

The first half of this monograph provides an overview of the theoretical concerns of evaluators. Definitions are provided of accountability, measurement, assessment, evaluation research, formative and summative evaluation, goal-free evaluation, goal-based evaluation, and evaluation. Several models of evaluation are described and discussed,…