Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of fourth- and fifth-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations…

The current literature is replete with instances of imprecise and conflicting usage of "qualitative" and "quantitative" evaluation. This paper presents a framework for making distinctions among several related concepts to eliminate this potential source of confusion. In the process, the terms "qualitative" and…

Potential sources of bias are classified as ethical compromises, value inertias, or cognitive limitations. Thirteen specifics of intuitive thinking and judgmental processes are described. The author wishes to alert naturalistic evaluators to common failings. This list can be a useful checklist in reducing, integrating and drawing inferences from…

Examines and compares various outcomes of education, such as standardized test results, classroom observations, teacher reports, and teacher interviews, in terms of their potential to inform policymakers about policy influences on student outcomes. Suggests the need for clearer understanding of how these approximations are related to each other.…

U.S. Department of Education (ED) activities relating to the utility of Title I evaluations are discussed within the context of an overview of the Title I Evaluation and Reporting System (TIERS) and a history of Title I evaluations. Implications for Chapter 1 of the Education Consolidation and Improvement Act (ECIA) of 1981 are considered. (LC)

A critical guide is offered regarding ethnographic evaluation data: the analytical descriptions or reconstructions of intact cultural scenes and groups which delineate the shared beliefs, practices, artifacts, folk knowledge, and behaviors of some group of people. (PN)

This paper describes eight problems faced by a school district evaluator in evaluating state-funded, compensatory education programs: determining evaluation ownership, determining the major constraints, determining what to evaluate, determining what methods to use, determining participant characteristics, determining instrumentation, determining…

Problems that face evaluators, including field based evaluations, are discussed. The author states that open communication, access to data, and an ability to be accepted are paramount; knowledge of randomness, robustness and homoscedasticity may be secondary. (Author/PN)

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

Using examples from an evaluation design of a bilingual preschool program, the authors have developed a paradigm resting on contextually based evaluation and involving implementation strategies and participant researchers. Multiple methods of gathering environment-specific data are used in the process. (MH)

Drawing on British data, this article discusses issues involved in analyzing educational indicator data. Gross productivity, new productivity, and inequality are discussed as types of indicators that describe interdistrict variation in Great Britain. Recommendations are made regarding features of an educational assessment that would be necessary…

A performance evaluation model is presented to address the need for measuring the effectiveness of educational training programs in institutions of higher learning. The model emphasizes outcomes by assessing the quality of change that occurs in individual and program performance. (Author/LMO)

The Judicial Evaluation Method (JEM) is useful for aiding decision-making bodies to formulate policies. Broad public participation in complex issues is provided by JEM. (The conceptualization, policy formulation stages, and participant roles are identified; and the model is applied in two case studies). (MH)

This study evaluates 35 federal and privately sponsored databases that report national education statistics in terms of their potential for informing policy deliberations. It argues that for all the national data collected, information is lacking on several major concerns, is often inadequate statistically, and is sometimes contradictory. Various…