Institutions of higher education are asked to consider how their work can advance equity in institutional outcomes. Assessment, too, has been asked to consider the ways in which traditional student assessment "privileges and validates certain types of learning and evidence of learning over others" (Montenegro and Jankowski 2017, p. 5).…

Implementation fidelity data indicate to what extent the delivered educational intervention (e.g., pedagogies, curricula) differs from the designed intervention (Gerstner & Finney, 2013; O'Donnell, 2008). Fidelity data help practitioners make more accurate inferences regarding program effectiveness (Dumas, Lynch, Laughlin, Smith, & Prinz,…

An approach to evaluation initiated by the Kellogg Foundation called cluster evaluation (not to be confused with cluster sampling) is described. Cluster evaluation provides a skilled, credible evaluator to work with a cluster of projects to assure that useful and defensible information is obtained for program evaluation. (SLD)

Personnel at Saint Louis University's Department of Education have been theorizing, researching, and enlarging an approach to program evaluation that focuses heavily on the place of values in making judgments. This work originally stemmed from general curriculum evaluative theory developed by James H. McElhinney and Richard C. Kunkel. The content…

The problems, procedures, and benefits of case-study program evaluation are investigated. An evaluation plan that included several data collection methods (document review, interview, content analysis, attitude questionnaire survey, sociogram analysis) and emphasized the role of the evaluator as participant-observer, collector and synthesizer of…

The effects of using recommended data collection procedures on median recommended test standards, variability of recommended test standards, and reliability of recommended standards for 7 subtests of the National Teacher Examinations Communications Skills and General Knowledge Tests were explored, using 236 evaluators (75 public school teachers…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

Administering measures of students' ethical orientation at various points in the education of business students would be helpful in determining the affective impact of the curriculum. Procedures for eliminating item bias and maximizing the validity and reliability of such measures are discussed and illustrated through actual data collected in the…

This guide was designed for trainers presenting inservice workshops for program evaluators, teachers, principals, curriculum specialists, and others responsible for school programs. It is keyed to a companion volume, the Program Evaluator's Guide (ED l42 563), the primary source for workshop participants. Developed under the California Evaluation…

The role of expert judges in establishing the content validity of the National Teacher Examinations (NTE) was examined in a detailed study. The NTE are used in 22 states for screening applicants to teacher education programs and/or for screening candidates for initial teacher certification. Such extensive use of the NTE has stimulated 35 recent…

The Cooperative Assessment of Experiential Learning (CAEL) Project involves Educational Testing Service and some 250 member institutions. The purpose of the project is to develop procedures and materials that will be useful in strengthening the assessment of experiential learning in higher education. This report describes extensive findings that…