This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

An annotated bibliography is organized to match the format of the Standards for Evaluations of Educational Programs, Projects, and Materials, including sections on utility, feasibility, propriety, and accuracy of evaluations. It identifies literature that includes in-depth information about the issues covered in the Standards. The Standards are…

Meta-analysis is a collection of systematic techniques for resolving apparent contradictions in research findings. Meta-analysts translate results from different studies to a common metric and statistically explore the relations between study characteristics and findings. Since G. Glass first used the term "meta-analysis" in 1976, it has…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

This document consists of the first 10 articles of volume 8 of the electronic journal "Practical Assessment, Research & Evaluation" published in 2002-2003: (1) "Using Electronic Surveys: Advice from Survey Professionals" (David M. Shannon, Todd E. Johnson, Shelby Searcy, and Alan Lott); (2) "Four Assumptions of Multiple Regression That Researchers…

Studies on the criterion validity of student evaluation-of-instruction instruments are analyzed, and recommendations are offered for future research into student evaluation of instruction. The main problem, and probably the reason for the lack of validity studies, is that it is difficult to agree on what the criteria of effective teaching should…

This digest discusses the use of benchmarking as a strategy for assessing and improving efficiency and productivity of administrative processes and instructional models in colleges and universities. Benchmarking, developed by the Xerox Corporation in the 1980s, is defined as an ongoing, systematic process for measuring and comparing the work…

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…

This report concerns the use of benchmarking as a strategy for assessing and improving efficiency and productivity of administrative processes and instructional models in colleges and universities. The introductory chapter addresses the need for new tools and strategies to meet the increased competition and the higher demand for accountability…

Some steps to identify an initial set of indicators and to develop alternative indicator systems are outlined for educational evaluation and illustrated through the example of a National Science Foundation (NSF) study of mathematics and science education. The first step is to conceptualize potential indicators to specify a comprehensive monitoring…

Salary equity issues in higher education are examined with reference to sex discrimination in faculty salaries, the law and its application, judicial deference toward higher education, and the nature of salary equity evidence. The basis for most salary equity studies has been the simple observation that salaries of male professors are generally…

Directed at practitioners in adult and career education, this document defines qualitative research, compares qualitative research to quantitative research, describes the "war" between proponents of each kind of research, describes how to assess qualitative research, and explains how to choose and use qualitative techniques. Pitfalls of…