The basis of agreement or disagreement among judges/evaluators when applying a coding scheme to concurrent verbal protocols was studied. The sample included 20 university graduates, from varied backgrounds; 10 subjects had and 10 subjects did not have experience in protocol analysis. The total sample was divided into four balanced groups according…

The primary function of the Title I Technical Assistance Center (TAC) was to facilitate the implementation of the Title I Evaluation and Reporting System (TIERS) in local school districts by providing technical assistance in evaluation to state education agency and local education agency personnel involved in Title I activities. However,…

Use factors comprise those characteristics or elements present in evaluation settings that potentially affect use. This paper focuses on one such use factor, termed "written requirements for the evaluation." This factor includes the evaluation requirements accompanying federally-funded programs. Two questions are dealt with: how does…

A method of evaluation that is appropriate for a student affairs department that contains more than one service unit (e.g., a counseling center or student union) is described. A staff member in each service unit is appointed to conduct that unit's self-study, with the consultative help of an experienced evaluation coordinator. For each unit, the…

This four-part handbook, developed by the Accrediting Commission for Community and Junior Colleges of the Western Association of Schools and Colleges (WASC), is intended for use by two-year institutions under review, members of evaluation teams, and others concerned with good practice in two-year institutions. Part I reviews the purposes of…

In this context, ethics refers to a set of normative standards for resolving dilemmas that policy analysts or evaluators often face with regard to what they should do in performing their roles in the interests of societal desirability. The dilemmas relate to: (1) prediction versus prediction plus prescription; (2) evaluation versus evaluation plus…

Since observers' memory-based ratings of organizational phenomena provide data in research and decision-making contexts, bias in observers' judgments must be examined. A study was conducted to explore the extent to which leader behavior ratings are more generally biased by the availability heuristic. The availability heuristic is operative when a…

This three-volume set outlines the policies, procedures, and requirements of the Western Association of Schools and Colleges' Accrediting Commission for Community and Junior Colleges. First, the "Handbook of Accreditation and Policy Manual" covers the following topics: (1) eligibility for accreditation and requirements for maintaining…

The role of sample papers (i.e., anchor papers, prototypes, range-finders) in holistic evaluation of writing is discussed. When, where, and how many sample papers are to be selected, and who should perform the selection are covered. The process of sample selection should proceed as follows: (1) a general reading of papers by committee members to…

Hypothesis generation and testing is outlined as an additional domain for program evaluators. Program evaluation involves a thorough analysis of the processes that contribute to change (or a lack of change) among program recipients. This process of change is analyzed in two ways: (1) treating programs as naturally occurring field studies; and (2)…

A conceptual framework and practical approach are presented focusing on the possibility of making an evaluation of tertiary educational institutions by means of different levels, categories, and criteria of analysis. The paper is a preliminary reference design of evaluation whose theoretical approach is summarized with a more extensive…

From 1980 through 1983, 41 articles in selected professional journals dealt with summative evaluation of training and development efforts in business and industry. All of the standard components of program evaluation were addressed either directly or indirectly in them, in varying degree and depth. Although one must contact the primary audience to…

The various needs for evaluating evaluators and their efforts are discussed in this paper. The argument is presented that evaluators should not themselves carry out summative evaluation on their own efforts. Several possible purposes of evaluation of evaluation staffs and products are pursued, and the methods and persons most appropriate to each…

In the specific methods of standard setting in testing, judgments about individuals being tested, contrasting groups being tested, and judgments about the test items are discussed. In judgments about individual test-takers, assumptions are presented based on the knowledge and skills the test is intended to measure, the test-takers' skills at the…

Three separate sessions were held in different geographic locations in October and November, 1977 as parts of the National Symposia for Professionals in Evaluation and Research (NSPER). The sessions focused on designing an introductory evaluation course for students and educators who are involved in assessment activities. Each session's workshops…