In order to evaluate standard setting procedures, apart from the more commonly applied approach of simply comparing the derived standards or failure rates across various techniques, this study investigated the errors of classification associated with the contrasting groups procedures. Monte Carlo simulations were employed to produce…

An overview is provided of curriculum management and "mapping," an auditing technique for assessing the content, time, and sequence of the taught curriculum as reported by the teacher. The general notion of management is first discussed in terms of three basic kinds of activities: defining purpose and mission, configuring available…

In circumstances where judges are required to make ratings of performance, it is usually required to have two or more raters who are trained to agree on independent ratings of the same performance. It is suggested that such a requirement may produce the paradox of attenuation associated with item analysis, in which too high a correlation between…

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

Fourteen research reports related to mathematics education are abstracted and analyzed. Five studies deal with aspects of mathematics instruction, and there are four reports each on mathematics achievement and on two cognitive processes. The remaining items concern calculators, attitudes, and aptitude-treatment interaction. Research related to…

This document contains three papers from the Methodology Project of the Center for the Study of Evaluation. Methods for characterizing test accuracy are reported in the first two papers. "Bounds on the K Out of N Reliability of a Test, and an Exact Test for Hierarchically Related Items" describes and illustrates how an extension of a…

The Home Health Assisting (HHA) program was developed specifically for use by educational agencies which offer a program in HHA upon approval granted by New York State Education Department through the Joint State Agency review and approval process. It is designed to prepare adults for work in the home under supervision of a health-care agency. A…

An overview is presented of the current status of competency testing for teacher certification. The question of the effect of certification tests on the quality of hired teachers is briefly discussed. Statistics are presented on types of tests used by various states, with particular attention to differences in the cut-off scores for passage of a…

The effects of two methods of testing students on student grades were studied in 1982 with two economics classes that were taught by the same instructor. One class, which involved four 1-hour lectures weekly, received the normal four block-form examinations. The 34 students in this class were the control group. The 36 students in the other class…

A set of procedures for validating the Army's Skill Qualification Tests (SQT) are described. Three phases are discussed: (1) the selection of tasks, (2) the selection of specific content for hands-on performance test items, and of written self-evaluation components, and (3) the establishment of content validity of the hands-on component. The task…

The four papers in this collection were drawn from a symposium convened to review the state of the art in speaking and listening assessment at all educational levels and to suggest strategies for addressing the technical issues, particularly those relating to test bias and the use of rating scales, that speaking and listening assessors often face.…

The unprecedented development of self-help groups confirms their importance, but few studies have focused on prevention and self-help groups. Two methods for investigating preventive potential are outcome studies and process analysis. To assess the presence of helping processes in self-help group meetings, a process analysis was developed to…

The overall purpose of the national Head Start evaluation is to assess the impact, on the children and parents being served, of: (1) the educational services component of Head Start, and (2) a new demonstration program within Head Start, Basic Educational Skills (BES). The evaluation deals with a total of 65 Head Start programs and their families.…

Perspectives on the evaluation of college teaching are considered. Some of the conditions that are needed generally include the following: the existence of an evaluation system that has a process for evaluating research and service, a clear definition of the difference between the evaluation of worth and the evaluation of merit, and a separate…

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…