This handbook for training program evaluators provides background information and practice activities in the following areas: (1) measurement: purposes, ideals, possibilities; (2) defining measurement domains; (3) person and item sampling; (4) test and item selection--with a selected list of standardized tests with pertinent information on each,…

Fourteen criteria used to evaluate criterion referenced tests were assigned two sets of weights reflecting the characteristics of tests designed as a classroom resource or for program evaluation. Twenty eight currently available criterion referenced tests were rated against the criteria using each set of weights. A comparison of the scores…

This report represents the results of an investigation of the appropriateness of criterion-referenced tests (CRTS) for large-scale evaluations. First, the development and validation of CRTS, including the formulation and generation of CRT objectives, items, and score-interpretation schemes and dimensions of item and test quality, were examined to…

The feasibility of using criterion referenced tests (CRTs) in a large-scale evaluation conducted in an effectiveness evaluation context was investigated. The study began by examining the theory that structures the development and validation of CRTs to discover whether, on theoretical grounds alone, CRTs are suitable or not suitable for large-scale…

A void exists between the rapid growth of post-high school trade and technical education and the development of educational management tools for that area. Hoping to help fill this void, this research effort concentrated on the development of psychometric instruments useful in measuring achievements. Trade and technical areas involved in the study…

An overview of the system analysis approach to evaluation and the psychometric models currently proposed to evaluate Elementary and Secondary Education Act Title I projects is presented. It is argued that, in America's Pacific possessions, the sole use of the systems analysis approach to evaluation fails to provide adequate information to…

Proposes that objective-referenced tests replace norm-referenced tests as a vehicle for program evaluation. Describes a methodology, based on latent trait theory, for joining norm-referenced and objective-referenced testing in a customized testing program. (TE)

This guide presents detailed information concerning the purposes and process of program evaluation, the role of the evaluator, and the development of an evaluation plan or design. Instruction is provided in selecting or developing assessment instruments, collecting and analyzing data, reporting evaluation results and applying the findings. The…

In this paper, the author reviews a number of criticisms that have been made of the use of standardized tests in the social studies and reviews 11 general, skills, and discipline-oriented standardized tests for social studies. Standardized tests evaluating the results of the new social studies courses are open to criticism on the basis of…

The Washington state Title I Migrant Program Evaluation project is a feasibility study designed to assess the suitability of existing normed criterion referenced tests to measuring mathematics achievement at grades four, five, and six. Objectives include judging the technical qualities and content of several normed criterion referenced tests;…

To comply with Ohio state standards, guidelines are provided for local school districts to organize a competency program. Five steps are outlined: (1) planning the program, including budgeting, scheduling, inservice training, coordinating advisory and working committees, and ensuring public awareness; (2) establishing competencies, by developing…

A classical model for achievement test development was influenced by: the educational tradition of selecting a sample of questions appropriate to a subject and counting the proportion of acceptable responses; the emphasis on obtaining a large and homogeneous sample of questions to insure reliability; and the tradition in psychological testing of…

The objectives of this booklet are to provide suggestions, procedures, and rules of thumb to aid the evaluator in using achievement tests in program evaluation. It also discusses some of the theories underlying the procedures for developing and selecting achievement tests and interpreting their results. Each of the six chapters offers advice on…

Most of the information in this booklet is useful for both formative and summative evaluations. The booklet offers information to help the evaluator develop skills in designing and using instruments to measure affective objectives or attitudes. The chapters cover: (1) an introduction to the measurement of attitudes and attitude change; (2)…

Abstracts are presented of the major conference papers and thematic discussions delivered at the 1978 Measurement and Methodology Conference. The titles of the presentations are: Policy-Responsive Evaluation (Wiley); When Educators Set Standards (Glass); Comments on Wiley and Glass (Schutz); Key Standard-Setting Considerations for Minimal…