This simulation study involved the design of two two-stage tests in which the routing tests and the second-stage measurement testlets took the form of a multidimensional knapsack problem with prespecified target informations and constraints to be enumerated using the algorithm of E. Balas. Two conventional tests of similar length to the two-stage…

Six models for evaluating change are examined via a Monte Carlo study. All six models show a lack of power. A modified analysis of variance procedure is suggested as an alternative. (JKS)

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

This report documents the activities of the technical committee formed to examine issues related to the norm-referenced model (RMC Model A) for evaluation of Elementary and Secondary Education Act Title I programs. Background information is provided on the committee's activities, purpose, and meetings; and the members are listed. The reports of…

Evaluations of social programs based upon quasi-experimental designs are typically plagued by problems of nonequivalence between the experimental and comparison group prior to the experiment. In such settings it is extremely difficult, if not impossible, to isolate the effects of the program from the confounding effects associated with the…

The equivalency of achievement results obtained under Title I evaluation models A1 and C1 was examined. Data were reading comprehension and arithmetic scores on the Iowa Tests of Basic Skills, administered to fourth, sixth, and eighth grade students in St. Louis, Missouri. The St. Louis Public Schools had traditionally used Model A1, a…

This material provides a discussion of the construction and analysis of tests prepared for classroom use by teachers. The initial discussion is concerned with the purposes of evaluation and the specification of objectives. This is followed by an examination of theoretical and practical considerations in planning a test. The material on test item…