This report represents the results of an investigation of the appropriateness of criterion-referenced tests (CRTS) for large-scale evaluations. First, the development and validation of CRTS, including the formulation and generation of CRT objectives, items, and score-interpretation schemes and dimensions of item and test quality, were examined to…

A procedure for in-depth analysis of a limited number of tests being considered for selection by a school, district, project, or state personnel is described. This procedure involves listing the objectives that it would be desirable to measure determining the relative importance of each of these objectives, having "judges" match test items to…

The Title I Evaluation and Reporting System (TIERS) was mandated to meet the requirements of the 1974 amendments to the Elementary and Secondary Education Act. It was hoped that TIERS would lead to a clear report of the effectiveness of Title I programs, based upon a synthesis of nationwide data. It has been extremely difficult to compare…

This guide is a compilation of factors considered important in the selection of tests for bilingual/bicultural programs. It is intended for use by test selectors or teachers in bilingual education, and does not presume to be exhaustive or authoritative. Basically the guide consists of questions the test selector or teacher should ask when…

A liberal interpretation of Section 151 of Public Law 93-380, to implement effective local evaluation of Title I programs, is supported. Weaknesses are cited: (1) nationwide impact data, (2) unsound aggregation of Title I achievement gains, and (3) lack of consideration of alternative evaluation methods. (MH)

This brief monograph, intended for preschool teachers and administrators, explains various aspects of the assessment and evaluation of children and early childhood education programs. The value of evaluation procedures for program development is noted. The different forms that research designs and tests can take are explained. It is emphasized…

Oregon has recognized the problems involved in the evaluation of Elementary Secondary Education Act Title I programs, and has worked toward solutions, while recognizing the differing needs of local, state, and federal departments of education. In order to provide help to the local school districts with respect to evaluation, a statewide committee…

In this paper, the author reviews a number of criticisms that have been made of the use of standardized tests in the social studies and reviews 11 general, skills, and discipline-oriented standardized tests for social studies. Standardized tests evaluating the results of the new social studies courses are open to criticism on the basis of…

A classical model for achievement test development was influenced by: the educational tradition of selecting a sample of questions appropriate to a subject and counting the proportion of acceptable responses; the emphasis on obtaining a large and homogeneous sample of questions to insure reliability; and the tradition in psychological testing of…

Use of the Woodcock Reading Mastery Tests (WRMT), individually administered wide ranging reading tests, was explored, using Title I evaluation Models A1 and A2. Attention was focused on: (1) relationship of the Title I curriculum to the WRMT and the SRA Reading Test; (2) comparative reading achievement gains on both tests, using Model A1; and (3)…

This report is the final one in a trilogy stemming from the 1968 Summer Reading Institute in the Washington Model School Division. The Institute was designed to meet the needs of elementary school teachers in their attempts to teach language skills and reading to students in grades K-3. This follow-up study examines the results of the Summer…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

Abstracts are presented of the major conference papers and thematic discussions delivered at the 1978 Measurement and Methodology Conference. The titles of the presentations are: Policy-Responsive Evaluation (Wiley); When Educators Set Standards (Glass); Comments on Wiley and Glass (Schutz); Key Standard-Setting Considerations for Minimal…

The Language Assessment Battery was administered to third to fifth grade limited English speaking students in New York City. Special techniques addressed two common problems in testing these populations: (1) language tests suitable for limited English speakers change their psychometric characteristics over time as the students' language ability…