This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

This manual is presented to assist local districts in complying with the requirements of the Massachusetts Policy on Basic Skills Improvement, whose principal goal is to help students master basic skills prior to high school graduation. The policy requires schools to evaluate student achievement in the basic skills at least once during the early…

A project was conducted to develop vocational education tests for use in Georgia secondary schools, specifically for welding, machine shop, and sheet metal courses. The project team developed an outline of an assessment model that included the following components: (1) select a program for use in developing test items; (2) verify duties, tasks,…

A procedure which employs a method of item substitution based on item difficulty is recommended for developing parallel criterion referenced test forms. This procedure is currently being used in the Florida functional literacy testing program and the Georgia teacher certification testing program. Reasons for developing parallel test forms involve…

The objectives of this study were twofold: first, to develop an improved version of the instruments used to measure Goal IV (Attitude Toward School and School Learning) at the fifth and eleventh grade levels in the public schools of Pennsylvania under a program of "Educational Quality Assessment" mandated by the legislature. Secondly, it was the…

The Alberta High School Social Studies Achievement Tests are described in terms of the procedures used for test construction and analysis of the norming data. The test construction is explained according to a model for the values clarification process in the social studies, and the evaluation models appropriate for assessing the values…

The validity, reliability, and item characteristics of the Maine Real Estate Licensure Examination were investigated. Its validity was based on its construction; a task analysis was performed on real estate broker and salesperson jobs, items were written by trained personnel; and the test was reviewed by a panel of experts. Differences in scores…

The 1973-74 Michigan Educational Assessment Program (MEAP) provided information on twenty-two separate measures of interest to educators. The program provides for measures of (1) word relationships, (2) mathematics, (3) reading and (4) attitudes (optional). In contrast to past programs, the mathematics and reading instruments are…

The results are presented of the validation study of reading and mathematics criterion referenced tests, administered to South Carolina students in grades 3, 6, and 8. This testing was mandated by state law to field test a competency based assessment program. The study was based on three activities: (1) test selection; (2) content validation; and…