The steps discussed are (a) stating the purpose of the battery, (b) specifying performance objectives, (c) generating an item pool, (d) item analysis, (e) item selection, (f) determining cut-off scores, and (g) validating the battery. (MP)

This paper was presented with other papers in a forum dealing with statewide testing programs. The primary purpose of the paper is to address practical considerations and methods of resolution for large districts or states who are planning on conducting large scale testing or assessment programs with criterion or performance referenced measures.…

Research on the lack of correlation between standardized tests and school district goals has suggested that district goals might be better met by supplementing standardized tests with district-made criterion-referenced testing systems. This article reports on the development of such a system, the Academic Learning Progress Assessment System…

The Georgia Teacher Certification Testing Program includes 28 criterion-referenced tests designed by National Evaluation Systems, Inc. (Amherst, Massachusetts) and covering 28 different teaching, leadership, and service fields. This publication offers an overview of the test development process, test validation procedures, test administration…

The items of the Florida minimal competency test have never been validated as measures of "survival skills," and the pass/fail standards were set mindlessly and capriciously. (Author/IRT)

An urban school district affected by testing in the effective schools context is described in order to provide examples of the effects of testing on teaching and the curriculum. The report describes the method of operationalizing the effective schools research using test information. An important catalyst to improving the instructional program was…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

The validity of criterion-referenced interpretations of the proficiency scales of the National Assessment of Educational Progress (NAEP) is discussed. A major goal of the NAEP scales is to describe student achievement in specific content areas from grade 3 (age 9 years) through grade 11 (age 17 years). The numerical values for NAEP scales are…

The psychometric properties of the testing tools of the Michigan Educational Assessment Program (MEAP), the state standardized testing program, are examined. Reliability studies have indicated that the scores from the MEAP, ranging from 0.654 to 0.949, are generally acceptable. The State Department of Education offered supporting evidence for the…

This digest is designed to provide information to Texas testing coordinators, other educators, and interested citizens about the development procedures and technical attributes of the state-mandated criterion-referenced assessment program. The chapters are: (1) "Background"; (2) "Test Development"; (3) "Test…

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

This special issue of "Catalyst", entitled Testing Programs in Schools: What's New?, was published jointly by the Nebraska Council of School Administrators and the Nebraska Association for Supervision and Curriculum. The articles emphasize desirability of designing testing programs to meet the information needs of educators and the…

An advisory committee representing counselors, curriculum specialists, students, teachers, and community members should participate in selecting standardized tests for school districts. These steps should be followed: (1) identify test purpose in relation to needs and objectives--diagnosis, placement, career guidance, program evaluation; (2)…

The need for better validation of professional licensing and certification examinations is discussed in Part I. Predictive criterion-related validation studies are difficult to develop, time consuming, impractical and expensive. Since training and knowledge variables are not necessarily sufficient to predict job proficiency, it appears logical to…

This document contains five papers describing the customization of the achievement testing program for Palm Beach County (Florida) Schools. They are as follows: "Customized Achievement Testing Programs" (S. Jean Jolly); "Using the Rasch Model to Develop Curriculum-Referenced Norms" (R. Robert Rentz); "Matching Standardized…