In many practical testing situations, alternate test forms from the same testing program are not strictly parallel to each other and instead the test forms exhibit small psychometric differences. This article investigates the potential practical impact that these small psychometric differences can have on expected classification accuracy. Ten…

Items on test score scales located at and below the Proficient cut score define the content area knowledge and skills required to achieve proficiency. Alternately, examinees who perform at the Proficient level on a test can be expected to be able to demonstrate that they have mastered most of the knowledge and skills represented by the items at…

This Brief builds on the work of the National Association of State Boards of Education 1997 Study Group on State Assessment Systems by examining one of the state board actions that is most likely to capture the publics attention: setting cut scores on state assessments. This process involves a large measure of human judgment and politics and a…

All New Jersey students in grades 3, 6, 9, and 11 are tested annually in basic reading and computation skills using the New Jersey Minimum Basic Skills (MBS) Tests. The MBS testing program was initiated in 1976. The former Educational Assessment Program tests were used during the tramsition, and test development activities were begun in 1977.…

Administering a large scale licensing examination program presents both technical and non-technical challenges. Five major areas are discussed in this paper: (1) ensuring test validity in relation to occupational entry standards; (2) developing test items from valid examination specifications; (3) establishing legally defensible passing scores;…

In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link…

This field memo to all teachers and administrators of public and nonpublic schools is the first of three in a series of updates from the Deputy Commissioner of the Office of Elementary, Middle, Secondary, and Continuing Education on standards and assessments in New York. This document contains information on New York's learning standards and the…

Rasch model statistics and domain-referenced test development methods were used in the Virginia Basic Learning Skills (BLS) testing programs and the Graduation Competencies testing program in order to increase the fairness and effectiveness of those programs. Mastery of each of the 83 objectives in reading and mathematics for grades one through…

The accountability testing programs of many states have begun to make extensive use of constructed-response questions and to report test results in terms of percentages of students at various proficiency or performance levels. This paper describes the step-by-step procedures for two standard-setting methods recently used for the New Hampshire…

Results are presented of the Connecticut Statewide Basic Skills Proficiency Test, which was administered to Connecticut ninth graders for the fourth time in 1983. The history of the test is summarized; it was designed to identify students who are performing so far below grade level that they require remedial instruction to succeed in the ninth…

Connecticut's Basic Skills Proficiency Test, administered for the sixth time in October 1985, measures reading, language arts, mathematics, and writing skills. The test was intended to identify students who require further diagnosis and remediation in order to participate successfully in ninth grade classes. Results indicated that over 90 percent…

The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…

Steps involved in the item analysis and scaling of the 1990 edition of Forms A and B of the Nevada High School Proficiency Examinations (NHSPEs) are described. Pilot tests of Forms A and B of the 47-item reading and 45-item mathematics tests were each administered to random samples of more than 600 eleventh-grade students. A computer program was…

Pennsylvania's "Testing for Essential Learning and Literacy Skills" (TELLS) program was instituted during the 1984-85 school year, to identify reading and mathematics problems early in a student's school career. This document describes the intent and legislation behind TELLS, the implementation of the test, population tested, properties…

A technical advisory committee assisted the Alabama State Department of Education in establishing passing scores and equating test forms of the Alabama High School Graduation Examination (AHSGE). The committee examined four methods of setting cutting scores: (1) Jensen's theoretical method--probability theory is used to set standards that are…