During the development of large-scale curricular achievement tests, recruited panels of independent subject-matter experts use systematic judgmental methods--often collectively labeled "alignment" methods--to rate the correspondence between a given test's items and the objective statements in a particular curricular standards document.…

The use of assessment results to inform school accountability relies on the assumption that the test design appropriately represents the content and cognitive emphasis reflected in the state's standards. Since the passage of the Every Student Succeeds Act and the certification of accountability assessments through federal peer review practices,…

The article reviews research and findings on problems and issues faced when translating international academic achievement tests. The purpose is to draw attention to the problems, to help to develop the procedures followed when translating the tests, and to provide suggestions for further research. The problems concentrate on the following: the…

In most large-scale assessments of student achievement, several broad content domains are tested. Because more items are needed to cover the content domains than can be presented in the limited testing time to each individual student, multiple test forms or booklets are utilized to distribute the items to the students. The construction of an…

Asserts that publishers of achievement tests are, for the most part, not in a position to obtain on their own any decent evidence about the consequences of uses made of their tests. Reasons why this is so are discussed, and what publishers can be expected to do is outlined. (SLD)

Multiple-choice items are a mainstay of achievement testing. The need to adequately cover the content domain to certify achievement proficiency by producing meaningful precise scores requires many high-quality items. More 3-option items can be administered than 4- or 5-option items per testing time while improving content coverage, without…

This instructional module presents and illustrates rules for designing performance assessments in a step-by-step strategy through: (1) reason for the assessment; (2) type of performance evaluated; (3) exercises to elicit performance; and (4) systematic rating procedures. Guidelines for maximizing reliability, validity, and economy are presented.…

Two achievement testing programs in New York City that have had and are having some consequences are described, and how the school system tries to determine and deal with these consequences is explored. Cooperation and open dialog between test publishers and the school district are making it possible to deal with the real-life problems of test…

The accuracy of statistics based on performance assessments that represent percentages of students reaching standards is explored using data from a large-scale performance assessment, the Maryland School Performance Assessment Program. Results with students in grades 3, 5, and 8 support the accuracy of pooling results to produce the statistics.…

The increased use of test scores as a measure of school quality is discussed. Legitimate and illegitimate practices of test preparation are considered. Some commercial test preparation programs are reviewed, with some conclusions about their effectiveness and desirability. (SLD)

Literature related to the multiple true-false (MTF) item format is reviewed. Each answer cluster of a MTF item may have several true items and the correctness of each is judged independently. MTF tests appear efficient and reliable, although they are a bit harder than multiple choice items for examinees. (SLD)

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

A norm-referenced achievement test, in combination with supplementary items, can be used to produce norm-referenced data as well as objective-referenced data. The experiences of the Palm Beach County (Florida) school district in developing and using such a test are described. (EGS)

Possible future practices in testing are discussed, with a critique of current educational measurement. As standardized achievement tests are used for wide-ranging purposes, there will be increasing reliance on item response theory and national item banks. A national system of monitoring development and use of tests will probably emerge. (SLD)

Major changes in educational and psychological theories that have come about since the cognitive and affective taxonomies of educational objectives were published in 1956 and 1964 are traced. The changes emphasize the need to understand thinking in the context of students' beliefs and self-directed cognitions. (SLD)