Describes the procedures by which Kentucky's state assessment program synthesized results from three standard setting procedures (Contrasting Groups, Bookmark, and Jaeger-Mills) for the 2000 state assessment. Shows the value of using multiple standard-setting approaches to gather information from each. (SLD)

This National Council on Measurement in Education (NCME) module is designed to help teachers understand test reliability requirements. Focus is on the reliability of scores from teacher-made achievement tests used for interpreting norm-referenced scores. Reliability, factors affecting scores, reliability estimation methods, reliability's relation…

Although it is assumed that student cognition contributes to student performance on achievement tests, it may be that current testing models lack the degree of specification necessary to warrant such inferences. With test score interpretations as the referent, the authors in this special issue address the role of student cognition in learning and…

The instructional impact of criterion-referenced testing during the past three decades is reviewed, and a method of devising criterion-referenced tests is suggested that departs from the usual model. Adding verification along the lines of panel review that newly constructed test items do elicit appropriate information is suggested. (SLD)

In response to J. J. Cannell's (1988) discussion of the reported "above average" achievement of the vast majority of public school systems nationwide, the nature of national norms is discussed. The public must be better informed about the interpretation of test results. (SLD)

The developer of the Comprehensive Tests of Basic Skills scaling responds to Hoover's attacks on Thurstone and item response theory scales (TM 510 173). While agreeing that grade equivalent (GE) scores are presently the most appropriate developmental score for reporting elementary grade achievement tests, limitations and inconsistencies in the GE…

Grade equivalent (GE) scores for elementary school achievement tests are defended in response to efforts to ban their use. Equal interval developmental scoring methods for the Sequential Tests of Educational Progress and the Comprehensive Tests of Basic Skills are criticized. (BS)

The author addresses issues raised by Burket (TM 510 174) about the Iowa Test of Basic Skills scaling procedures. Further reasons for his criticism of Thurstone scale scores and item response theory scale scores for elementary school achievement tests are given. (BS)

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

A sample (N=37) of currently published achievement tests was surveyed as to the availability of five types of technical data: (1) item selection techniques; (2) standardization; (3) types of norms; (4) types of validating data; and (5) types of reliability data. Recommendations for publishers and cautions for test users are given. (BS)

The use of national achievement tests in schools can result in varying degrees of curricular match/mismatch with respect to local curricula. This article explores the types of mismatch which can occur, discusses the inferences made from test scores and their importance, and addresses some implications for the educational community. (EGS)

Results of a 1987 report indicating that elementary students of all states were above the national average are assessed. Issues addressed include teaching for standardized tests, the effect of teaching on national norms, and alternatives available to protect the integrity of instruction and the validity of normed test scores. (TJH)

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

Effects of standardized testing on teaching and learning were studied in a survey of 341 elementary school teachers in 9 states, focusing on the meaning of test scores and test-score gains. Results indicate that standardized testing has considerable effects, and that teachers feel considerable pressure to improve student scores. (SLD)

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)