This paper follows a line of logical argumentation to claim that what Samuel Messick conceptualized about construct validation has probably been misunderstood by some educational policy makers, practicing educators, and classroom teachers. It argues that, while Messick's unified theory of test validation aimed at (a) warning educational…

Many problems in the areas of test interpretation and educational assessment are causing difficulties for educators. On one hand the public and legislators are requesting more state testing programs and assessment programs, while on the other, educators realize the problems concerning testing and test interpretation. Difficulties arise when tests…

Norm-referenced testing is not appropriate for use in teacher evaluation. A truly equitable method of teacher evaluation is based on a clear set of instructional targets and on the teacher's effectiveness in helping students master the specific skills and knowledge targeted. (Author/MLF)

A new variant of the standard method for estimating the accuracy of educational tests is examined. It is found that the estimates produced by the new method are essentially unbiased and that the typical sizes of the errors of the estimates approach their theoretical lower limit as size increases, though they are still noticably above it for small…

This article presents views of proponents and opponents to standardized tests, isolates the major weakness of testing--questionable validity--and offers several recommendations for the betterment of test development and use. Some major misuses of tests include the following: (a) tests are at times administered with no clear purpose; (b) test…

The decline in scholastic aptitude test ( SAT) scores does not signify that the quality of education is lower. To interpret this decline requires an understanding of the testing process, changing racial and sex mix of the test makers, changing lifestyle of youth, and the increase in the number of students taking the SAT. (Author/AM)

Consideration is given to the degree of congruence between objectives and test items in the evaluation of objective-based testing. An analytic technique that measures congruence is described, and a bibliography is provided. (CK)

Instructional programs organized according to modern educational technology are discussed within the purposes of criterion-referenced measurements used. The problems of criterion-referenced measurements include scoring and score interpretation, item and test analysis, and mastery testing. An overview of solutions and approaches to the problems and…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

Focusing on technical issues, this paper critiques proposed changes in assessment procedures at the further educational level (ages 16 through 18) in England and Wales. Major structural changes are taking place at this educational level, partly because of large scale youth unemployment. The two current examination systems for the final year of…

Problems in constructing criterion referenced tests related to inadequate technical criteria, and guidelines for their solution are discussed. The need to select a well-defined domain of behaviors is emphasized as the key to test construction and to understanding students' test performance. Considerations must also be given to the most effective…

Discussions at the National Consortium on Testing conference are summarized. Updates on recent and upcoming events are given by Jeff Schiller (National Institute of Education), Doug Whitney (American Council on Education), John Maxwell (National Council of Teachers of English), Dorianne Almann (National Science Teachers Association), Eric Gardner…

A discussion of performance contracting, defined as an agreement between a group offering instruction and a school needing the services, is presented. Four major hazards to direct measurement of specific learning are considered: poor statement of objectives; selection of the wrong tests; misinterpretation of test scores; and depersonalization of…

The nature and quality of teacher-developed tests was studied in a national sample of 228 teachers representing four grade levels and several subjects. Teachers described their patterns of test use, concerns about assessment, and use of performance testing. Teacher-developed performance assessment was heavily used. (Author/GDC)