A misconception exists that validity may refer only to the "interpretation" of test scores and not to the "uses" of those scores. The development and evolution of validity theory illustrate test score interpretation was a primary focus in the earliest days of modern testing, and that validating interpretations derived from test…

The conventional focus of validity in educational measurement has been on intended interpretations and uses of test scores. Empirical studies of test use by teachers, administrators and policy-makers show that actual interpretations and uses of test scores in context are invariably shaped by local users' questions, which frequently require…

PISA is an extremely influential large-scale assessment, and its "policy lessons" are being incorporated in a range of nations all over the world. In this paper I argue that not only is PISA influencing policies and practices, but also that "seeing like PISA" is becoming a widespread phenomenon. Globally, education…

In the present offering we challenge the presumption that the educational testing of students provides objective information about such students. This presumption largely rests on an empiricist account of science. In light of mounting criticism, however, empiricist foundationalism has given way to a social epistemology. From this standpoint,…

Few arguments about education are as effective at galvanizing public attention and motivating political action as those that compare the performance of students with their counterparts in other countries and that connect academic achievement to economic performance. Because data from international large-scale assessments (ILSA) have a powerful…

A growing body of research showing that grade retention serves as an educationally low-quality placement has raised increasing concerns about whether the use of standardized tests in making decisions concerning grade retention conforms to current standards for appropriate and nondiscriminatory test use. This article examines the extent to which…

This study investigates instructors' perceptions about strengths and weaknesses of a student ratings instrument employed in their university. The sample consisted of 357 instructors in a major Canadian university where each term students are required to complete an evaluation at the end of every course. Qualitative analyses of their written…

Examines student ratings of teacher effectiveness within a new framework that emphasizes six distinct aspects of validity: content, substantive, structural, generalizability, external, and consequential. Concludes that greater attention should be directed toward consequential validity, particularly how ratings are used on today's campuses and what…

Critically examines five issues surrounding the use of student evaluations of teaching for summative decisions: current practices, validity concerns, improving the reporting of results, improving the decision-making process, and incorporating validity estimates into the decision-making process. Concludes with a list of recommendations for…

Three major pragmatic issues in computerized testing are addressed: (1) encouraging teacher use; (2) reporting of information; and (3) test construction. Reference is made to four related articles. Additional areas for research include reporting of test information; item bank standards; validity; and rules for stopping in computerized testing.…

Discusses applications of the Problem Solving Inventory for counseling and managed health care, career and industrial/organizational issues, training, and academic performance. Examines the role of problem solving in psychological health and describes the inventory, how to administer it, and previous research findings. (RJM)

An expanded framework for validating tests is needed to include the perspectives of teachers and students as well as of test makers and scientists. The development of educational assessments must take place within an understanding of how tests are used in context. (SLD)

Examines the validity of large-scale educational assessment, suggesting that construct validity is insufficient for assuming an achievement measure's internal validity and that the uses of assessment results affect external validity. Discusses the role of learning theory in large-scale assessment, purposes of large-scale assessment, item types and…

A scale was developed for measuring the persuasive impact of qualitative and quantitative evaluation reports on decision makers. Using two exploratory (n=192 graduate and undergraduate students) and two confirmatory (n=200 administrators) samples, researchers developed a 28-item Likert-type scale that demonstrated high reliability and validity.…

When the National Assessment of Educational Progress (NAEP) was designed 20 years ago, comparisons among individual states or localities were not deemed desirable. Today, this lack of information to allow comparison is judged to be a serious weakness of the NAEP, and ways to allow comparisons are actively sought. The focus of this paper is to…