A misconception exists that validity may refer only to the "interpretation" of test scores and not to the "uses" of those scores. The development and evolution of validity theory illustrate test score interpretation was a primary focus in the earliest days of modern testing, and that validating interpretations derived from test…

The conventional focus of validity in educational measurement has been on intended interpretations and uses of test scores. Empirical studies of test use by teachers, administrators and policy-makers show that actual interpretations and uses of test scores in context are invariably shaped by local users' questions, which frequently require…

This brief report offers analysis of ACT and SAT results from 2008 to 2013 in the Southern Regional Education Board (SREB) region. The brief focuses on the increase in test participation rates and points to policies that SREB states initiated that affected these rates. Five SREB states currently require 100 percent student participation on the…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

An expanded framework for validating tests is needed to include the perspectives of teachers and students as well as of test makers and scientists. The development of educational assessments must take place within an understanding of how tests are used in context. (SLD)

A sound performance evaluation system uses a multitude of assessment methods to gather information and data about the performance of an individual. Four models are described that have been used with multiple assessment results to make decisions about performance. In a compensatory model, weak performance on one measure or attribute can be traded…

Since 1988, Vermont has been developing an innovative performance assessment program that relies substantially on portfolios of student work. This interim report presents findings about the reliability of scores from the first statewide implementation of the portfolio program in the 1991-92 school year. The focus is not on program impact as an…

Schools that are concerned with evaluating their programs need more than just the average scaled assessment scores from standardized tests. To help schools, the Massachusetts Educational Assessment Program produces school and district reports that contain the stories behind the averages. These reports describe the kind of students who took the…

Considerable evidence suggests that policy-makers, educators, the media, and the public do not understand national and state test results. The problems appear to be two-fold: the scales on which scores are reported seem confusing, and the report forms themselves are often too complex for the intended audiences. This paper addresses two topics. The…

This is the fourth in a series of technical reports that have dealt with issues surrounding the possibility of national value-added systems for primary schools in England. The main focus has been on the relative progress made by students between the ends of Key Stage 1 (KS1) and Key Stage 2 (KS2). The analysis has indicated that the strength of…

When the National Assessment of Educational Progress (NAEP) was designed 20 years ago, comparisons among individual states or localities were not deemed desirable. Today, this lack of information to allow comparison is judged to be a serious weakness of the NAEP, and ways to allow comparisons are actively sought. The focus of this paper is to…

Efforts have been made to increase the dissemination and use of data generated by the National Assessment of Educational Progress (NAEP). Potential users include those concerned with curriculum and methods evaluation, public policymakers, and researchers. NAEP can provide data for curriculum evaluation, including item analysis data which assist in…

Issues in the misuse of standardized test scores are discussed. While information misuse is not a problem unique to testing, it is particularly prevalent. Information can be a source of power, and politically motivated uses of information explain part of the misuse of test scores. Other misuses have historical roots in the exaggerated claims of…

The 1992-93 school year was the second year of the implementation of the Vermont assessment program. Evaluation of the 1991-92 year yielded mixed results, with some evidence that the assessment program was having a strong impact on instruction, but other indications that the reliability of the portfolio scoring in both writing and mathematics was…