Teachers are now experiencing the age of quantitative test-driven assessment, in which there is little weight accorded to teacher-based judgement about student progress. In the Australian context, the NAPLaN test has become a driving force in school and teacher accountability. The language of NAPLaN is one of bands and numerical scores and…

In "Beyond Test Scores: Leading Indicators for Education," Foley and colleagues (2008) define leading indicators as those that "provide early signals of progress toward academic achievement" (p. 1) and stress that educators "need leading indicators to help them see the direction their efforts are going in and to take…

In practice, vertical scales have been continually used to measure students' achievement progress across several grade levels and have been considered very challenging psychometric procedures. Recently, such practices have been drawing many criticisms. The major criticisms focus on dimensionality and construct equivalence of the latent trait or…

This report examines the availability and quality of predictive validity data for a selection of benchmark assessments identified by state and district personnel as in use within Mid-Atlantic Region jurisdictions. Based on a review of practices within the school districts in the region, this report details the benchmark assessments being used, in…

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

Examines the development and administration of the New Jersey General Intellectual Skills (GIS) Assessment, administered for the first time in 1990 at all public colleges and universities in the state. Describes the GIS's scope and function, scoring procedures, score reporting, faculty expectations, and initial results. (DMM)

This paper presents two examples of how methodological research in testing and evaluation simultaneously served the needs of both researchers and practitioners. The first example focuses on Center for the Study of Evaluation (CSE) research in writing assessment. This research investigated issues in domain definition, cognitive processing…

Specific recommendations are made concerning the circumstances under which the benefits of out-of-level testing outweigh the problems associated with it. Topics explored are: various methods for deciding when a set of test scores is invalid and the utility of these methods for local evaluators, the accuracy of vertical scaling, and the usefulness…

Describes United States literacy characteristics, based on April 2000 reports from the Organisation for Economic Cooperation and Development and the U.S. Department of Education's Office of Educational Research and Improvement. Discusses Angoff methods for evaluating validity of high-stakes testing programs in Massachusetts and Virginia. (MLH)

During the 1985-86 school year, an evaluation plan utilizing standardized norm-referenced test information was initiated within the Wichita Public School System in Kansas. The plan had four identifiable factors: (1) a growth measurement concept; (2) a simplified computation process; (3) a means of integration of growth measurement within user…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

Differences in the Texas Teacher Appraisal System scores of teacher subgroups over 2 years were examined for 2,366 teachers for scores on individual domains, sums of scores of the 1st 4 domains, and overall summary performance scores, as well as appraiser differences. Implications for teacher evaluation are discussed. (SLD)

Teacher evaluation is receiving increasing attention. Texas is the largest state to adopt a statewide appraisal instrument. The purpose of this study was to examine differences in Texas Teacher Appraisal System (TTAS) scores over a period of four years. The sum of scores of the first four individual domains and the overall summary performance…

When a state test and National Assessment of Educational Progress (NAEP) are both measuring the same construct, the achievement gaps between subgroups on both tests should be the same. However, if a teacher or school engages in "teaching to the test" then student performance may improve on one test but not on another. We hypothesized that…

The Center on Education Policy (CEP) has been studying state high school exit examinations since 2002. This is the sixth annual report on our comprehensive study of exit exams. The information comes from several sources: our survey of states that have mandatory exit exams, interviews with state officials, media reports, state Web sites, and case…