Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs…

The goal of this study was to explore the effectiveness of a short web-based tutorial in helping teachers to better understand the portrayal of measurement error in test score reports. The short video tutorial included both verbal and graphical representations of measurement error. Results showed a significant difference in comprehension scores…

Twenty-eight studies of grades, over a century, were reviewed using the argument-based approach to validity suggested by Kane as a theoretical framework. The review draws conclusions about the meaning of graded achievement, its relation to tested achievement, and changes in the construct of graded achievement over time. "Graded…

In this article, I specify a conceptual framework for test validity research on content assessments taken by English language learners (ELLs) in U.S. schools in grades K-12. This framework is modeled after one previously delineated by Willingham et al. (1988), which was developed to guide research on students with disabilities. In this framework…

The accuracy of achievement test score inferences largely depends on the sensitivity of scores to instruction focused on tested objectives. Sensitivity requirements are particularly challenging for standards-based assessments because a variety of plausible instructional differences across classrooms must be detected. For this study, we developed a…

Four issues associated with calculator-available assessments are discussed: (1) benefits and problems of calculator use; (2) components of various types of calculator-available assessments; (3) construction of calculator-available assessments; and (4) the need for additional examination of items included on calculator-available assessments. (SLD)

The two articles in this special section discuss the use of portfolios in large-scale assessment. Both describe pilot studies of portfolio assessment, pointing out pitfalls and advantages. If portfolios are to realize their potential in assessment and instructional improvement, teachers, students, and the public must receive better information…

Current discussions of the effects of test administration conditions (i.e., testing stakes) and the motivational levels associated with them on achievement test performance are reviewed. Results of a nonexperimental study suggest that, in contrast to a moderate-stakes testing environment, the National Assessment of Educational Progress does not…

Studies of the extent of standardized testing in U.S. schools in the early 1980s to 1990s were reviewed. All show the amount of systemwide testing to be less than two days per year. Methodological issues are explored, and the extent-of-testing estimates are updated to about 1995 through more recent research. (SLD)

Analyses of 10 raters' reasoning during think-aloud interviews provided evidence to support a model of the fundamental processes involved in rating standards-based, nonprescriptive portfolios. This process model provides a framework within which to conceptualize sound-rater reasoning and to identify reasoning that distorts the meaning of scores.…