We conducted generalizability studies to examine the extent to which ratings of language arts performance assignments, administered in a large, diverse, urban district to students in second through ninth grades, result in reliable and precise estimates of true student performance. The results highlight three important points when considering the…

Discusses some of the challenges of technology-based training and education, the role of quality verification and evaluation, and strategies to integrate evaluation into the everyday design of technology-based systems for education and training. (SLD)

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

Attempts to understand educational quality have created an ever-increasing set of measures and approaches. Issues regarding assessment of student learning, teacher effectiveness, and school effectiveness are discussed. (MT)

Following up on an earlier issue of "The Curriculum Journal" (Vol. 16, No. 1), this article focuses on learning outcomes in the context of video games. Learning outcomes are viewed from two theoretical frameworks: Kirkpatrick's levels of evaluation and the CRESST model of learning. These are used to analyse the outcomes claimed in journal articles…

Discusses values ascribed to performance assessment and recent criticisms of assessment and suggests model-based performance assessment for remedying and avoiding these criticisms. The paper explains the merits of a systematic approach to developing performance assessments and rubrics based on general models across ages and subject areas for…

Two examples of the interaction between computer technology and assessment are described: a tool-based knowledge representation approach to assess content understanding and a team problem-solving task involving negotiation. The examples serve as the context for the exploration of validity, equity, and utility. (LZ)

This article describes performance-based assessment as expounded by its proponents, comments on these conceptions, reviews evidence regarding the technical quality of performance-based assessment, and considers its validity under various policy options. (JDD)

Paper introduces a collection of papers on educational assessment, noting controversies surrounding both old and new assessment methods, discussing the persistent set of technical issues that must be addressed by the research community in measurement, and examining work by the National Center for Research on Evaluation, Standards, and Student…

This discussion of the use of expert performance as the basis for inferring assessment scoring criteria in evaluating student performance considers characteristics of experts and difficulties in use of adult expertise to evaluate student performance. The use of gifted students' performances as benchmarks is suggested as possibly providing…

Over the last 20 years, writing about technology (and more recently about its use in assessment systems) has been a joyful experience, in part because the author was usually right about how fast and how unexpected technology progress would be made. In this article, the author suggests to rethink assessment systems from design perspectives and the…

This study investigated how domain specifications controlled topic and rater reliability. History students completed three performance tasks. For each topic, they took prior knowledge tests, read primary materials, and wrote explanatory essays. Using a theory-based scoring rubric, four raters scored all essays. The rubric worked similarly on the…