Researchers have documented the impact of rater effects, or raters' tendencies to give different ratings than would be expected given examinee achievement levels, in performance assessments. However, the degree to which rater effects influence person fit, or the reasonableness of test-takers' achievement estimates given their response patterns,…

This paper introduces the new Massachusetts Performance Assessment for Leaders (PAL) and uses critical policy analysis to re-examine the validity evidence (using the 2014 Standards for Educational and Psychological Testing and a theory of multicultural validity) for the use and interpretation of the PAL in regards to emerging school leadership.…

This Digest addresses developing scoring rubrics, administering performance assessments, and scoring, interpreting, and using results. In developing scoring rubrics, the criteria within the scoring rubric should be clearly aligned with the requirements of the task and the state goals and objectives. They should also be expressed in terms of…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

The Wechsler Intelligence Scale for Children-Third Edition (WISC-III) is an individually administered test of intelligence for assessing children aged 6 through 16 years, 11 months. The WISC-III consists of several subtests, each classified into a verbal or performance scale. The child's performance on these measures is summarized in three…

The first edition of this book was written to give information about testing to people whose work gave them access to test results, but whose training included little or nothing about the use and interpretation of tests. Later editions have been intended for a broader audience as the need for understanding what test scores really mean has…

A quiz is presented that may call the attention of school personnel to regression effects in educational measurement, and clarify the meaning of statistical regression for educators in schools. Ten questions and their answers explore regression in the contexts of classroom testing, grading, and performance assessment. (SLD)

A cursory examination of current measurement texts used in teacher education reveals a treatment of such topics as test reliability, item analysis, and test interpretation based largely upon classical test theory. In the meantime, the landscape of the classroom has been significantly impacted by a growing emphasis on more authentic assessment…

The concept of developmental appropriateness can be applied to the assessment of young children. Clarifying the main purpose for which children are assessed can help determine what kinds of assessments would be most appropriate. Assessment of individual children might serve one of the following purposes: (1) to determine progress on significant…

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)

This book addresses the roles assessments play in education and provides detailed descriptions of the common assessment types, norm-referenced and criterion-referenced tests, and alternative assessments. Chapter 1 discusses the current arguments for and against the various methods of assessment, the quality requirements for test instruments, and…

The extent to which performance assessments can have unintended and undesirable consequences is not yet clear, but preliminary evidence suggests several issues of bias and fairness. Among these is the sheer difficulty of scoring complex performance assessments, as Vermont's experiences with portfolio assessment illustrate. (SLD)

The assumption that reliability is a necessary but insufficient condition for validity in assessment is challenged by exploring a dialectic between psychometric and hermeneutic approaches to drawing and warranting interpretations of human products of performance. Hermeneutic alternatives for epistemological and ethical purposes expand the range of…

Recent years have seen a new and serious commitment to improving methods of assessing academic performance. Schools, school districts, and states are experimenting with a wide range of assessment alternatives. This paper is about this new commitment to assessment and begins with some background on standardized tests because the rationale for…

This book provides basic skills and knowledge about assessment so that teachers can expand their ability to deal with appraisal problems in their own settings. The first section deals with the basic principles of assessment. The second section concerns creating and applying assessment tools. The third section reviews issues in understanding and…