A study was conducted to begin a process of validating hypothesized causes of local item dependence (LID) in large-scale performance assessments. Data for the study are item level scores from 26 science tasks from the 1993 edition of the Maryland School Performance Assessment Program. Causes of high LID were hypothesized from studies by Ferrara et…

The traditional concept of validity divides it into three separate types; content, criterion, and construct validities. This view is fragmented and incomplete, failing to take into account evidence of the value implications of score meaning as a basis for action and of the social consequences of score use. The new unified concept of validity…

This book is intended to introduce the classroom teacher and prospective teacher to the elements of measurement and assessment that are essential to good teaching. The main theme is that assessment plays an important role in the instructional process. This edition has been revised to reflect major changes in educational assessment since the last…

Different meanings of portfolio assessment are reviewed, and potential applications to program evaluation are explored. At present, portfolio assessments are not recommended as the primary source of evidence about the attainment of program goals in evaluations that compare curricula or programs because of the lack of validity and reliability…

Tests are being used widely, and misused widely, to evaluate students, teachers, principals, and other educational administrators. This short primer on testing and assessment is organized into three parts. Part 1, "Essential Statistical Terms," introduces some statistics that are essential to understanding testing concepts and for…

A general framework is provided for examining the validity of performance standards for high-stakes achievement tests. The emphasis is on conceptual issues and broadly defined methodological questions, the types of validity evidence that can be collected, and the advantages and limitations of different types of evidence. Validation consists of a…

A large school district conducting a revision of its curriculum-based assessment program for grades one through six introduced performance assessments in response to a demand for more authentic assessment associated with national concerns for standards-based educational reform. This study reports validity evidence for the locally developed reading…

This article examines one of the challenges to the integration of classroom and large-scale portfolio assessment, a challenge posed by the use of a student's classroom portfolio for large-scale assessment of his or her individual competencies. When work is composed with the support of peers, teachers, and parents, whose work is being judged? The…

Analyses of 10 raters' reasoning during think-aloud interviews provided evidence to support a model of the fundamental processes involved in rating standards-based, nonprescriptive portfolios. This process model provides a framework within which to conceptualize sound-rater reasoning and to identify reasoning that distorts the meaning of scores.…

Student assessment, from the classroom to the state and national levels, is changing. The era of norm-referenced, multiple choice, standardized tests may be coming to an end, to be replaced by other forms of assessment, not all equally good. This guide outlines a vision of what assessment in the service of learning can be and provides ideas,…

The assumption that reliability is a necessary but insufficient condition for validity in assessment is challenged by exploring a dialectic between psychometric and hermeneutic approaches to drawing and warranting interpretations of human products of performance. Hermeneutic alternatives for epistemological and ethical purposes expand the range of…

The new "Mathematics Framework for California Public Schools" identifies complex instructional activities and student performance, and requires new assessment methods to reveal that performance. One of the goals of the California Assessment Collaborative (CAC) is to study the effects of local assessment development and implementation…

This book provides basic skills and knowledge about assessment so that teachers can expand their ability to deal with appraisal problems in their own settings. The first section deals with the basic principles of assessment. The second section concerns creating and applying assessment tools. The third section reviews issues in understanding and…

The current trend toward site-based management in education, with its accompanying shift toward decision making at the individual school level, means new responsibilities and roles for principals. Principals are now required to be intimately involved in budgeting, personnel recruitment and hiring, selection of curricula and textbooks, and many…

The effect of testing accommodations, such as extra time, oral reading of the assessment, or small group testing, on the participation and performance levels of limited-English-proficient students (LEP) on the Rhode Island Grade 4 Mathematics Performance Assessment was studied. A pilot study was conducted with 22 classes of students to provide…