The measurement of higher-order competencies within a tertiary education system across countries presents methodological challenges due to differences in educational systems, socio-economic factors, and perceptions as to which constructs should be assessed (Blömeke, Zlatkin-Troitschanskaia, Kuhn, & Fege, 2013). According to Hart Research…

This handbook is designed as a quick reference for first-year teachers who find themselves in an assessment driven environment with little experience to help make sense of the language, underlying philosophy, or organizational structure of the assessment system. The handbook begins with advice on developing and evaluating effective learning…

This Digest addresses developing scoring rubrics, administering performance assessments, and scoring, interpreting, and using results. In developing scoring rubrics, the criteria within the scoring rubric should be clearly aligned with the requirements of the task and the state goals and objectives. They should also be expressed in terms of…

"Classroom Assessment in Action" clarifies the multi-faceted roles of measurement and assessment and their applications in a classroom setting. Comprehensive in scope, Shermis and Di Vesta explain basic measurement concepts and show students how to interpret the results of standardized tests. From these basic concepts, the authors then…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

This "Research to Practice Note" provides an overview of the cognitive science and measurement theory and research findings that support the EFF approach to assessment. Among the key findings addressed are the following: (1) Good assessment is grounded in a clear and explicit model of the cognitive processes that underlie complex and purposeful…

The development of a scoring tool to be used with alternative and authentic assessment strategies is discussed, describing the parts of such a tool and the development process. The design is based on the Innovation Configuration (IC) process of the Concerns-Based Adoption Model. To begin, components of the test task are identified. Variations that…

Describes four criteria that can be used to evaluate methods of assessment: (1) "What are the consequences of using the test?" (2) "Is this assessment fair?" (3) "Do the skills and knowledge of this assessment transfer or generalize?" and (4) "Does this assessment cover cognitively complex task?" (KDP)

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

The application of generalizability theory to the reliability and error variance estimation for performance assessment scores is discussed. Decision makers concerned with performance assessment need to realize the restrictions that limit generalizability such as limitations that lead to reductions in the number of tasks possible, rater quality,…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

The Wechsler Intelligence Scale for Children-Third Edition (WISC-III) is an individually administered test of intelligence for assessing children aged 6 through 16 years, 11 months. The WISC-III consists of several subtests, each classified into a verbal or performance scale. The child's performance on these measures is summarized in three…

The first edition of this book was written to give information about testing to people whose work gave them access to test results, but whose training included little or nothing about the use and interpretation of tests. Later editions have been intended for a broader audience as the need for understanding what test scores really mean has…

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)