The array of different philosophical positions underlying contemporary views on competence, assessment strategies and justification have led to advances in assessment science. Challenges may arise when these philosophical positions are not considered in assessment design. These can include (a) a logical incompatibility leading to varied or…

The 2014 Michigan Public High School Context and Performance Report Card is the Mackinac Center's second effort to measure high school performance. The first high school assessment was published in 2012, followed by the Center's 2013 elementary and middle school report card, which used a similar methodology to evaluate school performance. The…

Analyzes the three major inferences involved in interpretation of performance assessments: (1) scoring of the observed performances; (2) generalization to a domain of assessment performances like those included in the assessment; and (3) extrapolation to the large performance domain of interest. Suggests ways to improve the validity of performance…

K. K. Waltman and D. A. Frisbie (1994) observed that teachers and parents often interpret grades given to students in both absolute and relative senses. They conclude that this sort of interpretation is illogical and may indicate misunderstandings in several areas. Absolute and relative methods of assigning letter grades are approached from…

This commentary on articles in this special issue generally agrees with the viewpoints expressed, although it argues that in some cases the authors of these articles should have expanded on certain issues. Many comments relate to the legal defensibility of the positions taken. (SLD)

The construct validity of content standards is addressed in terms of their representative coverage of a construct domain and their alignment with the students' cognitive level of developing expertise in the subject matter. The construct validity of performance standards is addressed in terms of the extent to which they reflect increasing levels of…

Six dimensions of curriculum profiles are identified: (1) function-purpose; (2) curriculum coverage; (3) criterion referencing; (4) validity-reliability; (5) manageability; and (6) interpretability. Each dimension in Australian National Profiles, the Victoria (Australia) Profiles, and the National Curriculum Assessment in England and Wales is…

The development of a scoring tool to be used with alternative and authentic assessment strategies is discussed, describing the parts of such a tool and the development process. The design is based on the Innovation Configuration (IC) process of the Concerns-Based Adoption Model. To begin, components of the test task are identified. Variations that…

In contrast to multiple choice, alternative modes of assessment afford varying degrees of openness in the allowable responses. Prominent among the alternatives is the assessment of performance, sometimes in its own right where the issue is the quality of the particular performance per se, but more often as a vehicle for the assessment of…

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

The quantity of information obtained by performance assessments, compared to traditional testing methods, not only offers the potential for a great deal more feedback to educators, students, parents, and policy makers, but also presents educational personnel with the additional challenge of developing new techniques for effectively disseminating…

The application of generalizability theory to the reliability and error variance estimation for performance assessment scores is discussed. Decision makers concerned with performance assessment need to realize the restrictions that limit generalizability such as limitations that lead to reductions in the number of tasks possible, rater quality,…

The idea that validity should be considered a property of inferences, rather than of assessments, has developed slowly over the past century. In early writings about the validity of educational assessments, validity was defined as a property of an assessment. The most common definition was that an assessment was valid to the extent that it…

A quiz is presented that may call the attention of school personnel to regression effects in educational measurement, and clarify the meaning of statistical regression for educators in schools. Ten questions and their answers explore regression in the contexts of classroom testing, grading, and performance assessment. (SLD)