Background: A holistic approach to performance assessment recognizes the theoretical complexity of multifaceted critical thinking (CT), a key objective of higher education. However, issues related to reliability, interpretation, and use arise with this approach. Aims and Method: Therefore, we take an analytic approach to scoring students' written…

The measurement of higher-order competencies within a tertiary education system across countries presents methodological challenges due to differences in educational systems, socio-economic factors, and perceptions as to which constructs should be assessed (Blömeke, Zlatkin-Troitschanskaia, Kuhn, & Fege, 2013). According to Hart Research…

The purpose of this article is to provide an overview of the process used to examine the inter-rater reliability of the Teacher Work Sample (TWS) Scoring Rubric involved with the senior culminating experience for teacher candidates used at a large comprehensive university. The study compared holistic and analytic scores reported by Student Teacher…

Analyzes the three major inferences involved in interpretation of performance assessments: (1) scoring of the observed performances; (2) generalization to a domain of assessment performances like those included in the assessment; and (3) extrapolation to the large performance domain of interest. Suggests ways to improve the validity of performance…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

The construct validity of content standards is addressed in terms of their representative coverage of a construct domain and their alignment with the students' cognitive level of developing expertise in the subject matter. The construct validity of performance standards is addressed in terms of the extent to which they reflect increasing levels of…

The development of a scoring tool to be used with alternative and authentic assessment strategies is discussed, describing the parts of such a tool and the development process. The design is based on the Innovation Configuration (IC) process of the Concerns-Based Adoption Model. To begin, components of the test task are identified. Variations that…

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

In 1999, Rhode Island students in grades 3, 7, and 10 took a performance assessment in writing as part of the Rhode Island State Assessment Program. These two documents, a guide for educators and a guide for parents, describe the test and its scoring. The test is called a performance assessment because it requires the students to demonstrate their…

Rubric-related and rubric-unrelated features used by teacher raters to assign scores to constructed response items for mathematics and reading assessment were studied by looking at 1000 papers from Kansas seventh and tenth graders. Results validated the influence of correctness of answer in both mathematics and reading holistic scores. (SLD)

The Wechsler Intelligence Scale for Children-Third Edition (WISC-III) is an individually administered test of intelligence for assessing children aged 6 through 16 years, 11 months. The WISC-III consists of several subtests, each classified into a verbal or performance scale. The child's performance on these measures is summarized in three…

The purpose of the "Guide to Interpretation" is to assist Rhode Island educators in understanding the links between performance assessment and classroom instruction. This guide offers an overview of the Health Education Performance Assessment taken by all Rhode Island students in grades 5 and 9, an explanation of the scoring process, and…

Several common sources of error in assessment that depends on the use of judges are identified, and ways to reduce the impact of rating errors are examined. Numerous threats to the validity of scores based on ratings exist. These threats include: (1) the halo effect; (2) stereotyping; (3) perception differences; (4) leniency/stringency error; and…

The extent to which performance assessments can have unintended and undesirable consequences is not yet clear, but preliminary evidence suggests several issues of bias and fairness. Among these is the sheer difficulty of scoring complex performance assessments, as Vermont's experiences with portfolio assessment illustrate. (SLD)

Since 1988 the Vermont Department of Education has been developing an innovative statewide performance assessment program. In 1990, the RAND Corporation began evaluating the Vermont assessment program, focusing specifically on the portfolio component of its assessment system. This report presents results from the evaluation in the 1992-93 school…