In a targeted double-scoring procedure for performance assessments that are used for licensure and certification purposes, a subset of responses receives an independent second rating if the first rating falls into a preidentified critical score range (CSR) where an additional rating would lead to considerably more reliable pass-fail decisions.…

The American Occupational Therapy Association's Fieldwork Performance Evaluation plays a vital role in occupational therapy education by guiding students and fieldwork educators in determining students' entry-level competence. This evaluation tool dates to 1953 and has undergone numerous revisions as the profession evolved and changes were made to…

The centrality of entrustable professional activities (EPAs) in competency-based medical education (CBME) is predicated on the assumption that low-stakes, high-frequency workplace-based assessments used in a programmatic approach will result in accurate and defensible judgments of competence. While there have been conversations in the literature…

Recent research on rater effects in performance assessments has increasingly focused on rater centrality, the tendency to assign scores clustering around the rating scale's middle categories. In the present paper, we adopted Jin and Wang's (2018) extended facets modeling approach and constructed a centrality continuum, ranging from raters…

Performance-based assessment is a common approach to assess the development and acquisition of practice competencies among health professions students. Judgments related to the quality of performance are typically operationalized as ratings against success criteria specified within a rubric. The extent to which the rubric is understood,…

In many performance assessments, one or two raters from the complete rater pool scores each performance, resulting in a sparse rating design, where there are limited observations of each rater relative to the complete sample of students. Although sparse rating designs can be constructed to facilitate estimation of student achievement, the…

Providing students with feedback on their performance is a critical part of enhancing student learning in chemistry and is often integrated into homework assignments, quizzes, and exams. However, not all feedback is created equal, and the type of feedback the student receives can dramatically alter the utility of the feedback to reinforce correct…

A neuropsychologist describes a child's performance on a measure of short-term verbal memory as falling in the low average range. Another neuropsychologist reports that a child scored in the below average range. A third neuropsychologist describes a child's performance as mildly impaired. Yet, all three are referring to the same score on the same…

Higher education institutions (HEIs) have long embraced a path towards sustainability and engaged in supporting sustainable development. The adoption of the sustainability development goals has forced HEIs to assess how they engage with these goals and how they address societal challenges head on. However, the emergence of sustainability rankings…

This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

Rater effects, or raters' tendencies to assign ratings to performances that are different from the ratings that the performances warranted, are well documented in rater-mediated assessments across a variety of disciplines. In many real-data studies of rater effects, researchers have reported that raters exhibit more than one effect, such as a…

This self-paced online course provides educators with detailed information on creating and using performance assessments. Through five 30-minute modules, practitioners, instructional leaders, and administrators will learn the foundational concepts of assessment literacy and how to develop, score, and use performance assessments. They will also…

During the last few years Educational Teacher Performance Assessment (edTPA) has increasingly become a hot issue in teacher education programs in the United States. edTPA has become so important for a teacher candidate because many states mandate that candidates pass the test with a state-designated score as a requirement for the initial teaching…

The Regulations of the Commissioner of Education provide that an elementary-level science test is to be administered in Grade 4 to serve as a basis for determining students' needs for academic intervention services in science. The New York State Grade 4 Elementary-Level Science Test consists of two required components: a Written Test and a…

Background: A holistic approach to performance assessment recognizes the theoretical complexity of multifaceted critical thinking (CT), a key objective of higher education. However, issues related to reliability, interpretation, and use arise with this approach. Aims and Method: Therefore, we take an analytic approach to scoring students' written…