The efficiency of cognitive component skills is typically assessed with speeded performance tests. Interpreting only effective ability or effective speed as efficiency may be challenging because of the within-person dependency between both variables (speed-ability tradeoff, SAT). The present study measures efficiency as effective ability…

The conventional perception of Information Systems (IS) in educational systems, focused on improvement, often confines its role to the technical management of dashboards and performance indicators. Its transformative nature has, however, a profound impact at different levels: individual, institutional and even systemic. Thus, education systems'…

With an increase in interactions with non-human agents, understanding and forecasting the consequences of human interactions with them have become increasingly crucial. The present study focused on a subset of non-human agents known as virtual characters. To investigate whether people respond in the same way to a virtual character as they do to a…

Recent research on rater effects in performance assessments has increasingly focused on rater centrality, the tendency to assign scores clustering around the rating scale's middle categories. In the present paper, we adopted Jin and Wang's (2018) extended facets modeling approach and constructed a centrality continuum, ranging from raters…

Performance assessments (PAs) offer a more authentic measure of higher order skills, which is ideal for competency-based education (CBE) especially for students already in the workplace and striving to advance their careers. The goal of the current study was to examine the validity of undergraduate PA score interpretation in the college of IT at a…

Accomplishing a communication task in the real world requires the ability not only to do the task per se but also to manage aspects of the context in which it occurs. For this reason, simulations of target language use contexts have been incorporated into the design of communicative language tests as a way of enhancing the authenticity of…

The main goal of this study was to validate the strategy for the assessment of the cognitive complexity of chemical kinetics exam items. The strategy included three steps: 1) assessment of the difficulty of concepts, 2) assessment of distractor value, and 3) assessment of concepts' interactivity. One of the tasks was to determine whether there…

The Educative Teacher Performance Assessment (edTPA) is a widely implemented performance assessment in the United States used to indicate the readiness of pre-service teachers to enter the classroom and the level of pre-service teacher preparation supported by individual colleges of education. The purpose of this study is to investigate the…

Authentic assessment is revered to support student learning, but it is typically described within the context of work-integrated learning and professional schools, leaving one to question whether a classroom-based curriculum can offer authentic assessments. This study documented the prevalence of authentic assessments throughout a complete health…

The Performance Assessment for California Teachers (PACT) is a high stakes summative assessment that was designed to measure pre-service teacher readiness. We examined the inter-rater reliability (IRR) of trained PACT evaluators who rated 19 candidates. As measured by Cohen's weighted kappa, the overall IRR estimate was 0.17 (poor strength of…

This study investigates the comparability of three parallel translation tasks selected from a College English Test Band-6 (CET-6) and explores the major linguistic features contributing to translation difficulty. Data obtained from the participants' subjective rating, eye-tracking, and performance evaluation were triangulated to measure the…

A stated ambition for universities is to help all students develop meaningful career trajectories and make positive contributions to local, national and global communities. To achieve this ambition, universities need to reflect in depth on how approaches to assessment help develop global talent. The present article explores, from a…

How can learners be supported to engage productively in the kinds of feedback practices they may encounter after they graduate? This article introduces a novel concept of authentic feedback to denote processes which resemble the feedback practices of the discipline, profession or workplace. Drawing on the notion of authentic assessment, a…