All students at Norwegian universities and colleges have the right to complain about ordinary grading decisions. When an appeal is made, two new examiners are appointed, at least one of whom should be external. The handling of appeals in the current system is to be blind, meaning that the examiners handling the complaint should not be aware of the…

This paper explores the regulators' perspective and demonstrates how legitimacy deficits of private universities outweigh performance results in decisions regarding university inspections. We examined the period when the regulator had an urgent claim on Russian universities, particularly during the campaign to 'clean the system of higher…

This article concerns assessors' use of predictions of applicants' ability to learn when assessing admission tests for specialist music teacher education in Sweden. The data consist of stimulated-recall interviews with video-recorded admission tests as stimuli, and the analyses are based on discourse psychology with a focus on the variations,…

This study aims to examine whether differences exist in the factors influencing the difficulty of scoring English summaries and determining scores based on the raters' attributes, and to collect candid opinions, considerations, and tentative suggestions for future improvements to the analytic rubric of summary writing for English learners. In this…

Purpose: The purpose of this paper is to study how quality assurance (QA) has impacted Argentina's higher education system, how QA tasks are reflected on the organizational structure of institutions, which kind of professional profiles the new QA staff assume and to what extent university life is reconfigured from these changes.…

The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…

When facilitating large-scale instructional change, leaders face stakeholder tensions that arise from different institutional pressures. Over the past 4 years, we have created an innovative "live" case competition in a strategic management course as our college's signature undergraduate experiential learning opportunity. This case has…

In recent decades, a number of training environments have moved toward program approaches targeting the development of competencies. Because of their complexity, monitoring the development of those competencies is a considerable challenge. Our hypothesis is that a computerized system could help overcome this challenge if it is well accepted by its…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

Virtual reality simulation has had a significant impact on training of psychomotor surgical skills, yet there is still a lack of work on its use to teach surgical decision making. This is particularly noteworthy given the recognized importance of decision making in achieving positive surgical outcomes. With the objective of filling this gap, we…

Research-practice partnerships have become increasingly popular for promoting evidence use, and this is similar to how evaluators partner with practitioners. Researchers and evaluators working in partnership with practitioners participated in a survey measuring evidence use, research rigor and relevance, and interpersonal factors (e.g.,…

Many high-stakes qualifications include non-exam assessments that are marked by teachers. Awarding bodies then apply a moderation process to bring the marking of these assessments to an agreed standard. Comparative Judgement (CJ) is a technique where two (or more) pieces of work are compared at a time, allowing an overall rank order of work to be…

The present study examined how narcissistic features, self-assessed lie- and truth-related abilities, and thinking processing style influence successful lying and convincing truth-telling. To this end, 100 undergraduate students completed the NPI, REI, and LTAAS questionnaires and drew two drawings each. They then presented to a panel of four…

While listeners tend to downgrade speakers' accent and comprehensibility when they perceive them to be from a different language community--a process known as reverse linguistic stereotyping (RLS)--research has generally relied solely on quantitative data such as Likert scale ratings. The current study sought to extend the analysis further by…

Due to the diversity of steps to be followed in program evaluation and knowledge, skills, qualification and competency requirements, the evaluation should be a field of expertise similar to other disciplines. Thus, it is important to consider program evaluation as a field of expertise and to determine the required competencies. This study aimed to…