The study aims to examine the interplay of two critical constructs in evaluation: essential evaluator competency and evaluator practice. The research questions in this study, according to Smith (2008), are essentially, what he defined as "fundamental issues in evaluation." These issues fall into one or multiple of the four aspects…

Teachers have consistently been proven by research as the most critical factor in the academic success of students (Baker et al., 2010, Darling-Hammond, 2000, Tucker & Stronge, 2005, Taylor & Tyler, 2012). Having a quality teacher therefore provides the best pathway to strong student achievement, and knowing how to evaluate quality…

Understanding any inter- and intra-personal dynamic that affects bias in the judgment of creative output is among numerous areas of focus for researchers in Psychology (or subset field). Notably, as a result of changes in interpersonal dynamics, conditions of subjective construal can induce bias either leniently or severely without any due…

When students present writing tasks that require higher order thinking skills to work, one of the most important problems is scoring these writing tasks objectively. The fact that raters give scores below or above their performance based on several environmental factors affects the consistency of the measurements. Inconsistencies in scoring…

Across the country, school districts are increasingly seeking out privately contracted psychologists to conduct psychological evaluations. As such, it is increasingly important that psychological reports adhere to best practices and are written to ensure comprehension by both parents and teachers. This study explored the potential differences…

A perfect writing skill has been deemed instrumental to achieving competence in EFL, yet it is considered one of the most impressive learning domains. This study investigates the impact of human-AI collaborative feedback on the writing proficiency of EFL students. It examines key teaching domains, including the teaching environment, teacher…

The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously,…

Background: Invention and mastery learning approaches differ in their foundational educational paradigms, proposed mechanisms of learning, and potential impacts on learning outcomes. They also differ in their resource requirements. We explored the relative effects of 'invent and problem-solve, followed by instruction' (PS-I) learning compared to…

It is widely believed that human rating performance is influenced by an array of different factors. Among these, rater-related variables such as experience, language background, perceptions, and attitudes have been mentioned. One of the important rater-related factors is the way the raters interact with the rating scales. In particular, how raters…

Many high-stakes qualifications include non-exam assessments that are marked by teachers. Awarding bodies then apply a moderation process to bring the marking of these assessments to an agreed standard. Comparative Judgement (CJ) is a technique where two (or more) pieces of work are compared at a time, allowing an overall rank order of work to be…

Evaluators have opportunities to advance equity within evaluations, yet little research has examined whether and how evaluators center equity in evaluation practice. This paper explores whether and how evaluators in New England address inequities and advance equity throughout evaluation phases. The study uses a complementarity, sequential mixed…

Rubric scoring has been gaining traction as an emergent method to assess spoken-language interpreting, with two of the most well-known methods being rating scale-based holistic and analytic scoring. While the former provides a single global score, the latter generates separate scores on different dimensions of interpreting performance. Despite the…

The present study examined how narcissistic features, self-assessed lie- and truth-related abilities, and thinking processing style influence successful lying and convincing truth-telling. To this end, 100 undergraduate students completed the NPI, REI, and LTAAS questionnaires and drew two drawings each. They then presented to a panel of four…

One of the main generic competencies in Higher Education is "Learning to Learn". The key component of this competence is the capacity for self-regulated learning (SRL). For this competence to be developed, peer feedback seems useful because it fosters evaluative judgement. Following the principles of peer feedback processes, an online…

Writing support programs for students in writing-intensive, disciplinary courses are well established and take many forms, including communication centers, web-based skill development programs, and embedded writing consultants. This paper assesses the effectiveness of a program that embeds a writing grader, who assesses only the grammar of…