Behavior rating scales represent one of the most commonly used types of assessments in school psychology. Yet, they suffer from a fundamental limitation: They are an indirect methodology influenced partially by student behavior and partially by rater perspectives. Thus, the current study utilized advanced analytic approaches to evaluate rater…

Providing timely feedback is crucial in promoting academic achievement and student success. However, for multifarious reasons (e.g., limited teaching resources), feedback often arrives too late for learners to act on the feedback and improve learning. Thus, automated feedback systems have emerged to tackle educational tasks in various domains,…

The aim of this study is to analyse the importance of the number of raters and compare the results obtained by techniques based on Classical Test Theory (CTT) and Generalizability (G) Theory. The Kappa and Krippendorff alpha techniques based on CTT were used to determine the inter-rater reliability. In this descriptive research data consists of…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

This study conducts a comprehensive analysis of the assessment of journal writing in English as a Foreign Language (EFL) at the secondary school level, comparing the performance of a Generative Artificial Intelligence (GenAI) platform with two human graders. Employing a convergent parallel mixed methods design, quantitative data were collected…

Purpose: The purpose of this paper is to examine the perceptions of school principals of the evaluator's role and to learn about their requirements of school evaluators. Design/methodology/approach: The current study is based on the qualitative paradigm of data collection and analysis. This paradigm provides a profound a description of the…

Learner handover (LH), the process of sharing of information about learners between faculty supervisors, allows for longitudinal assessment fundamental in the competency-based education model. However, the potential to bias future assessments has been raised as a concern. The purpose of this study is to determine whether prior performance…

During the pandemic, teachers whose practice depends on maker-based learning have had the added challenge of translating their hands-on lessons for remote teaching. Yet with students making remotely, how can a teacher monitor the students' progress, offer timely feedback, or infer what the students understood? In short, how are teachers assessing…

Peer review is viewed as a valid quality assurance mechanism in higher education. Peer review of teaching is common practice at universities in Australia. However, peer review of assessment is a relatively new innovation in tertiary education. Peer review of assessment in a Triad structure utilised data, via interviews with academics and students,…

Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

In Pakistan, an accreditation system has been introduced to accredit teacher education programs and initiatives are being taken to begin the registration, licensing, and certification process of teachers. The Higher Education Commission (HEC) Pakistan has declared the accreditation of teacher education programs mandatory. All the institutions…

Acting as a reviewer is considered a substantial part of the role-bundle of the academic profession (quality assurance (QA) and quality enhancement (QE) role). Research literature about peer review, for example, for journals and grants, shows that acting as a peer reviewer adds to an academic's reputation. However, little is known about academics'…

Massive Open Online Courses (MOOCs) have become more and more popular recently. These courses have attracted a large number of students world-wide. In a popular course, there may be thousands of students. Such a large number of students in one course makes it infeasible for the instructors to grade all the submissions. Peer assessment is thus an…

Undergraduate clinical assessors make expert, multifaceted judgements of consultation skills in concert with medical school OSCE grading rubrics. Assessors are not cognitive machines: their judgements are made in the light of prior experience and social interactions with students. It is important to understand assessors' working conceptualisations…

The challenge and opportunity for the field of evaluation is to prepare evaluators with sophisticated interpersonal competence alongside technical research skills. This article shows that service-learning, a "real-world" pedagogical model, holds promise as a way to educate students in evaluation while developing their interpersonal…