One of the greatest challenges for schools is to identify effective and ineffective teachers in a classroom. Teacher evaluation is an expensive process in both time and resources. It is important that evaluations provide data to improve teaching and learning. Therefore, each evaluation needs to communicate opportunities for growth. This…

The teacher evaluation process has been an area of study for decades because of its complexity. Going back to one-room schoolhouses, teaching has always been an isolated profession--usually a room, a teacher, and students. Other colleagues or administrators are not participants in the classroom most of the time, which creates difficulties for…

This study aimed to measure the effect of rater training given to improve the peer assessment skills of secondary school students on rater behaviors using the many-facet Rasch Measurement model. The research employed a single-group pretest-posttest design. Since all raters scored all students, the analyses were carried out in a fully crossed (s x…

Background: Secondary school teachers sometimes teach and assess material outside their specialisms for reasons including staff shortages or the growing popularity of the interdisciplinary courses. We hypothesised that teacher-assessors with different subject specialisms may differ in their interpretations of frequently used words in teaching and…

The purpose of this quantitative correlational study was to determine if, and to what extent, a relationship existed between teachers' perceptions of their evaluator's instructional leadership and the teachers' evaluation scores at the middle and high school levels in one Florida school district. Ozcan's theory of teacher motivation states that…

For the first time in the history of the high stakes Leaving Certificate Established examination in Ireland, teachers graded and ranked their own students due to COVID-19 restrictions. In the wake of the process, a questionnaire and focus group interviews explored how teachers engaged with the Leaving Certificate Calculated Grades 2020 (CG2020)…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…

Broadly defined, academic language (AL) is a set of lexical-grammatical norms and registers commonly used in educational and academic discourse. Mastery of academic language in writing is an important aspect of writing instruction and assessment. The purpose of this study was to use Natural Language Processing (NLP) tools to examine the extent to…

Teacher performance scores inform education leaders' management of teacher human resources. However, prior research has implied that different interpretations of performance criteria between teachers and their evaluators suppress teacher development. Although research has examined teacher perceptions of performance scores and compared teacher…

Purpose: Multiple-measure principal evaluation systems have become commonplace in the past decade, but we do not know how principals perceive their evaluations under these regimes. This study analyzes how principals perceive evaluation in a state that was an early adopter of such a system. It describes how attitudes are explained by individual and…

Purpose: Multiple-measure principal evaluation systems have become commonplace in the last decade, but we do not know how principals perceive their evaluations under these regimes. This study analyzes how principals perceive evaluation in a state that was an early adopter of such a system. It describes how attitudes are explained by individual and…

We investigated the relationship between the scores assigned by an Automated Essay Scoring (AES) system, the Intelligent Essay Assessor (IEA), and grades allocated by trained, professional human raters to English essay writing by instigating two procedures novel to written-language assessment: the logistic transformation of AES raw scores into…

Professionalising outreach and evaluation work would enhance the quality and rigour of provision, benefit widening participation students and achieve regulatory requirements (Bowes et al. [2019]. "The National Collaborative Outreach Programme End of Phase 1 report for the national formative and impact evaluations." Office for Students;…

In recent decades, the assessment of instructional quality has grown into a popular and well-funded arm of educational research. The present study contributes to this field by exploring first impressions of untrained raters as an innovative approach of assessment. We apply the thin slice procedure to obtain ratings of instructional quality along…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…