With the generative artificial intelligence (AI) tool's remarkable capabilities in understanding and generating meaningful content, intriguing questions have been raised about its potential as an automated essay scoring (AES) system. One such tool is ChatGPT, which is capable of scoring any written work based on predefined criteria. However,…

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems. Students were instructed to write down verbal explanations of their reasoning process when solving one conceptual…

Despite the importance that learners must place on using prosody appropriately in EIL interaction, pragmatic functions of prosody have been largely disregarded in teaching materials and classroom instruction (Nikolic, 2018). Moreover, with a recent change in classroom paradigms instigated by the global development of educational technologies and…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

Science, Technology, Engineering, and Mathematics (STEM) education has become increasingly important in the US due to its influence on the nation's educational needs, the creation of a skilled labor force, and opportunities for more tech-savvy workers. However, the evaluation approaches and methodologies used in STEM education programs have come…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

The purpose of this study was to investigate the influence of digital and non-digital storybooks on low-income preschoolers' oral language comprehension. Employing a within-subject design on 38 four-year-olds from a Head Start program, we compared the effect of medium on preschoolers' target words and comprehension of stories. Four digital…

Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

There has been a worldwide increase in the number of postgraduate students over the last few years and therefore some examiners struggle to maintain high standards of consistency, accuracy and fairness. This is especially true in developing countries where the increase is supervision capacity is not on a par with the growth in student numbers. The…

The use of technology in the evaluation of higher education programs is a mainstay. Physical evidence rooms, face-to-face interviews, and reviewing of documentation on site have become obsolete. Relying on the heavy use of technology in the evaluation process has allowed what some believe to be a more cohesive, streamlined approach to the…

This study reports on the development and usefulness of an assessment procedure for teachers' coaching competence. We examined the usefulness of the developed procedure with respect to making reliable judgments. Video portfolios were constructed by researchers, which consisted of deliberately planned video recordings of teachers' coaching…

Education, from a student perspective, is largely driven by assessment. An effective assessment tool should be both valid and reliable, yet this is often not achieved. The aim of this literature review is to identify and appraise the evidence base for assessment tools used primarily in evaluating clinical skills of dental students. Methods:…

In education, data-driven decision making is a buzz word that has come to mean collecting absolutely as much data as possible on everything from attendance to zero tolerance, and then having absolutely no idea what to do with it. Most educational organizations with a plethora of data usually call in a data miner, or evaluator, to make some sense…

Educators participating in networked learning communities have very little support from integrated tools in evaluating students' learning activities flow and examining learners' online behaviour. There is a need for non-intrusive ways to monitor learners' progress in order better to follow their learning process and appraise the online course…