In this three-study investigation, we applied various approaches to score drawings created in response to both Form A and Form B of the Torrance Tests of Creative Thinking-Figural (broadly TTCT-F) as well as the Multi-Trial Creative Ideation task (MTCI). We focused on TTCT-F in Study 1, and utilizing a random forest classifier, we achieved 79% and…

Recent developments in the use of large-language models have led to substantial improvements in the accuracy of content-based automated scoring of free-text responses. The reported accuracy levels suggest that automated systems could have widespread applicability in assessment. However, before they are used in operational testing, other aspects of…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

Rubrics play a crucial role in shaping educational assessment, providing clear criteria for both teaching and learning. The advent of online rubric platforms has the potential to significantly enhance the effectiveness of rubrics in educational contexts, offering innovative features for assessment and feedback through the creation of erubrics.…

Machine learning methods can be used to reduce the manual workload in exam grading, making it possible for teachers to spend more time on other tasks. However, when it comes to grading exams, fully eliminating manual work is not yet possible even with very accurate automated grading, as any grading mistakes could have significant consequences for…

Automatic essay scoring (AES) is an essential educational application in natural language processing. This automated process will alleviate the burden by increasing the reliability and consistency of the assessment. With the advances in text embedding libraries and neural network models, AES systems achieved good results in terms of accuracy.…

Background: Generative artificial intelligence (AI) represents a potentially powerful, time-saving tool for grading student essays. However, little is known about how AI-generated essay scores compare to human instructor scores. Objective: The purpose of this study was to compare the essay grading scores produced by AI with those of human…

This paper investigates crosslingual content scoring, a scenario where scoring models trained on learner data in one language are applied to data in a different language. We analyze data in five different languages (Chinese, English, French, German and Spanish) collected for three prompts of the established English ASAP content scoring dataset. We…

This study examines a Technology, Pedagogy, Content Knowledge (TPACK) training framework for pre- and in-service mathematics teachers that enables them to experience inquiry-based learning as learners in a dynamic geometry environment that serves as a mathematics laboratory. We investigate the effect of this experience on the teachers' TPACK,…

AI-enabled assessment of student papers has the potential to provide both summative and formative feedback and reduce the time spent on grading. Using auto-ethnography, this study compares AI-enabled and human assessment of business student examination papers in a law module based on previously established rubrics. Examination papers were…

Creativity is an imperative skill for today's learners, one that has important contributions to issues of inclusion and equity in education. Therefore, assessing creativity is of major importance in educational contexts. However, scoring creativity based on traditional tools suffers from subjectivity and is heavily time- and labour-consuming. This…

The Colleague AI platform introduces a groundbreaking Rubric Generation function designed to streamline how educators create and use rubrics for instructional and assessment purposes. This feature uses artificial intelligence (AI) to produce standards-based rubrics tailored to course content for formative and summative evaluations. By automating…

Background: With the arrival of generative artificial intelligence (genAI) tools, psychology educators are rethinking their assessment practices. Objective: This paper describes one approach to integrating genAI into an assessment designed to promote psychological literacy. Method: Students used ChatGPT to generate a media release about a…

Generative artificial intelligence (GAI) is becoming more popular among educators with the recent advancements in tools such as ChatGPT and Dall-E. Although there are still questions around its efficacy, this type of technology can produce data or information based on prompts, which can be adapted for teachers' use. This article explores how this…

Accompanying the recent rise in cautious popularity surrounding Generative Artificial Intelligence (Gen-AI), some language educators are exploring innovative linguistic interactions with Gen-AI. Seeking to add a literature approximation to such criticism, this article explores two activities that feature Gen-AI in undergraduate literature courses.…