Background: Generative artificial intelligence (AI) represents a potentially powerful, time-saving tool for grading student essays. However, little is known about how AI-generated essay scores compare to human instructor scores. Objective: The purpose of this study was to compare the essay grading scores produced by AI with those of human…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

The main objective of this Methods Showcase Article is to show how the technique of adaptive comparative judgment, coupled with a crowdsourcing approach, can offer practical solutions to reliability issues as well as to address the time and cost difficulties associated with a text-based approach to proficiency assessment in L2 research. We…

Software security is inevitably dependent on developers' ability to to design and implement software without security bugs. Perhaps unsurprisingly, developers often fail to do this. Our goal is to understand this from a usability perspective, identifying how we might best train developers and equip them with the right software tools. To this end,…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students' writing using prompts and pre-defined rubrics compared to human raters.…

The aims of the study were analyzing students' understanding and skills to make concept mapping in work energy matter through C-Map application software. True experimental method with randomized control group pre-test and post-test design was utilized in the research method. The research involved 72 public high school students from second…

Background: Recent evidence suggests PechaKucha--a presentation style utilizing simplified visuals, narration, and rigid time constraints--may promote various learning outcomes and instructor goals better than traditional PowerPoint presentations. Objective: The purpose of this study was to test the effectiveness of students' PechaKucha compared…

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated…

This quasi-experimental research aimed to examine if and to what extent the adaptation of the 4/3/2 technique and self-assessment contributes to the improvement of students' speaking fluency. 24 ninth graders ranging from 11 to 13 years old were separated randomly into control and experimental groups, each having 12 participants. The data were…

Learners in the process of developing complex skills need a rich mental model of what such skills entail. Textual analytics rubrics (TR) are a widely used instrument to support formative assessment of complex skills, supporting feedback, reflection, and thus mental model development of complex skills. However, the textual nature of a rubric limits…

The development of computational thinking is as important as writing, reading and arithmetic, and, it should start as early as kindergarten (Wing, 2008). However, little has been done in terms of investigating the factors influencing the development of computational thinking in preschool education (Bers et al., 2014; Ching et al., 2018; Kazakoff…

This paper focuses on examining the use of the Duolingo App as a supplement to the traditional ESP courses in Secretarial Studies, for Advanced ESP learners Classes of Lycée Technique et Professional de Porto Novo (LTP-PN), in the Benin Republic. The Objective is to assess substantial improvement of Learners Oral Communication skills after 3…

Rubrics can guide teachers to provide effective feedback and students' peer- and self-assessment. This paper examines the effect of rubric use in flipped learning activities on students' learning achievement, metacognitive awareness, and cognitive load through a quasi-experiment. A total of 83 university students were randomly assigned to an…

Despite less than 10% of South Africans claiming English as their home language, it has become the de facto language of instruction. Yet we cannot assume that teachers have sufficient command of this language when using it for instructional purposes. As a sub-study, in this article we report on the oral proficiency of isiZulu-speaking pre-service…