This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

This paper proposes to use depth perception to represent raters' decision in holistic evaluation of ESL essays, as an alternative medium to conventional form of numerical scores. The researchers verified the new method's accuracy and inter/intra-rater reliability by inviting 24 ESL teachers to perform different representations when rating 60…

The aim of this study is to analyse the importance of the number of raters and compare the results obtained by techniques based on Classical Test Theory (CTT) and Generalizability (G) Theory. The Kappa and Krippendorff alpha techniques based on CTT were used to determine the inter-rater reliability. In this descriptive research data consists of…

According to creative writing pedagogies academic Susanne Gannon ("English in Australia, 54"(2), 43-56, 2019), and the Federal government-commissioned NAPLAN review (McGaw et al., 2020), NAPLAN has restricted how writing is taught in secondary schools. A NAPLAN-influenced structural approach to teaching writing has subsumed the…

Instructional explanations are an ubiquitous component of classroom instruction, but are relatively neglected in science education when compared to other facets of teaching and learning. The ubiquity of instructional explanations and their potential to stimulate learning in students suggests that they should garner more attention from science…

Modeling allows students to become more effective designers. High school technology and engineering students engage in engineering design challenges as part of traditional instructional practices. Model-eliciting activities (MEA) present students with opportunities to elicit mathematical thinking that facilitates modeling. Students (n = 266) from…

The primary goal of this project is to assess the students' better communication attainment after applying a series of five interactive strategies to an experiment group of subjects. This class will be compared with a control group of other participants, and in their class, the interactive approaches are not emphasized and practiced openly. The…

The assessment process in higher education considers four aspects: assessment agents, procedure, content, and scoring. In this study, we delve into the who. We analyze the role of transversal competence assessment agents in the framework of professional internships in university master's degree programs, comparing the suitability of their…

This study aimed at comparing two types of IELTS writing task 1 namely, bar charts and tables of Iranian test takers in terms of four IELTS writing assessment criteria including task achievement, coherence and cohesion, lexical resource, and grammar range and accuracy. The study also sought to identify test takers' strengths and weaknesses in the…

Although the ESL Composition Profile (CP) has been widely used by scholars as a well-balanced rubric for learner essay evaluation, it is not necessarily easy for L2 teachers to rate students' essays based on the five criteria of the CP. This indicates the necessity to explore reliable alternatives to the CP. This article, therefore, compares three…

Assessing student learning in university courses is commonly done using a rubric that arranges the assessment criteria and standards descriptors in a matrix style or grid format. This paper introduces an alternative style of grading tool known as the continua model of a guide to making judgements, which arranges assessment criteria based on a…

This study is an inquiry into the effects of reading short stories in improving foreign language writing skills through Read for Writing model, which is the adaptation of the approach called Talk for Writing (Corbett, 2013). It is a quasi-experimental 13-week field study which was implemented in a primary school. The purpose of this study is to…

If the aim of education is for all students to learn and improve, then the expectations must be transparent to the students. In this study, three aspects of transparency are investigated in relation to an examination methodology for student teachers: self-assessment criteria, a scoring rubric, and exemplars. The examinations studied were carried…

Purpose and Method of Study: The purpose of this study was to examine the quality of the design of the subject university's online general education courses based on the Quality Matters™ (QM) criteria and scoring rubric and correlate this evaluation with the implementation of the university's overall institutional mission and student learning…

Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the…