Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

In Automated Essay Scoring (AES) systems, many previous works have studied group fairness using the demographic features of essay writers. However, individual fairness also plays an important role in fair evaluation and has not been yet explored. Initialized by Dwork et al., the fundamental concept of individual fairness is "similar people…

In this study, an explanatory sequential design was utilized to examine the impact of strategy-based instruction (SBI) on the writing performance and motivation of English as a Foreign Language (EFL) learners in a writing course. A total of 50 Chinese EFL students were selected from two intact classes and were randomly assigned to either the…

In the process of measuring and assessing high-level cognitive skills, interference of rater errors in measurements brings about a constant concern and low objectivity. The main purpose of this study was to investigate the impact of rater training on rater errors in the process of assessing individual performance. The study was conducted with a…

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students' writing using prompts and pre-defined rubrics compared to human raters.…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

The writing of student theses is an important activity at universities and is expected to demonstrate the students' academic skills. In the teacher-education programme, examiners from different academic disciplines are involved in supervising and examining student theses. Moreover, different subject disciplines have different traditions concerning…

This exploratory study investigated the effect of assessing both process and product compared to assessing written products alone. Two groups of students received teacher feedback over a one-year period. One group was assessed on their revisions in addition to the quality of final drafts, while a second group was assessed on the quality of final…

Literacy educators and researchers have long recognized the importance of increasing students' writing proficiency across age and grade levels. With the release of the Common Core State Standards (CCSS), a new and greater emphasis is being placed on writing in the K-12 curriculum. Educators, as well as the authors of the CCSS, agree that…

Introductory biology courses are supposed to serve as gateways for many majors, but too often they serve instead as gatekeepers. Reliance on lectures, large classes, and multiple-choice tests results in high drop and failure rates. Critiques of undergraduate science education are clear about the problems with conventional introductory science…

This longitudinal study examined whether the implementation of a Spanish-English paired literacy approach provides an academic advantage to emerging bilingual students over a sequential literacy approach. The study employed a quasi-experimental design. It compared the biliteracy outcomes of third-grade emerging bilingual learners participating in…

Adaptive Comparative Judgement (ACJ) is a modification of Thurstone's method of comparative judgement that exploits the power of adaptivity, but in scoring rather than testing. Professional judgement by teachers replaces the marking of tests; a judge is asked to compare the work of two students and simply to decide which of them is the better.…

Dynamic assessment originates in the Zone of Proximal Development (ZPD). Practicing dynamic assessment necessarily requires the development of ZPD. This study aimed to investigate the effect of peer-assisted mediation vs. tutor-intervention within dynamic assessment framework on writing development and the attitude of Iranian intermediate EFL…

Background: Many in education argue for the importance of incorporating teacher judgements in the assessment and reporting of student performance. Advocates of such an approach are cognisant, though, that obtaining a satisfactory level of consistency in teacher judgements poses a challenge. Purpose: This study investigates the extent to which the…

This study investigates the potential of a software tool based on Latent Semantic Analysis (LSA; Landauer, McNamara, Dennis, & Kintsch, 2007) to automatically evaluate complex German texts. A sample of N = 94 German university students provided written answers to questions that involved a high amount of analytical reasoning and evaluation.…