The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…

This study examined the relationships between reading assistant (RA) software usage, reading comprehension ability, and post-TOEIC reading scores among Thai EFL university students. Seventy-six students from a private international university in central Thailand participated. Data were collected from students' pre- and post-TOEIC reading scores…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

With the incremental integration of technology in writing assessment, technology-generated feedback has found its way to take further steps toward replacing human corrective feedback and rating. Yet, further investigation is deemed necessary regarding its potential use either as a supplement to or replacement for human feedback. This study aims to…

The present study investigated the speaking module of TOEFL iBT with an emphasis on the dichotomy of independent and integrated tasks. The potential differences between the two speaking conditions were intended to be explored based on the oral performance elicited from a group of Iranian test takers. To collect the required data, a simulated…

This study examined the validity of data collected from a novel online story retell task. The task was specifically designed for use by junior school teachers with the support of speech-language therapists or literacy specialists. The assessment task was developed to monitor children's oral language progress in their first year at school as part…

This experimental study, using a pretest-treatment-posttest design, compared the effects of focused direct written corrective feedback and additional writing practice on L2 learners' written syntactic complexity. The participants were 60 Iranian elementary EFL learners, whose L2 proficiency as well as L2 writing syntactic complexity and accuracy…

Many studies that have investigated the educational value of online machine translation (MT) in second language (L2) writing generally report significant improvements after MT use, but no study as of yet has comprehensively analyzed the effectiveness of MT use in terms of various measures in syntactic complexity, accuracy, lexical complexity, and…

A computer program was developed to estimate speed-accuracy response models for dichotomous items. This report describes how the models are estimated and how to specify data and input files. An example using data from a listening section of an international language test is described to illustrate the modeling approach and features of the computer…

This study aims at investigating the challenges that Yemeni translation students encounter when translating neologisms from English into Arabic. It also aims at comparing students' translation with outcomes of machine translation (MT). The authors follow the descriptive and comparative methods in conducting this study. To achieve the objective of…

Background: Children with developmental language disorder (DLD) demonstrate deficits in vocabulary development and novel word learning processes, which have been proposed to stem from their speech perception deficits. Aims: This study had two aims. The first was to evaluate the efficacy of an intervention incorporating a computer-based phonetic…

This study had two aims. The first was to explain the process of using the Rasch measurement model to validate tests in an easy-to-understand way for those unfamiliar with the Rasch measurement model. The second was to validate two final exams with several shared items. The exams were given to two groups of students with slightly differing English…

Item Response Theory (IRT) is a ubiquitous model for understanding humans based on their responses to questions, used in fields as diverse as education, medicine and psychology. Large modern datasets offer opportunities to capture more nuances in human behavior, potentially improving test scoring and better informing public policy. Yet larger…

We explore the nature of forgetting in a corpus of 125,000 students learning Spanish using the Rosetta Stone® foreign-language instruction software across 48 lessons. Students are tested on a lesson after its initial study and are then retested after a variable time lag. We observe forgetting consistent with power function decay at a rate that…

Two groups of freshman students, enrolled in a Vocabulary I and Reading I courses, participated in the study. Before instruction, both groups took a recognition (vocabulary) and a production (oral reading) pre-test. Comparisons of the pre-test scores showed no significant differences between the experimental and control group in decoding skills…