Recent developments in the use of large-language models have led to substantial improvements in the accuracy of content-based automated scoring of free-text responses. The reported accuracy levels suggest that automated systems could have widespread applicability in assessment. However, before they are used in operational testing, other aspects of…

This paper explores the efficacy of ChatGPT, a generative artificial intelligence in educational contexts, particularly concerning its potential to assist students in overcoming academic challenges while highlighting its limitations. ChatGPT is suitable for solving general problems. When a student comes across academic challenges, ChatGPT may…

Interrupted time series (ITS) studies are frequently used to examine the impact of population-level interventions or exposures. Systematic reviews with meta-analyses including ITS designs may inform public health and policy decision-making. Re-analysis of ITS may be required for inclusion in meta-analysis. While publications of ITS rarely provide…

The analysis of spoken language has been integral to a breadth of research in social science and beyond. However, for analyses to occur with efficiency, language must be in the form of computer-readable text. Historically, the speech-to-text process has occurred manually using human transcriptionists. Automated speech recognition (ASR) is…

Purpose: ParAlg (Paraphasia Algorithms) is a software that automatically categorizes a person with aphasia's naming error (paraphasia) in relation to its intended target on a picture-naming test. These classifications (based on lexicality as well as semantic, phonological, and morphological similarity to the target) are important for…

When we read, errors in oculomotor programming can cause the eyes to land and fixate on different words from what the mind intended. Previous work suggests that these "mislocated fixations" form 10-30% of first-pass fixations in reading eye movement data, which presents theoretical and analytic issues for eyetracking-while-reading…

This study examined effects of pronunciation training using automatic speech recognition technology on common pronunciation errors of Korean English learners. Participants were divided into two groups. One group was given instruction and training about the use of automatic speech recognition for pronunciation practice. The other group was not…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Automatic speech recognition (ASR) has considerable potential to model aspects of classroom discourse with the goals of automated assessment, feedback, and instructional support. However, modeling student talk is besieged by numerous challenges including a lack of data for child speech, low signal to noise ratio, speech disfluencies, and…

This study seeks to clarify whether teachers are able to distinguish between essays written by English L2 students or generated by ChatGPT. 47 instructors who hold experience teaching English to native speakers of Japanese in universities or other higher education institutions were tested on whether they could identify between human written essays…

Mass adoption of neural machine translation (NMT) tools in the translation workflow has exerted a significant impact on the language services industry over the last decade. There are claims that with the advent of NMT, automated translation has reached human parity for translating news (see, e.g. Popel et al. 2020). Moreover, some machine…

An online peer-assessment system typically allows students to give textual feedback to their peers, with the goal of helping the peers improve their work. The amount of help that students receive is highly dependent on the quality of the reviews. Previous studies have investigated using machine learning to detect characteristics of reviews (e.g.,…

Age of acquisition (AoA) is a measure of word complexity which refers to the age at which a word is typically learned. AoA measures have shown strong correlations with reading comprehension, lexical decision times, and writing quality. AoA scores based on both adult and child data have limitations that allow for error in measurement, and increase…

This study aims to explore how corpus-based approaches can be used to address the distinctions of English near-synonyms effectively. Especially, it collected source data from the British National Corpus (BNC) and adopted Sketch Engine (SkE) as an analyzing tool to compare the near synonymous pair "damage" and "destroy" commonly…

While feedback is widely considered essential for second language (L2) writing development (Bitchener & Ferris, 2012), teachers may not always be able to provide their learners with immediate and frequent corrective feedback. Automated writing evaluation (AWE) systems can help respond to this challenge by providing L2 learners with written…