Artificial intelligence (AI) technologies continue to revolutionize various sectors, including their incorporation into education, particularly in K-12 science education, which has become evidently significant. This paper presents a bibliometric analysis and systematic review that examines the incorporation of AI technologies in K-12 science…

Reading comprehension is a widely adopted method for learning English, involving reading articles and answering related questions. However, the reading comprehension training typically focuses on the skill level required for a standardized learning stage, without considering the impact of individual differences in linguistic competence. This…

Student evaluation of teaching (SET) surveys are the most widely used tool for collecting higher education student feedback to inform academic quality improvement, promotion and recruitment processes. Malicious and abusive student comments in SET surveys have the potential to harm the wellbeing and career prospects of academics. Despite much…

The purpose of this study is to generate non-verbal items for a visual reasoning test using templated-based automatic item generation (AIG). The fundamental research method involved following the three stages of template-based AIG. An item from the 2016 4th-grade entrance exam of the Science and Art Center (known as BILSEM) was chosen as the…

The study explored six ESL university students' behavioral, cognitive, and affective engagement with e-rater feedback on local issues and examined any changes in students' engagement over two weeks. We explored behavioral engagement through the analysis of screencasts of students' e-rater usage and writing assignments. We measured cognitive and…

Over the last five years, tremendous strides have been made in advancing the AIG methodology required to produce items in diverse content areas. However, the one content area where enormous problems remain unsolved is language arts, generally, and reading comprehension, more specifically. While reading comprehension test items can be created using…

While automated feedback is becoming readily accessible to student writers, how students employ resources and strategies to use such feedback remains largely unexplored. Informed by activity theory and the construct of appropriation, this study conceptualizes students' use of automated feedback as social appropriation mediated by resources and…

Recent years have witnessed an increasing interest in the use of automated writing evaluation (AWE) in second language writing classrooms. This increase is partially due to the belief that AWE can assist teachers by allowing them to devote more feedback to higher-level (HL) writing skills, such as content and organization, while the technology…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

New challenges in today's world have contributed to increased attention toward evaluating individuals' collaborative problem solving (CPS) skills. One difficulty with this work is identifying evidence of individuals' CPS capabilities, particularly when interacting in digital spaces. Often human-driven approaches are used but are limited in scale.…

To examine the utility of spoken dialog systems (SDSs) for learning and low-stakes assessment, we administered the same role-play task in two different modalities to a group of 47 tertiary-level learners of English. Each participant completed the task in an SDS setting with a fully automated agent and engaged in the same task with a human…

Classical automated test assembly (ATA) methods assume fixed and known coefficients for the constraints and the objective function. This hypothesis is not true for the estimates of item response theory parameters, which are crucial elements in test assembly classical models. To account for uncertainty in ATA, we propose a chance-constrained…

Background: Learners' writing skills are critical to their academic and professional development. Previous studies have shown that learners' self-assessment during writing is essential for assessing their writing products and monitoring their writing processes. However, conducting practical self-assessments of writing remains challenging for…

Reflective writing is an important educational practice to train reflective thinking. Currently, researchers must manually analyze these writings, limiting practice and research because the analysis is time and resource consuming. This study evaluates whether machine learning can be used to automate this manual analysis. The study investigates…

This dissertation focuses on the dynamics between teachers and machines at the intersections of design, teaching labor, and pedagogy when automation is deployed in writing classrooms. The sites of analysis are Eli Review and Turnitin, two technologies that represent different design approaches that center around "informating" or…