Recent investigations in automated essay scoring research imply that hybrid models, which combine feature engineering and the powerful tools of deep neural networks (DNNs), reach state-of-the-art performance. However, most of these findings are from holistic scoring tasks. In the present study, we use a total of four prompts from two different…

Formative assessment plays a critical role in improving learning outcomes by providing feedback on student mastery. Open-ended questions, which require students to produce multi-word, nontrivial responses, are a popular tool for formative assessment as they provide more specific insights into what students do and do not know. However, grading…

The accelerating adoption of AI in education highlights the need for an assistant that is explicitly grounded in competency-based learning to develop learners' digital competencies. This study proposes the AI Assistant Framework on Competency-Based Learning for Digital Competency Development (AICoLED) and evaluates its appropriateness through…

ChatGPT is a new technological tool with the potential to impact education. Using Vergnaud's notion of "use schemes," we analyzed three interviews with engineering students who discovered ChatGPT and started to develop initial utilization schemes of the tool. Results showed that there were three domains of use of ChatGPT: (a) in…

Prompts play a crucial role in eliciting accurate outputs from large language models (LLMs). This study examines the effectiveness of an automatic prompt engineering (APE) framework for automatic scoring in educational measurement. We collected constructed-response data from 930 students across 11 items and used human scores as the true labels. A…

ChatGPT was released to the public in November 30, 2022. This study examines how ChatGPT can be used by educators and students to promote learning and what are the challenges and limitations. This study is unique in providing one of the first systematic reviews using peer review studies to provide an early examination of the field. Using PRISMA…

Background: In the past few years there has been a growing interest in the employment of verbal productions as digital biomarkers, namely objective, quantifiable behavioural data that can be collected and measured by means of digital devices, allowing for a low-cost pathology detection, classification and monitoring. Numerous research papers have…

Designing and constructing pedagogical tests that contain items (i.e. questions) which measure various types of skills for different levels of students equitably is a challenging task. Teachers and item writers alike need to ensure that the quality of assessment materials is consistent, if student evaluations are to be objective and effective.…

Aim/Purpose: This paper is part of a multi-case study that aims to test whether generative AI makes an effective coding assistant. Particularly, this work evaluates the ability of two AI chatbots (ChatGPT and Bing Chat) to generate concise computer code, considers ethical issues related to generative AI, and offers suggestions for how to improve…

The process of generating challenging and appropriate distractors for multiple-choice questions is a complex and time-consuming task. Existing methods for an automated generation have limitations in proposing challenging distractors, or they fail to effectively filter out incorrect choices that closely resemble the correct answer, share synonymous…

The rapidly evolving digital landscape, punctuated by the emergence of artificial intelligence (AI) and immersive technologies, is poised to reshape learning environments dramatically. This study explores the potential use of ChatGPT, a state-of-the-art language model developed by OpenAI, in Metaverse learning environments. It sheds light on…

Close reading, as Paula Moya (2016) writes, may remain the "most powerful discipline-specific tool we have at our disposal" (p. 9). At a time when the work of English teachers is threatened by many factors, including political polarization and the rise of artificial intelligence (AI), close reading may be the soundest way of unifying and…

Opioid use is common among Social Security Disability Insurance (SSDI) beneficiaries, who account for a disproportionate share of opioid-related hospitalizations and mortality in the United States. However, little is known about the prevalence of opioid use prior to SSDI enrollment. Understanding when opioid use is established and how it…

After ChatGPT was released late in 2022, many arguments about its accuracy and use in education arose. In this article, I seek to provide evidence of the accuracy and validity of ChatGPT's responses to users' queries in education by applying a systematic review methodology to analyse publications in specific databases following PRISMA guidelines…

In this article, a dialogue text feature extraction model based on big data and machine learning is constructed, which transforms the high-dimensional space of text features into the low-dimensional space that is easy to process, so that the best feature words can be selected to represent the document set. Tests show that in most cases, the…