This paper explores the potential of large language models to accurately extract and translate equations from typed student responses into a standard format. This is a useful task as standardized equations can be graded reliably using a computer algebra system or a satisfiability modulo theories solver. Therefore physics instructors interested in…

Automated scoring is a current hot topic in creativity research. However, most research has focused on the English language and popular verbal creative thinking tasks, such as the alternate uses task. Therefore, in this study, we present a large language model approach for automated scoring of a scientific creative thinking task that assesses…

Searching multiple resources to locate eligible studies for research syntheses can result in hundreds to thousands of duplicate references that should be removed before the screening process for efficiency. Research investigating the performance of automated methods for deduplicating references via reference managers and systematic review software…

The new era of generative artificial intelligence has sparked the blossoming academic fireworks in the realm of education and information technologies. Driven by natural language processing (NLP), automated writing evaluation (AWE) tools become a ubiquitous practice in intelligent computer-assisted language learning (CALL) environments. Based on…

RAN (Rapid Automatized Naming) is known to be a robust predictor of reading development in different languages. Much less is known about RAN predictive power in bilingual contexts. This is the first meta-analysis of research with bilingual children, assessing the strength of the RAN-reading relationship both within and across languages. It also…

Background and Objective: Advancing automation technologies are replacing certain occupations such as those involving simple food preparation more than occupations such as those in STEM fields (e.g., engineering, health care). Older workers generally face higher job automation risks in part due to their lower levels of digital skills. A better…

Recognizing the Social Determinants of Mental Health (SDMHs) among students is essential, as lower backgrounds in these determinants elevate the risk of poor academic achievement, behavioral issues, and physical health problems, thereby affecting both physical and emotional well-being. Leveraging students' self-reported lived experiential essays…

We aimed to evaluate the performance of supervised machine learning algorithms in predicting articles relevant for full-text review in a systematic review. Overall, 16,430 manually screened titles/abstracts, including 861 references identified relevant for full-text review were used for the analysis. Of these, 40% (n = 6573) were sub-divided for…

Automatic Item Generation (AIG) is an extremely useful tool to construct many high-quality exam items more efficiently than traditional item writing methods. A large pool of items, however, presents challenges like identifying a particular item to meet a specific need. For example, when making a fixed form exam, best practices forbid item stems…

The current educational system relies heavily on manual grading, posing challenges such as delayed feedback and grading inaccuracies. Automated grading tools (AGTs) offer solutions but come with limitations. To address this, "GRAD-AI" is introduced, an advanced AGT that combines automation with teacher involvement for precise grading,…

Although it is commonly believed that automation aids human decision-making, conflicting evidence raises questions about whether individuals would gain greater advantages from automation in difficult tasks. Our study examines the combined influence of task difficulty and automation reliability on aided decision-making. We assessed decision…

There is a long-standing lack of learner satisfaction with quality and quantity of feedback in health professions education (HPE) and training. To address this, university and training programmes are increasingly using technological advancements and data analytic tools to provide feedback. One such educational technology is the Learning Analytic…

Automated assessment is well-established within computer science courses but largely absent from human--computer interaction courses. Automating the assessment of human--computer interaction (HCI) is challenging because the coursework tends not to be computational but rather highly creative, such as designing and implementing interactive…

An increasing number of language testing companies are developing and deploying deep learning-based automated essay scoring systems (AES) to replace traditional approaches that rely on handcrafted feature extraction. However, there is hesitation to accept neural network approaches to automated essay scoring because the features are automatically…

Background: Analyzing student short-answer written justifications to conceptually challenging questions has proven helpful to understand student thinking and improve conceptual understanding. However, qualitative analyses are limited by the burden of analyzing large amounts of text. Purpose: We apply dense and sparse Large Language Models (LLMs)…