Recent developments in the use of large-language models have led to substantial improvements in the accuracy of content-based automated scoring of free-text responses. The reported accuracy levels suggest that automated systems could have widespread applicability in assessment. However, before they are used in operational testing, other aspects of…

Knowing functions and functional thinking have recently moved from just knowledge for older students to incorporating younger students, and functional thinking has been identified as one of the core competencies for algebra. Although it is significant for mathematical understanding, there is no unified view of functional thinking and how different…

Researchers have increasingly utilized artificial intelligence to automatically analyze classroom dialogue, aiming to provide timely feedback to teachers due to its educational significance. However, traditional machine learning and deep learning models face challenges, such as limited performance and lack of generalizability, across various…

In the changing realm of academic research, Generative Artificial Intelligence (AI) is a significant force, altering the way knowledge is pursued and understood. "Enhancing Doctoral Dissertations Ethically with AI: A Comprehensive Guide" serves as an indispensable guide for doctoral students and educators on the frontline of this shift,…

The capabilities of large language models (LLMs) in language comprehension, conversational interaction, and content generation have led to their widespread adoption across various educational stages and contexts. Given the fundamental role of education, concerns are rising about whether LLMs can serve as competent teachers. To address the…

Despite extensive studies on large language models and their capability to respond to questions from various licensed exams, there has been limited focus on employing chatbots for specific subjects within the medical curriculum, specifically medical neuroscience. This research compared the performances of Claude 3.5 Sonnet (Anthropic), GPT-3.5 and…

Recent advancements in large language models (LLMs) hold significant promise for improving physics education research that uses machine learning. In this study, we compare the application of various models for conducting a large-scale analysis of written text grounded in a physics education research classification problem: identifying skills in…

This study evaluates Large language models (LLMs)' performance on Chinese Postgraduate Medical Entrance Examination (CPGMEE) as well as the hallucinations produced by LLMs and investigate their implications for medical education. We curated 10 trials of mock CPGMEE to evaluate the performances of 4 LLMs (GPT-4.0, ChatGPT, QWen 2.1 and Ernie 4.0).…

Technological advances have made the ability to translate no longer exclusively belong to humans. Today, machine translation has turned into a tool with superior performance to convert text between languages without the need for human intervention. One of the translation research foci is the studies of causative translation, especially from…

Creating assessment questions aligned to standards is a time-consuming task for teachers, but large language models such as ChatGPT can help. Bryan Drost & Char Shryock describe a three-step process for using ChatGPT to create assessments: 1) Ask ChatGPT to break standards into measurable targets. 2) Determine how much time to spend on each…

With the growing attention directed towards ChatGPT and its applications in education, this study explored its impact on various variables pertaining to student learning. Specifically, an integrated theoretical framework was used to investigate the factors that influence student problem-solving and critical thinking abilities when using ChatGPT…

Providing timely and personalized feedback on open-ended student responses is a challenge in education due to the increased workloads and time constraints educators face. While existing research has explored how learning analytic approaches can support feedback provision, previous studies have not sufficiently investigated educators' perspectives…

We conducted two experiments to assess the alignment between Generative AI (GenAI) text personalization and hypothetical readers' profiles. In Experiment 1, four LLMs (i.e., Claude 3.5 Sonnet; Llama; Gemini Pro 1.5; ChatGPT 4) were prompted to tailor 10 science texts (i.e., biology, chemistry, physics) to accommodate four different profiles…

ChatGPT, as an example of generative artificial intelligence, possesses high-level conversational and problem-solving capabilities supported by powerful computational models and big data. However, the powerful performance of ChatGPT might enhance learner dependency. Although it has not yet been confirmed, many teachers and scholars are also…

As the development and application of large language models (LLMs) in physics education progress, the well-known AI-based chatbot ChatGPT4 has presented numerous opportunities for educational assessment. Investigating the potential of AI tools in practical educational assessment carries profound significance. This study explored the comparative…