This study explores and analyzes the specific performance of large language models (LLMs) in instructional design, aiming to unveil their potential strengths and possible weaknesses. Recently, the influence of LLMs has gradually increased in multiple fields, yet exploratory research on their application in education remains relatively scarce. In…

Technological Advances in Artificial Intelligence (AI) have Brought forth the Potential for Models to Assist in Academic Writing. However, Concerns Regarding the Accuracy, Reliability, and Impact of AI in Academic Writing have been Raised. This Study Examined the Capabilities of GPT-4, a state-of-the-art AI Language Model, in Writing an American…

Artificial intelligence (AI) technologies have been consistently influencing the progress of education for an extended period, with its impact becoming more significant especially after the launch of ChatGPT-3.5 at the end of November 2022. In the field of physics education, recent research regarding the performance of ChatGPT-3.5 in solving…

Teamwork skills are commonly evaluated by human assessors, which can be logistically challenging and resource intensive. Technological advancements provide an opportunity for a new assessment method -- virtual behavioural simulations with self-scoring algorithms. This study explores whether a rule-based algorithm can match human assessors at…

Large language models (LLMs), such as ChatGPT, are becoming increasingly prominent. Their use is becoming more and more popular to assist with simple tasks, such as summarizing documents, translating languages, rephrasing sentences, or answering questions. Reports like McKinsey's (Chui, & Yee, 2023) estimate that by implementing LLMs,…

In this study, we introduce a framework designed to help educators assess the effectiveness of popular generative artificial intelligence (AI) tools in solving authentic assessments. We employed Bloom's taxonomy as a guiding principle to create authentic assessments that evaluate the capabilities of generative AI tools. We applied this framework…

In November 2022, ChatGPT, an Artificial Intelligence (AI) large language model (LLM) capable of generating human-like responses, was launched. ChatGPT has a variety of promising applications in education, such as using it as thought-partner in generating curricular resources. However, scholars also recognize that the use of ChatGPT raises…

Natural language processing (NLP) has captivated the attention of educational researchers over the past three decades. In this study, a total of 2,480 studies were retrieved through a comprehensive literature search. We used neural topic modeling and pre-trained language modeling to explore the research topics pertaining to the application of NLP…

We tested the frequent assumption that the difficulty of word retrieval increases when a speaker is being observed and evaluated. We modified the Trier Social Stress Test (TSST) so that participants believed that its evaluative observation components continued throughout the duration of a subsequent word retrieval task, and measured participants'…

This study examined the linguistic dimensions of comprehensibility and perceived fluency in the context of L2 argumentative speech elicited from 40 Japanese-speaking learners of English. Their speaking performance was judged by 10 inexperienced native speakers of English for comprehensibility and perceived fluency, and was also objectively…

Three experiments examine whether a naturalistic reading task can induce long-lasting changes of syntactic patterns in memory. Judgment of grammatical acceptability is used as an indirect test of memory for sentences that are identical or only syntactically similar to those read earlier. In previous research (Luka & Barsalou, 2005) both sorts of…

People differ in the size of their social network, and thus in the properties of the linguistic input they receive. This article examines whether differences in social network size influence individuals' linguistic skills in their native language, focusing on global comprehension of evaluative language. Study 1 exploits the natural variation in…

This study investigated the effect of repeated evaluation and repeated exposure on grammatical acceptability ratings for both acceptable and unacceptable sentence types. In Experiment 1, subjects in the Experimental group rated multiple examples of two ungrammatical sentence types (ungrammatical binding and double object with dative-only verb),…

Purpose: This article outlines the author's conceptualization of the key mechanisms that are engaged in the processing of spoken language, referred to as the spoken language processing model. The act of processing what is heard is very complex and involves the successful intertwining of auditory, cognitive, and language mechanisms. Spoken language…

The way words are used in natural language can influence how the same words are understood by students in formal educational contexts. Here we argue that this so-called semantic contamination effect plays a role in determining how students engage with mathematical proof, a fundamental aspect of learning mathematics. Analyses of responses to…