Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

Conversational agents have been widely used in education to support student learning. There have been recent attempts to design and use conversational agents to conduct assessments (i.e., conversation-based assessments: CBA). In this study, we developed CBA with constructed and selected-response tests using Rasa--an artificial intelligence-based…

The research on language acquisition and retention has primarily focused on monolinguals and bilinguals, with comparatively few studies including trilinguals. To address this gap, the current study compares the acquisition and retention of a novel morphosyntactic rule in Spanish in twelve monolinguals, twelve bilinguals, and twelve trilinguals.…

This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on…

Purpose: Researchers discovered that when students were given the opportunity to change their answers, a majority changed their responses from incorrect to correct, and this change often increased the overall test results. What prompts students to modify their answers? This study aims to examine the modification of scientific reasoning test, with…

This paper reports our work on replacing lab report grading by post-online lab quizzes using Desire2Learn (D2L, an online course management software), specifically, how we circumvent some of the limitations imposed by D2L and the outcomes.

Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school…

In the traditional conception of working memory for word lists, phonological codes are used primarily, and semantic codes are often discarded or ignored. Yet, other evidence indicates an important role for semantic codes. We carried out a preplanned set of four experiments to determine whether phonological and semantic codes are used similarly or…

The advent of artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT and Gemini, has significantly impacted the educational landscape, offering unique opportunities for learning and assessment. In the realm of written assessment grading, traditionally viewed as a laborious and subjective process, this study sought to…

Event concepts of common verbs (e.g. "eat," "sleep") can be broadly shared across languages, but a given language's rules for subcategorization are largely arbitrary and vary substantially across languages. When subcategorization information does not match between first language (L1) and second language (L2), how does this…

This study sought to identify the challenges and needs of TOEFL iBT candidates in achieving C1 level scores in the speaking and writing sections of the exam. To this end, the researcher employed a mixed-method approach to collect data from a population of 46 students, both male and female, between the ages of 22 and 30. The participants were…

The same-different task is a classic paradigm that requires participants to judge whether two successively presented stimuli are the same or different. While this task is simple, with results that have been replicated many times, response times (RTs) and accuracy for both same and different decisions remain difficult to model. The biggest obstacle…

The aim of this experiment was to determine if dyad practice helped individuals become aware, use, and retain information in a dynamically changing perceptual-motor task compared with practice alone. We used a computerized perceptual-motor task, where individuals were required to intercept balls that dropped from the top of the screen. A colored…

This study reports syllable position effects on second language (L2) Portuguese speech perception, revealing that L2 segmental learning may be prone to an influence from the suprasegmental level. The results show that first language (L1) Mandarin learners had diminished performance on the discrimination between the target Portuguese liquids (/l/…

Category learning is fundamental to cognition, but little is known about how it proceeds in real-world environments when learners do not have instructions to search for category-relevant information, do not make overt category decisions, and do not experience direct feedback. Prior research demonstrates that listeners can acquire task-irrelevant…