Effective educational measurement relies heavily on the curation of well-designed item pools. However, item calibration is time consuming and costly, requiring a sufficient number of respondents to estimate the psychometric properties of items. In this study, we explore the potential of six different large language models (LLMs; GPT-3.5, GPT-4,…

Freely accessible generative artificial intelligence (GenAI) poses challenges to physiology education regarding learning and academic integrity. Although many studies have explored the capabilities of GenAI to complete assessments, few have implemented educative activities to highlight GenAI risks and benefits or explored physiology students'…

Previous research used the learning hierarchy (LH) as a heuristic to select reading interventions based on the level of accuracy defined as the percentage of words read correctly. The current study examined the validity of the LH by reporting the prevalence of reading profiles proposed by the framework: Acquisition phase--inaccurate and slow,…

The majority of research in computational psycholinguistics on sentence processing has focused on word-by-word incremental processing within sentences, rather than holistic sentence-level representations. This study introduces two novel computational approaches for quantifying sentence-level processing: sentence surprisal and sentence relevance.…

Foreign language (L2) learners' speaking proficiency is often quantified using two dimensions: intuitive human ratings and analytical, linguistic complexity, accuracy, and fluency (CAF) indices. While previous research and assessment practices have predominantly focused on either the subjective approach to L2 speaking or the objective one, it is…

Background and Context: Feedback on one's progress is essential to new programming language learners, particularly in out-of-classroom settings. Though many study materials offer assessment mechanisms, most do not examine the accuracy of the feedback they deliver, nor give evidence on its validity. Objective: We investigate the potential use of a…

Despite the availability and potential usefulness of demographic and contextual data in many quantitative studies within engineering education, the preference for ANOVA over regression models remains prevalent, often without clear justification. A mapping review of literature from the EJEE and JEE spanning 2012-2022 identified 98 studies using…

Prior research suggests most students do not glean valid cues from provided visuals, resulting in reduced metacomprehension accuracy. Across 4 experiments, we explored how the presence of instructional visuals affects students' metacomprehension accuracy and cue-use for different types of metacognitive judgments. Undergraduates read texts on…

Learning style recognition is an indispensable part of achieving personalized learning in online learning systems. The traditional inventory method for learning style identification faces the limitations such as subject and static characteristics. Therefore, an automatic and reliable learning style recognition mechanism is designed in this…

This is a conceptual paper that explores critiquing picturebooks set in Africa. The paper is grounded in BlackCrit (Black Critical Theory) and Racial and Ethnic Socialization (RES). Using pragmatism as a method, we offer a detailed analysis of 3 carefully selected books, on the broad basis of authenticity, accuracy, and respectfulness. A deeper…

We develop a "latent variable forest" (LV Forest) algorithm for the estimation of latent variable scores with one or more latent variables. LV Forest estimates unbiased latent variable scores based on "confirmatory factor analysis" (CFA) models with ordinal and/or numerical response variables. Through parametric model…

This paper is a critical exposition on three major issues related to 'interpretive research conducted by researchers who claim they engaged in mixed methods' research. First, to provide context, we demonstrate that the term 'mixed' is inappropriate for the research practices usually adopted by its exponents. Secondly, we argue, expositions in…

In young adults and adolescents, dyslexia typically is characterized by slow or laborious reading. These reading difficulties are underpinned at least partly by a phonological deficit that disrupts cognitive connections between spoken and written language. Prosodic stress is a phonological property of spoken language reflecting differences in…

Identifying items with differential item functioning (DIF) in an assessment is a crucial step for achieving equitable measurement. One critical issue that has not been fully addressed with existing studies is how DIF items can be detected when data are multilevel. In the present study, we introduced a Lord's Wald X[superscript 2] test-based…

We examined how noun frequency and the typicality of surrounding linguistic context contribute to children's real-time comprehension. Monolingual English-learning toddlers viewed pairs of pictures while hearing sentences with typical or atypical sentence frames ("Look at the…" vs. "Examine the…"), followed by nouns that were…