Predicting student performance in international large-scale assessments (ILSAs) is crucial for understanding educational outcomes on a global scale. ILSAs, such as the Program for International Student Assessment and the Trends in International Mathematics and Science Study, serve as vital tools for policymakers, educators, and researchers to…

Several studies compared three different types of questions (conceptual, algorithmic, and graphical) across various topics, however, few focused specifically on gifted students. This study addressed this gap. The aim of the study, hence, was to determine whether there were notable differences in gifted students' performance in the three types of…

Multiple choice questions are traditionally expensive to produce. Recent advances in large language models (LLMs) have led to fine-tuned LLMs that generate questions competitive with human-authored questions. However, the relative capabilities of ChatGPT-family models have not yet been established for this task. We present a carefully-controlled…

Multidimensional item response theory (MIRT) models have generated increasing interest in the psychometrics literature. Efficient approaches for estimating MIRT models with dichotomous responses have been developed, but constructing an equally efficient and robust algorithm for polytomous models has received limited attention. To address this gap,…

As we move further into the digital age, the acquisition of digital literacy (DL) and computational thinking (CT) skills is emerging internationally as an essential goal for students in contemporary school curricula. As the world becomes more uncertain and volatile due to impacts of artificial intelligence (AI), international unrest, climate…

A marginal maximum likelihood estimation algorithm is presented for the ordered partition model of M. Wilson that does not require the set of available responses to be fully ordered. The model and its estimation algorithm are illustrated in a comparison of alternative scoring schemes for open-ended science items. (SLD)

Analyzes differences in students' performance on algorithmic, lower-order cognitive skills (LOCS), and conceptual exam questions and the correlations between their achievements on these categories across different populations.Reports that the highest scores were obtained for the algorithmic questions, the lowest for the conceptual questions, and…

Several measurement theorists have convincingly argued that methods of writing test questions, particularly for criterion-referenced tests, should be based on operationally defined rules. This study was designed to examine and further refine a method for objectively generating multiple-choice questions for prose instructional materials. Important…