This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of…

Textbook anatomy depiction of the hepatobiliary tree is present in 55%-62% of the population. Misidentification of hepatobiliary variants can lead to bile duct injuries in cholecystectomies. A better understanding of variants has been cited as a key area for improvement in anatomy education. The aim of this study was to compare the effectiveness…

Despite continued efforts to address this issue, many students still exhibit misunderstandings regarding Newton's laws. These misconceptions include beliefs, such as every movement requires a force, that force is directly proportional to velocity, and that action-reaction forces can differ in magnitude. To mitigate these misunderstandings,…

Providing diagnostic feedback about growth is crucial to formative decisions such as targeted remedial instructions or interventions. This article proposed a longitudinal higher-order diagnostic classification modeling approach for measuring growth. The new modeling approach is able to provide quantitative values of overall and individual growth…

Science education is crucial for fostering knowledge across academic disciplines. Past efforts to enhance science achievement at the elementary level have explored various instructional strategies. Among these, the Understanding by Design (UbD) model has shown notable potential in improving science achievement outcomes compared to traditional…

Multiple choice questions are traditionally expensive to produce. Recent advances in large language models (LLMs) have led to fine-tuned LLMs that generate questions competitive with human-authored questions. However, the relative capabilities of ChatGPT-family models have not yet been established for this task. We present a carefully-controlled…

The "drawing-to-learn" pedagogical approach has gained considerable attention and evidence supporting its efficacy for facilitating learning. However, little theoretical or empirical research has addressed issues regarding collaborative drawing-to-learn. In this study, we developed collaborative drawing-to-learn activities and three…

This study aimed to examine authentic models of science assessment in assessing the competence of senior high school students who met the criteria of validity, practicality, and effectiveness. The methodology applied was an evaluation and developmental research. Research was conducted in senior high school in accordance with the needs of the…

A psychological framework for different types of items commonly used with mixed-format exams is proposed. A choice model based on signal detection theory (SDT) is used for multiple-choice (MC) items, whereas an item response theory (IRT) model is used for open-ended (OE) items. The SDT and IRT models are shown to share a common conceptualization…

Learning about the Earth through geoscience education is important in order to make informed decisions about the future of the Earth. The aim of this study is to examine students' conceptual development on geoscience subjects based on inquiry-based learning. 7th grade students participated in this study. The researcher prepared lesson plans and…

The Next Generation Science Standards (NGSS) delineate three interrelated dimensions that describe what students should know and how they should engage in science learning. These present significant challenges for assessment because traditional assessments may not be able to capture the ways in which students engage with content. Science…

Background: Formative assessments are needed to enable monitoring how student knowledge develops throughout a unit. Constructed response items which require learners to formulate their own free-text responses are well suited for testing their active knowledge. However, assessing such constructed responses in an automated fashion is a complex task…

This work is the fourth of a series of papers applying multidimensional item response theory (MIRT) to widely used physics conceptual assessments. This study applies MIRT analysis using both exploratory and confirmatory methods to the Brief Electricity and Magnetism Assessment (BEMA) to explore the assessment's structure and to determine a…

In this article, we extend Liao's test for across-group comparisons of the fixed effects from the generalized linear model to the fixed and random effects of the generalized linear mixed model (GLMM). Using as our basis the Wald statistic, we developed an asymptotic test statistic for across-group comparisons of these effects. The test can be…

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…