Testing programs have explored the use of technology-enhanced items alongside traditional item types (e.g., multiple-choice and constructed-response items) as measurement evidence of latent constructs modeled with item response theory (IRT). In this report, we discuss considerations in applying IRT models to a particular type of adaptive testlet…

Learning experience designers consistently balance the trade-off between open and close-ended activities. The growth and scalability of Computer Based Learning Platforms (CBLPs) have only magnified the importance of these design trade-offs. CBLPs often utilize close-ended activities (i.e. Multiple-Choice Questions [MCQs]) due to feasibility…

Mediation analysis plays an important role in understanding causal processes in social and behavioral sciences. While path analysis with composite scores was criticized to yield biased parameter estimates when variables contain measurement errors, recent literature has pointed out that the population values of parameters of latent-variable models…

Designing a multidimensional adaptive test (M-MST) based on a multidimensional item response theory (MIRT) model is critical to make full use of the advantages of both MST and MIRT in implementing multidimensional assessments. This study proposed two types of automated test assembly (ATA) algorithms and one set of routing rules that can facilitate…

Measurement errors attributable to cultural issues are complex and challenging for educational assessments. We need assessment tests sensitive to the cultural heterogeneity of populations, and psychometric methods appropriate to address fairness and equity concerns. Built on the research of culturally responsive assessment, this dissertation…

Administration and scoring of cognitive assessments have evolved from a paper-based platform to a digital format. Since this advancement, Pearson has created a system (Q-interactive) that allows examiners to administer the WISC-V via two iPads. However, limited research exists exploring the effects of this new method of administration when…

Purpose: This uses quantitative and qualitative methods in assessing performance and process outcomes in a team lecture hybrid (TLH) instructional design applied in a public affairs course. Design/methodology/approach: Within a non-experimental prospective design, individual and team outcomes were assessed as follows: survey of student perceptions…

Objective: ADHD and autism are complex and frequently co-occurring neurodevelopmental conditions with shared etiological and pathophysiological elements. In this paper, we attempt to differentiate these conditions among the young people in terms of intrinsic patterns of brain connectivity revealed during resting state using machine learning…

When developing a digital test, one of the first decisions that need to be made is which type of Computer-Based Test (CBT) to develop. Six different CBT types are considered here: linear tests, automatically generated tests, computerized adaptive tests, adaptive learning environments, educational simulations, and educational games. The selection…

"Simulation-based inference" is often considered a pedagogical strategy for helping students develop inferential reasoning, for example, giving them a visual and concrete reference for deciding whether the observed statistic is unlikely to happen by chance alone when the null hypothesis is true. In this article, we highlight for teachers…

Diagnostic tests are typically administered in a multiple-choice (MC) format due to their advantages of objectivity and time efficiency. The MC-deterministic input, noisy "and" gate (DINA) family of models, a representative class of cognitive diagnostic models for MC items, efficiently and parsimoniously estimates the mastery profiles of…

Spaced retrieval practice harnesses two well-studied phenomena: the spacing effect, where spacing out practice over several sessions leads to a gain in retention compared to massed practice in one session; and the testing effect, where material that is tested is better retained than material that is restudied. This meta-analysis investigates if,…

The arrival of ChatGPT and other artificial intelligence (AI) has caused considerable concern for educators worldwide, many of whom are still recovering from the impact of the COVID-19 pandemic. Although the debate continues around the use of AI in education, one approach to ensure students are achieving their learning objectives, the oral exam or…

High-stakes exams are often administered at designated test centers, requiring many students to test in unfamiliar environments. We investigate whether such arrangements impact students' test performance and, by extension, access to educational opportunities. Using unique administrative data from China's national college entrance examination…

It is important to determine the level of pedagogical content knowledge of teachers regarding skills. The aim of this study is to establish the theoretical framework of skill-specific pedagogical content knowledge and to develop a reliable and valid scale to measure teachers' entrepreneurship pedagogical content knowledge. The draft scale form was…