Item difficulty and dimensionality often correlate, implying that unidimensional IRT approximations to multidimensional data (i.e., reference composites) can take a curvilinear form in the multidimensional space. Although this issue has been previously discussed in the context of vertical scaling applications, we illustrate how such a phenomenon…

Background/purpose: This study aimed to reveal the accuracy of estimation of multiple-choice test items parameters following the models of the item-response theory in measurement. Materials/methods: The researchers depended on the measurement accuracy indicators, which express the absolute difference between the estimated and actual values of the…

Research methods with roots in complexity science are increasingly popular in social research. However, they are not widespread and have potential to deliver value more fully and consistently to social research and methodology. One reason for this is that methods are often used alone, or only with traditional social research methods. We attempt to…

The focus of this paper is on the empirical relationship between item difficulty and item discrimination. Two studies--an empirical investigation and a simulation study--were conducted to examine the association between item difficulty and item discrimination under classical test theory and item response theory (IRT), and the effects of the…

In selected-response assessments such as attitude surveys with Likert-type rating scales, examinees often select from rating scale categories to reflect their locations on a construct. Researchers have observed that some examinees exhibit "response styles," which are systematic patterns of responses in which examinees are more likely to…

Game-based learning has proven to be an effective teaching method in a variety of fields, including supply chain management (SCM). This paper discusses the use of simulation-based business games for training and education in SCM by evaluating the complexity of SCM games. The main contributions of this study are twofold. (1) Creation of a database…

This qualitative descriptive study investigated the experiences and professional outcomes of novice registered nurses participating in professional development nursing simulations integrating worked examples, a cognitive load instructional design principle. Drawing upon cognitive load theory and the worked examples principle, the study addressed…

The overall aim was to examine effects of differences in group ability and features of the anchor test form on equating bias and the standard error of equating (SEE) using both real and simulated data. Chained kernel equating, Postratification kernel equating, and Circle-arc equating were studied. A college admissions test with four different…

The purposes of this study were (1) to introduce a virtual dental lab designed to support students' virtual clinical examinations in a dentistry program in South Korea and (2) to determine how dental students' levels of expertise (low, medium, or high) influence their clinical performance in terms of dwell time on each tooth location, total…

Background: Research in social cognition suggests that learning effectiveness in teacher-learner pairs may be influenced by how well their attention aligns with each other. However, we currently have limited understanding of how common distractions in real-world environments affect teacher-student interactions, specifically the synchronisation of…

A key consideration when giving any computerized adaptive test (CAT) is how much adaptation is present when the test is used in practice. This study introduces a new framework to measure the amount of adaptation of Rasch-based CATs based on looking at the differences between the selected item locations (Rasch item difficulty parameters) of the…

A conceptualization of multiple-choice exams in terms of signal detection theory (SDT) leads to simple measures of item difficulty and item discrimination that are closely related to, but also distinct from, those used in classical item analysis (CIA). The theory defines a "true split," depending on whether or not examinees know an item,…

The Rasch model is commonly used to calibrate multiple choice items. However, the sample sizes needed to estimate the Rasch model can be difficult to attain (e.g., consider a small testing company trying to pretest new items). With small sample sizes, auxiliary information besides the item responses may improve estimation of the item parameters.…

Human operators often experience large fluctuations in cognitive workload over seconds timescales that can lead to sub-optimal performance, ranging from overload to neglect. Adaptive automation could potentially address this issue, but to do so it needs to be aware of real-time changes in operators' spare cognitive capacity, so it can provide help…

Purpose: Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in…