This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is…

The severity of bias in respondents' self-reports due to acquiescence response style (ARS) and extreme response style (ERS) depends strongly on how consistent these response styles are over the course of a questionnaire. In the literature, different alternative hypotheses on response style (in)consistency circulate. Therefore, nine alternative…

This article extends the work by Armstrong and Shi on CUmulative SUM (CUSUM) person-fit methodology. The authors present new theoretical considerations concerning the use of CUSUM person-fit statistics based on likelihood ratios for the purpose of detecting cheating and random guessing by individual test takers. According to the Neyman-Pearson…

Many latent traits in the human sciences have a hierarchical structure. This study aimed to develop a new class of higher order item response theory models for hierarchical latent traits that are flexible in accommodating both dichotomous and polytomous items, to estimate both item and person parameters jointly, to allow users to specify…

To rule out the need for a two-parameter item response theory (IRT) model during item analysis by Rasch models, it is important to check the Rasch model's assumption that all items have the same item discrimination. Biserial and polyserial correlation coefficients measuring the association between items and restscores are often used in an informal…

The article proposes a family of item-response models that allow the separate and independent specification of three orthogonal components: item attribute, person covariate, and local item dependence. Special interest lies in extending the linear logistic test model, which is commonly used to measure item attributes, to tests with embedded item…

Mixture item response theory (IRT) models aid the interpretation of response behavior on personality tests and may provide possibilities for improving prediction. Heterogeneity in the population is modeled by identifying homogeneous subgroups that conform to different measurement models. In this study, mixture IRT models were applied to the…

In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible…

An ability-based guessing model is formulated and applied to several data sets regarding educational tests in language and in mathematics. The formulation of the model is such that the probability of a correct guess does not only depend on the item but also on the ability of the individual, weighted with a general discrimination parameter. By so…

Two observed-score methods that assume equally reliable congeneric tests were compared for the external anchor test equating model. Each derivation was compared to existing test equating methods based on different assumptions. Using samples of Australian secondary school students (N=about 6,000), the methods were compared empirically with existing…

Developed an item response theory model of response stability based on the local independence principle. Tested the model, which predicts response changes under repeated administrations of the same instrument, with real data for 432 Spanish undergraduates. Results indicate that the model predictions are approximately fulfilled. (SLD)

Used the multicomponent latent trait model (MTLM) (S. Embretson, 1980, 1984) for 3 different synonym tasks completed by 212 and 257 Belgian secondary school students. Developed a heuristic evaluation procedure that tested features of the model and provided an explanation for why the MTLM did not fit the data. (SLD)

Examined the performance of three item-response models applied to data collected from a conventionally developed Likert-type personality scale administered to 657 Spanish undergraduates. Models' response assumptions were reasonably tenable, and the solutions obtained for the continuous, censored, and graded-response models were similar. (SLD)

The effect of test length on predictive validity is examined empirically. For four tests, the curve of validity against test length had a very gentle slope for the longer tests and all tests could be reduced by more than 60 percent without appreciable decreases in validity. (Author/BW)

Equating error was estimated using the same test with three linear equating methods in three paradigms--single-link equating; circular equating through a chain; and pseudo-circular equating, in which a test is equated to itself through equating chains. Over 31,000 Psychometric Entrance Test scores of college applicants in Israel were analyzed.…