Reliabilities of the two most widely used intraindividual variability indicators, "ISD[superscript 2]" and "ISD", are derived analytically. Both are functions of the sizes of the first and second moments of true intraindividual variability, the size of the measurement error variance, and the number of assessments within a burst. For comparison,…

Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…

Mediation analysis uses measures of hypothesized mediating variables to test theory for how a treatment achieves effects on outcomes and to improve subsequent treatments by identifying the most efficient treatment components. Most current mediation analysis methods rely on untested distributional and functional form assumptions for valid…

In this article we propose several modeling choices to extend propensity score analysis to clustered data. We describe different possible model specifications for estimation of the propensity score: single-level model, fixed effects model, and two random effects models. We also consider both conditioning within clusters and conditioning across…

This article proposes a model-based multiple-group procedure for assessing the impact of faking on personality measures and the scores derived from these measures. The assessment is at the item level and the base model, which is intended for binary items, can be parameterized both as an Item Response Theory (IRT) model and as an Item…

The comparative format used in ranking and paired comparisons tasks can significantly reduce the impact of uniform response biases typically associated with rating scales. Thurstone's (1927, 1931) model provides a powerful framework for modeling comparative data such as paired comparisons and rankings. Although Thurstonian models are generally…

Evaluated multilevel models of growth and change in relation to regression toward the mean artifacts (RTMAs), using simulated data to represent students nested within schools for which there were initial school differences due to selection based on pretest achievement scores. Results demonstrate that multilevel growth models provide no protection…

Proposes an extension of the propensity score adjustment method to the analysis of group differences on latent variable models. Uses multiple indicators-multiple causes (MIMIC) structural equation modeling to test hypotheses about treatment group differences. Discusses the role of factorial invariance as it relates to this approach. (SLD)

This article first discusses a statistical test for investigating whether or not the pattern of missing scores in a respondent-by-item data matrix is random. Since this is an asymptotic test, we investigate whether it is useful in small but realistic sample sizes. Then, we discuss two known simple imputation methods, person mean (PM) and two-way…

Presents a validation procedure for cognitive structures that is based on structural equation modeling of cognitive subordination relationships among test items. Illustrates the method using scores of 278 ninth graders on an algebra test and shows results for the same test when the linear logistic test model is used. (SLD)

Effects of overextracting factors and components within and between maximum likelihood factor analysis and principal components analysis were examined through computer simulation of a range of factor and component patterns. Results demonstrate similarity of component and factor scores during overextraction. Overall, results indicate that…

Adaptive forms of weighted structural regression are developed and discussed. Bootstrapping studies indicate that the new methods have potential to recover known population regression weights and predict criterion score values routinely better than do ordinary least squares methods. The new methods are scale free and simple to compute. (SLD)

The relation between the power of a significance test in a block design with correlated measurements and the reliability of the measuring instrument is analyzed in terms of the components of variance entering the reliability coefficient and the noncentrality parameter. (Author/LMO)

Principal component, image component, three types of factor score estimates, and one scale score method were compared over different levels of variables, saturations, sample sizes, variable to component ratios, and pattern rotations. There were virtually no overall differences among methods, with the average correlation between matched scores…

The purpose of the current study was to investigate the relative performance of the parametric, rank, and normal scores procedures when the classical assumptions were met and under violations of these assumptions. This investigation included the normal scores as well as the rank test. (LMO)