A log-linear model (LLM) is a well-known statistical method to examine the relationship among categorical variables. This study investigated the performance of LLM in detecting differential item functioning (DIF) for polytomously scored items via simulations where various sample sizes, ability mean differences (impact), and DIF types were…

The bookmark standard-setting procedure is an item response theory-based method that is widely implemented in state testing programs. This study estimates standard errors for cut scores resulting from bookmark standard settings under a generalizability theory model and investigates the effects of different universes of generalization and error…

In this study, the authors develop a generalized multilevel facets model, which is not only a multilevel and two-parameter generalization of the facets model, but also a multilevel and facet generalization of the generalized partial credit model. Because the new model is formulated within a framework of nonlinear mixed models, no efforts are…

Conducted a reliability generalization study of Kolb's Learning Style Inventory (LSI; D. Kolb, 1976). Results for 34 studies indicate that internal consistency and test-retest reliabilities for LSI scores fluctuate considerably and contribute to deleterious cumulative measurement error. (SLD)

Submitted the Mathematics Anxiety Rating Scale (MARS) (F. Richardson and R. Suinn, 1972) to a reliability generalization analysis to characterize the variability of measurement error in MARS scores across administrations and identify characteristics predictive of score reliability variations. Results for 67 analyses generally support the internal…

Studied sources of measurement error variance in the Teacher Efficacy Scale (TES) (Gibson and Dembo, 1984). Used reliability generalization to characterize the typical score reliability for the TES and potential sources of measurement error variance across 43 studies. Also examined related instruments for measurement integrity. (SLD)

Proposes a new method, reliability generalization, for meta-analysis. Reliability generalization characterizes the typical reliability of scores for a test across studies, the amount of variability in reliability coefficients, and the sources of this variability. Analysis of 87 reliability coefficients for two scales of the Bem Sex Role Inventory…

Submitted the Myers-Briggs Type Indicator (MBTI) to a descriptive reliability generalization analysis to characterize the variability of measurement error in MBTI scores across administrations. In general the MBTI and its scales yielded scores with strong internal consistency and test-retest reliability estimates. (SLD)

Performed a meta-analysis of reliability estimates for Beck Depression Inventory (BDI) (A. Beck and others, 1961) scores across studies. Only 7.5% of studies reviewed (n=1,200) reported meaningful reliability estimates. Analysis results suggest that standard errors of measurement should be considered in addition to reliability estimates when…