A log-linear model (LLM) is a well-known statistical method to examine the relationship among categorical variables. This study investigated the performance of LLM in detecting differential item functioning (DIF) for polytomously scored items via simulations where various sample sizes, ability mean differences (impact), and DIF types were…

More robust and rigorous psychometric models, such as multidimensional Item Response Theory models, have been advocated for survey applications. However, item responses may be influenced by construct-irrelevant variance factors such as preferences for extreme response options. Through empirical and simulation methods, this study evaluates the use…

Reliability generalization studies were conducted on the motivation and learning strategies scales of the Motivated Strategies for Learning Questionnaire (MSLQ) to typify score reliabilities for all scales on the instrument and to examine potential sources of measurement error across studies which used these scales. Average reliability…

The assessment of positive affect (PA) and negative affect (NA) by means of the Positive Affect and Negative Affect Schedule has received a remarkable popularity in the social sciences. Using a meta-analytic tool--namely, reliability generalization (RG)--population reliability scores of both scales have been investigated on the basis of a random…

Person-fit methods are used to uncover atypical test performance as reflected in the pattern of scores on individual items in a test. Unlike parametric person-fit statistics, nonparametric person-fit statistics do not require fitting a parametric test theory model. This study investigates the effectiveness of generalizations of nonparametric…

Conducted a reliability generalization study of Kolb's Learning Style Inventory (LSI; D. Kolb, 1976). Results for 34 studies indicate that internal consistency and test-retest reliabilities for LSI scores fluctuate considerably and contribute to deleterious cumulative measurement error. (SLD)

Submitted the Mathematics Anxiety Rating Scale (MARS) (F. Richardson and R. Suinn, 1972) to a reliability generalization analysis to characterize the variability of measurement error in MARS scores across administrations and identify characteristics predictive of score reliability variations. Results for 67 analyses generally support the internal…

Studied sources of measurement error variance in the Teacher Efficacy Scale (TES) (Gibson and Dembo, 1984). Used reliability generalization to characterize the typical score reliability for the TES and potential sources of measurement error variance across 43 studies. Also examined related instruments for measurement integrity. (SLD)

Proposes a new method, reliability generalization, for meta-analysis. Reliability generalization characterizes the typical reliability of scores for a test across studies, the amount of variability in reliability coefficients, and the sources of this variability. Analysis of 87 reliability coefficients for two scales of the Bem Sex Role Inventory…

Submitted the Myers-Briggs Type Indicator (MBTI) to a descriptive reliability generalization analysis to characterize the variability of measurement error in MBTI scores across administrations. In general the MBTI and its scales yielded scores with strong internal consistency and test-retest reliability estimates. (SLD)

Performed a meta-analysis of reliability estimates for Beck Depression Inventory (BDI) (A. Beck and others, 1961) scores across studies. Only 7.5% of studies reviewed (n=1,200) reported meaningful reliability estimates. Analysis results suggest that standard errors of measurement should be considered in addition to reliability estimates when…

The diagnosis of developmental dyslexia (DD) is reliant on a discrepancy between intellectual functioning and reading achievement. Discrepancy-based formulae have frequently been employed to establish the significance of the difference between "intelligence" and "actual" reading achievement. These formulae, however, often fail to take into…