It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

Parallel analysis has been shown to be suitable for dimensionality assessment in factor analysis of continuous variables. There have also been attempts to demonstrate that it may be used to uncover the factorial structure of binary variables conforming to the unidimensional normal ogive model. This article provides both theoretical and empirical…

The impact of outliers on Cronbach's coefficient [alpha] has not been documented in the psychometric or statistical literature. This is an important gap because coefficient [alpha] is the most widely used measurement statistic in all of the social, educational, and health sciences. The impact of outliers on coefficient [alpha] is investigated for…

Coefficient alpha was examined through computer simulation as an estimate of test reliability under violation of two assumptions. Coefficient alpha underestimated reliability under violation of the assumption of essential tau-equivalence of subtest scores and overestimated it under violation of the assumption of uncorrelated subtest error scores.…

Whether it is possible to develop a classification function that identifies the underlying range restriction from sample information alone was investigated in a simulation. Results indicate that such a function is possible. The procedure was found to be relatively accurate, robust, and powerful. (SLD)

The effect that collapsing ordered polytomous variable scales has on structural equation measurement model parameter estimates was examined. Four parameter estimation procedures were investigated in a Monte Carlo study. Collapsing categories in ordered polytomous variables had little effect when latent projection procedures were used. (SLD)

The present study compares the robustness of two different one way fixed-effects analysis of covariance (ANCOVA) models to investigate whether the model which uses a test statistic incorporating estimates of separate unequal regression slopes is more robust than the conventional model which assumes the slopes are equal. (Author/BW)

Effects of violating the independence assumption when combining correlation coefficients in a meta-analysis were studied. This Monte-Carlo simulation varied sample size, predictor number, population intercorrelation among predictors, and population correlation between predictors and criterion. Combining statistics from nonindependent data in a…

Examined the performance of a recently available full information maximum likelihood (FIML) estimator in a multiple regression model with missing data using Monte Carlo simulation and considering the effects of four independent variables. Results indicate that FIML estimation was superior to that of three ad hoc techniques, with less bias and less…

Investigated the robustness of the group-level polytomous Item Response Theory model to violations of assumptions of school-level normality and within-school normality and constant variance with eight large simulated case samples. Discusses the precision obtained in estimating school ability. (SLD)

A polychotomous nominal response model-based computerized adaptive test (CAT) was simulated using data from 1,093 University of Texas students. The ability estimation of this model and its overall performance were compared with those of a dichotomous three-parameter logistic model-based CAT. Advantages and drawbacks of nominal response CAT are…

This study reports results of an investigation based on simulated data of the distributional properties of the item fit statistics that are commonly used in the Rasch model calibration programs as indices of the fit of responses to individual items to the measurement model. (SLD)

The effects of sample size, number of variables, and population value of the congruence coefficient on the sampling distribution of the congruence coefficient were examined. Sample data were generated on the basis of the common factor model, and principal axes factor analyses were performed. (Author/LMO)

Implications of ignoring correlated error on parameter estimates in some simple structural equation models are examined. It is shown analytically and empirically through simulation that ignoring positive between-construct correlated error overestimates the structural parameter linking the two constructs. Effects become more pronounced with…

Ignorance of the characteristics of a mixed population may lead to bias in a summary measure of a phenomenon. A test based on sample kurtosis is demonstrated by a simulation study to be more powerful than six other known tests in detecting a class of mixed normal distributions. (SLD)