Three methods based on the nonparametric item response theory (IRT) of R. J. Mokken for the estimation of the reliability of single dichotomous test items are discussed. Analytical and Monte Carlo studies show that one method, designated "MS," is superior because of smaller bias and smaller sampling variance. (SLD)

It is well-known that for normally distributed errors parametric tests are optimal statistically, but perhaps less well-known is that when normality does not hold, nonparametric tests frequently possess greater statistical power than parametric tests, while controlling Type I error rate. However, the use of nonparametric procedures has been…

To examine the predictive utility of three scales provided in the released database of the Third International Mathematics and Science Study (TIMSS) (international plausible values, standardized percent correct score, and national Rasch score), information was obtained on the performance in state examinations in mathematics and science in 1996…

Exact nonparametric procedures have been used to identify the level of differential item functioning (DIF) in binary items. This study explored the use of exact DIF procedures with items scored on a Likert scale. The results from an attitude survey suggest that the large-sample Cochran-Mantel-Haenszel (CMH) procedure identifies more items as…

The development of the DETECT procedure marked an important advancement in nonparametric dimensionality analysis. DETECT is the first nonparametric technique to estimate the number of dimensions in a data set, estimate an effect size for multidimensionality, and identify which dimension is predominantly measured by each item. The efficacy of…

The Type I error and power properties of the 2x2x2 analysis of variance (ANOVA) and tests developed by McSweeney (1967), Bradley (1979), Harwell-Serlin (1989; Harwell, 1991), and Blair-Sawilowsky (1990) were compared using Monte Carlo methods. The ANOVA was superior under the Gaussian and uniform distributions. The Blair-Sawilowsky test was…

This paper presents a conceptualization of test bias for standardized ability tests which is based on multidimensional, non-parametric, item response theory. An explanation of how individually-biased items can combine through a test score to produce test bias is provided. It is contended that bias, although expressed at the item level, should be…

This is the second half of the course described in SE 013 166. The chapter headings are: (10) Sample surveys; (11) Analysis of variance; (12) Use of analysis of variance for adjustment of data; (13) Exploratory data analysis; (14) Plotting and computing; (15) Logit regression for binary data; (16) Transformations and distribution-free inference;…

This text is designed for undergraduate courses in statistics or tests and measurements in physical education. It covers basic statistical concepts such as frequency distributions; graphs and curves; percentiles; measure of central tendency and variability; correlations; t tests; special applications of t tests for unequal, small, or correlated…

An analysis of self-report delinquency data using four non-metric procedures for structural analysis revealed support for the existence of a general delinquency factor. However, offenses of low seriousness and victimless offenses (drinking and drug-taking items) were only weakly related to this general factor. (Author/CTM)

The purpose of the current study was to investigate the relative performance of the parametric, rank, and normal scores procedures when the classical assumptions were met and under violations of these assumptions. This investigation included the normal scores as well as the rank test. (LMO)

The paper discusses the consequences for maximum likelihood factor analysis which may follow if the observed variables are ordinal with only a few scale steps. Results indicate that classification may lead to a substantial lack of fit of the model--an erroneous indication that more factors are needed. (Author/CTM)

Several existing group-based statistics to detect improbable item score patterns are discussed, along with the cut scores proposed in the literature to classify an item score pattern as aberrant. A simulation study and an empirical study are used to compare the statistics and their use and to investigate the practical use of cut scores. (SLD)

Chernyshenko, Stark, Chan, Drasgow, and Williams (2001) investigated the fit of Samejima's logistic graded model and Levine's non-parametric MFS model to the scales of two personality questionnaires and found that the graded model did not fit well. We attribute the poor fit of the graded model to small amounts of multidimensionality present in…

Differential item functioning (DIF) is an important consideration in assessing the validity of test scores (Camilli & Shepard, 1994). A variety of statistical procedures have been developed to assess DIF in tests of dichotomous (Hills, 1989; Millsap & Everson, 1993) and polytomous (Penfield & Lam, 2000; Potenza & Dorans, 1995) items. Some of these…