This article introduces a bootstrap generalization to the Modified Parallel Analysis (MPA) method of test dimensionality assessment using factor analysis. This methodology, based on the use of Marginal Maximum Likelihood nonlinear factor analysis, provides for the calculation of a test statistic based on a parametric bootstrap using the MPA…

A Markov chain Monte Carlo (MCMC) method and a bootstrap method were compared in the estimation of standard errors of item response theory (IRT) true score equating. Three test form relationships were examined: parallel, tau-equivalent, and congeneric. Data were simulated based on Reading Comprehension and Vocabulary tests of the Iowa Tests of…

Despite numerous empirical studies, there is surprisingly little agreement about whether the Social Security earnings test affects male labor supply. In this paper, we provide a comprehensive analysis of the labor supply effects of the earnings test using longitudinal administrative earnings data and more commonly used survey data. We find that…

Although experiments are viewed as the gold standard for evaluation, some of their benefits may be lost when, as is common, outcomes are not defined for some sample members. In evaluations of marriage interventions, for example, a key outcome--relationship quality--is undefined when a couple splits up. This article shows how treatment-control…

This report provides national data on the availability and use of educational technology in public elementary and secondary schools during fall 2008. The data are the results of a national school-level survey that is one of a set that includes district, school, and teacher surveys on educational technology. Every year between 1994 and 2005 (with…

We investigated language variation and score variation in the testing of English language learners, native Spanish speakers. We gave students the same set of National Assessment of Educational Progress mathematics items in both their first language and their second language. We examined the amount of score variation due to the main and interaction…

An equation comparable to Spearman's correction for attenuation, which does not depend upon the assumption that error scores are uncorrelated with true scores and with other sets of scores, is derived. (Editor)

A new formula, expressing relative efficiency solely in terms of the standard errors of measurement and the frequency of distributions of true scores, is developed for the relative efficiency of two tests measuring the same trait. Subtests from the Scholastic Aptitude Test provide a numerical illustration. (Author/RC)

In analyzing exploratory repeated measures data with more than two measures, two competing tests must be administered simultaneously if one is to make an efficient and effective decision regarding the tenability of the null hypothesis of no differences among measurement means. Obviously, such a procedure is not without a cost vis-a-vis Type I…

This Digest presents a discussion of the assumptions of multiple regression that is tailored to the practicing researcher. The focus is on the assumptions of multiple regression that are not robust to violation, and that researchers can deal with if violated. Assumptions of normality, linearity, reliability of measurement, and homoscedasticity are…

The relationship between generalizability and validity is explained, making four important points. The first is that generalizability coefficients provide upper bounds on validity. The second point is that generalization is one step in most interpretive arguments, and therefore, generalizability is a necessary condition for the validity of these…

Asymptotic distribution theory of Brogden's form of biserial correlation coefficient is derived and large sample estimates of its standard error obtained. Its relative efficiency to the biserial correlation coefficient is examined. Recommendations for choice of estimator of biserial correlation are presented. (Author/JKS)

Corrections for restriction in range due to explicit selection assume linearity of regression and homoscedastic array variances. A Monte Carlo study was conducted to examine the effects of some common forms of violation of these assumptions. (Author/CP)