The report is the first systematic evaluation of the sentence equivalence item type introduced by the "GRE"® revised General Test. We adopt a validity framework to guide our investigation based on Kane's approach to validation whereby a hierarchy of inferences that should be documented to support score meaning and interpretation is…

In this research, we investigated the feasibility of implementing the "e-rater"® scoring engine as a check score in place of all-human scoring for the "Graduate Record Examinations"® ("GRE"®) revised General Test (rGRE) Analytical Writing measure. This report provides the scientific basis for the use of e-rater as a…

Empirical Bayes (EB) methods are frequently used on hierarchical linear models in practice. This paper provides an overview of parametric EB methods with special emphasis on their application in data-analytic settings. Eight different models with different levels of complexity are described. Comparisons of performance with other methods are…

Operational procedures for the Graduate Record Examinations Validity Study Service are reviewed, with emphasis on the problem of frequent occurrence of negative coefficients in the fitted within-department regressions obtained by the empirical Bayes method of H. I. Braun and D. Jones (1985). Several alterations of the operational procedures are…

This paper synthesizes ideas from the fields of graphical modeling and education testing, particularly item response theory (IRT) applied to computerized adaptive testing (CAT). Graphical modeling can offer IRT a language for describing multifaceted skills and knowledge, and disentangling evidence from complex performances. IRT-CAT can offer…

Convergent validity of expert-systems scores for 4 complex constructed-response mathematical formats was assessed for 249 examinees from the Graduate Record Examinations (GRE) General Test in June 1989. The hypothesized five-factor model fit the data well, but an alternative with two dimensions (GRE-quantitative and constructed-response)…

We describe the item modeling development and evaluation process as applied to a quantitative assessment with high-stakes outcomes. In addition to expediting the item-creation process, a model-based approach may reduce pretesting costs, if the difficulty and discrimination of model-generated items may be predicted to a predefined level of…

The Graduate Record Examinations (GRE) Cooperative Validity Studies Project began in 1975 to fill the need for cooperation between graduate schools and testing agencies and for graduate level validity studies. More than 150 data sets from the 39 participating schools, representing over 19 fields of study, were analyzed. The data confirmed earlier…