Automated essay scoring (AES) generally computes essay scores as a function of macrofeatures derived from a set of microfeatures extracted from the text using natural language processing (NLP). In the "e-rater"® automated scoring engine, developed at "Educational Testing Service" (ETS) for the automated scoring of essays, each…

This paper compares two alternative scoring methods--multiple regression and classification trees--for an automated speech scoring system used in a practice environment. The two methods were evaluated on two criteria: construct representation and empirical performance in predicting human scores. The empirical performance of the two scoring models…

A review of cross-validation shrinkage formulas is presented which focuses on the theoretical and practical problems in the use of various formulas. Practical guidelines for use of both formulas and empirical cross-validation are provided. A comparison of results using these formulas in a range of situations is then presented. The result of these…

Several advantages to the use of factor scores as independent variables in a multiple regression equation were found. To help select the most desirable type of factor score on which to calculate a regression equation, computer-based Monte Carlo methods were used to compare the predictive accuracy upon replication of regression of five…

Computer-based Monte Carlo methods compared the predictive accuracy upon replication of regression of five complete and four incomplete factor score estimation methods. Prediction on incomplete factor scores showed better double cross-validated prediction accuracy than on complete scores. The unique unit-weighted factor score was superior among…

This paper illustrates the transformation of a raw data matrix into a matrix of associations, and then into a factor matrix. Factor analysis attempts to distill the most important relationships among a set of variables, thereby permitting some theoretical simplification. In this heuristic data, a correlation matrix was derived to display…

PRIME is a library of 44 batch-oriented computer routines: 20 major package programs, which use 12 statistical utility routines, and 12 other utility routines for input/output and data manipulation. This manual contains a general description of data preparation and coding, standard control cards, input deck arrangement, standard options, and…

To determine whether it is necessary for eight College Research Center (CRC) member colleges to use 16 distinct sets of weight in combining four admissions tests scores into predictive composities, a standard set of weights were developed and tested for effectiveness in predicting Freshman Average Grade (FAG). The basic sample in which weights…

The purpose of the present investigation was to develop a construct validity approach for testing whether the separation of positive and negative item subscales is substantively meaningful in self-concept research. Results from three published studies using the Self Description Questionnaire (SDQ) III were reanalyzed. The SDQ III measures 13…

The objective of this study was to show that standardized reading scores could be adequately estimated from scores on a criterion-referenced test in reading. This would reduce classroom test time, while, at the same time, provide the kinds of information teachers need to guide instruction, and the kinds of information administrators require for…