Unit-weight sum scores (UWSSs) are routinely used as estimates of factor scores on the basis of solutions obtained with the nonlinear exploratory factor analysis (EFA) model for ordered-categorical responses. Theoretically, this practice results in a loss of information and accuracy, and is expected to lead to biased estimates. However, the…

It is necessary to supply proof regarding the construct validity of the scales. Especially, when new scales are developed the construct validity is researched by the Exploratory Factor Analysis (EFA). Generally, factor extraction is performed via the Principal Component Analysis (PCA) which is not exactly factor analysis and the Principal Axis…

The dimensionality is one of the most investigated concepts in the psychological assessment, and there are many ways to determine the dimensionality of a measured construct. The Automated Item Selection Procedure (AISP) and the DETECT are non-parametric methods aiming to determine the factorial structure of a data set. In the current study,…

The goal of this work is to enhance the robustness and efficiency of the multimodal human states recognition task. Human states recognition can be considered as a joint term for identifying/verifing various kinds of human related states, such as biometric identity, language spoken, age, gender, emotion, intoxication level, physical activity, vocal…

ETS has recently instituted the Cognitively Based Assessments of, for, and as Learning (CBAL) research initiative to create a new generation of assessment designed from the ground up to enhance learning. It is intended as a general approach, covering multiple subject areas including reading, writing, and math. This paper is concerned with the…

The e-rater[R] automated essay scoring system is used operationally in the scoring of TOEFL iBT[R] independent essays. Previous research has found support for a 3-factor structure of the e-rater features. This 3-factor structure has an attractive hierarchical linguistic interpretation with a word choice factor, a grammatical convention within a…

This paper proposes an alternative content measure for essay scoring, based on the "difference" in the relative frequency of a word in high-scored versus low-scored essays. The "differential word use" (DWU) measure is the average of these differences across all words in the essay. A positive value indicates the essay is using…

Enterprise Resource Planning (ERP) systems have had a significant impact on business organizations. These large systems offer opportunities for companies regarding the integration and functionality of information technology systems; in effect, companies can realize a competitive advantage that is necessary in today's global companies. However,…

This report evaluates the construct coverage of the e-rater[R[ scoring engine. The matter of construct coverage depends on whether one defines writing skill, in terms of process or product. Originally, the e-rater engine consisted of a large set of components with a proven ability to predict human holistic scores. By organizing these capabilities…

This report describes the development of grade norms for timed-writing performance in two modes of writing: persuasive and descriptive. These norms are based on objective and automatically computed measures of writing quality in grammar, usage, mechanics, style, vocabulary, organization, and development. These measures are also used in the…

TEACHERS' RATINGS ON SIX 7-POINT SEMANTIC DIFFERENTIAL SCALES (GOOD-BAD, WORTHLESS-VALUABLE, FAIR-UNFAIR, MEANINGLESS-MEANINGFUL, WISE-FOOLISH, DISREPUTABLE-REPUTABLE) WERE OBTAINED FOR THE FOLLOWING TERMS--AUTOMATED INSTRUCTION, SELF-INSTRUCTIONAL PROGRAM, TEACHING MACHINE, MECHANIZED TUTOR, PROGRAMED TEST, PROGRAMED INSTRUCTION, TUTOR TEXT, WORK…

Experiments were performed to determine the feasibility of using ALCAPP as one form of on-line dialogue. Assuming the ALCAPP (Automatic List Classification and Profile Production) system is in an on-line mode, investigations of those parameters which could affect its stability and reliability were conducted. Fifty-two full test documents were used…