Because there is no commonly accepted view of what makes for good writing, automated essay scoring (AES) ideally should be able to accommodate different theoretical positions, certainly at the level of state standards but also perhaps among teachers at the classroom level. This paper presents a practical approach and an interactive computer…

A databased approach to vocational course assessment enables users to rank the quality of vocational education courses. Courses ranked highest may be commended. Courses ranked lowest may be considered in need of improvement efforts. The Databased Course Assessment Method (DCAM) was developed in the public domain and customized to the needs of the…

A new approach to polychotomous scoring of test items, similar to "max-alpha" scaling (MAS) and known as polyweighting, has been developed. Unlike MAS, this new method of polychotomous scoring provides scoring weights for a given item that are independent of the difficulty of other items in the analysis. Moreover, the scoring weights are…

In January 1982, the College Board and Educational Testing Service implemented a technical change in the procedures used to equate scores on the Scholastic Aptitude Test (SAT). For previous editions of the SAT, a linear equating procedure was used to establish the comparability of scores on different editions. Beginning in January 1982, this…

The aims of this study were: (1) to review and discuss alternatives for evaluating members of a set of scores which may be interpreted independently as contributing to a composite score, or as a member of a profile and (2) to examine multivariate generalizability theory, as suggested by Joe and Woodward, applied to student course/instructor…

Three principal uses of composite variables in the Title I Evaluation and Reporting System (TIERS) are examined in light of four basic methodological issues: (1) the criterion used in constructing the composite; (2) the likely reliability of both component and criterion variables; (3) the form of the relationship between components and criterion;…

Various practices of grading, and some of their advantages and disadvantages are discussed. The first chapter presents the purposes and meaning of letter grades, and offers some guidelines: letter grades should reflect academic achievement, rather than affective behavior or personality; they should be closely related to course objectives and…

Several advantages to the use of factor scores as independent variables in a multiple regression equation were found. To help select the most desirable type of factor score on which to calculate a regression equation, computer-based Monte Carlo methods were used to compare the predictive accuracy upon replication of regression of five…

Background and attitude questionnaire items used in the Michigan Educational Assessment battery to measure socioeconomic status and attitudes toward self, school, and the importance of school achievement are presented. A priori weights for item responses are provided. (For related document, see TM 002 329.) (KM)

Compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. Scoring methods compared were: formula scoring, a priori scoring, empirical scoring with an internal criterion, and two modifications of formula scoring. The empirically determined scoring system is seen as superior. (RC)

A validity scale for the Sharp Consumer Satisfaction Scale was developed and used in experiments to assess patients' satisfaction with community mental health centers. The scale discriminated between clients who offered suggestions and those who did not. It also improved researcher's ability to predict true scores from obtained scores. (DWH)

The present study suggests that although the reliability of an academic aptitude test given under formula-score condition can be increased substantially through empirical option weighting, much of the increase is due to the capitalization of the keying procedure on omitting tendencies which are reliable but not valid. (Author)

Findings show that the reliability of GPA depends on three factors: the number of course grades, the average reliability of these grades, and the credit-hour weights. (Authors)

This paper develops a multiplicative model as a means of combining ratings of criticality and frequency of various activities involved in job analyses. The model incorporates adjustments to ensure that effective weights of criticality and frequency are appropriate. An example of the model's use is presented. (TJH)