Formulas for transforming scores and statistics on a rating scale having any number of categories to a scale having a different number of categories are described. To illustrate the use of one of the formulas, the means and variances of items on six forms of a course evaluation questionnaire were compared. (Author/LMO)

Linear and nonlinear methods for incorporating score precision information when the score scale is established for educational tests are compared. Examples illustrate the methods, which discourage overinterpretation of small score differences and enhance score interpretability by equalizing error variance along the score scale. Measurement error…

A statistical experiment was conducted in an operational setting to determine the contributions of different sources of variability to the unreliability scoring of essays and other free-response questions. Partially balanced incomplete block designs facilitated the unbiased estimation of certain main effects without requiring readers to assess the…

Simplified and complex methods of scoring discrepancy format needs assessment instruments were compared. It was shown that the use of the simplified procedure yielded statistically equivalent results as compared to the use of the more complex procedure. The importance of the format and the scoring techniques is discussed. (Author/JAZ)

A study of college student study skills and note sources and their relationship to test performance found that the more sources students used, the higher their test scores would be. In addition, students made choices about the sources they use, and some choices led to higher scores, especially those reflectng scorer. (MSE)

Describes the role of information on score reliabilities, significance of score differences, intercorrelations of scores, and differential validity of score patterns on the interpretation of results from multiscore batteries. (Author)

States that, due to confusion of concepts and lack of systemization, "previous studies are often difficult to interpret and consequently...afford little possibility of formulating more precise statements about those errors the concepts represent...." A proposal for systematization is presented. (Author/RW)

In the Angoff standard setting procedure, subject matter experts (SMEs) estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item comprising the test. In many cases, these item performance estimates are made twice, with information shared with SMEs between estimates. This…

This paper describes and evaluates the use of decision theory as a tool for classifying examinees based on their item response patterns. Decision theory, developed by A. Wald (1947) and now widely used in engineering, agriculture, and computing, provides a simple model for the analysis of categorical data. Measurement decision theory requires only…

There has been little discussion of two conventions common within classroom assessment: the convention of representing student's performance on an assessment using a single score; and the convention of using the average score to summarize a student's performance over a set of assessments. This paper attempts to demonstrate that the assumptions…

This Digest draws from the current literature and the author's experience to identify suggestions for developing performance assessments and their accompanying scoring rubrics. This Digest, part 1, addresses writing goals and objectives and developing performance assessments. Before a performance assessment or scoring rubric is written or…

This study was designed to investigate several scoring modalities in terms of the accuracy of scores and the efficiency of scoring procedures. Five scoring modalities (SM) are conceptualized by considering tasks and raters as sources of error where "p,""t," and "r" represent person, task, and rater, respectively.…

The procedures and advantages of the gross speed--two percent-of-error method in scoring typewriting timed writings are presented. The method makes allowance for errors according to the number of opportunities for error. A mailing address for the typing scoring chart and further information on the method is included. (AG)

This study attempts to determine the extent of agreement on the Torrance Tests of Creative Thinking scores among independent scorers with no training other than individual study of the scoring guides, and a scorer trained by Torrance. (Author)

A group of 21 students was tested under a time limit considerably shorter than should have been allowed. This report describes a tryout of a method for estimating the power'' scores that would have been obtained if the students had had enough time to finish. (Author/CB)