There are difficulties in expressing effect sizes on a common metric when some studies use transformed scales to express group differences, or use factorial designs or covariance adjustments to obtain a reduced error term. A common metric on which effect sizes may be standardized is described. (Author/RL)

Investigated scoring agreement among three different training levels of Visual Motor Integration Test (VMI) diagnosticians. Correlational data demonstrated high interexaminer reliabilities; however, there were gross errors in precision after raw scores had been converted into VMI age equivalent scores. (Author/RC)

The Selected Marker Tests were examined for scoring problems and internal consistency and were administered orally to sixth and seventh graders. Scoring problems were discovered and changes were suggested. The problem was found to be item reliability rather than interrater reliability. (Author/MH)

Supposing different values of the standard measurement error, the relation of scale coarseness to the total amount of error is studied on the basis of probability distribution of error. The analyses are performed within two models of error and with two criteria of amount of error. (Editor/SJL)

Describes a point grading system designed to provide students with some academic freedom and to set up concrete criteria for successful cognitive, affective, and psychomotor behavior. (Author/MA)

Absolute ratings on the Microcounseling Skill Discrimination Scale (MSDS) confound the individual's use of the rating scale and actual ability to discriminate effective and ineffective counselor behaviors. This note suggests methods of scoring the MSDS that will eliminate variability attributable to response language and improve the validity of…

Five forms of a basic science examination administered over three years in a national board testing program were analyzed to determine the stability of judged cut scores. Results indicate that cut scores derived from the modified Nedelsky procedure were within equating error of the Rasch equated cut scores over the five administrations. (SLD)

Examined mothers' accuracy in predicting the responses their children gave and the scores they achieved on two standardized vocabulary tests. Findings indicate that the overall estimates by mothers of language-impaired children were more accurate than those by mothers of language-normal children. (28 references) (Author/CK)

Discusses problems with scoring reliability of the Vermont Education Department's writing portfolio test, particularly the difficulties teachers face in agreeing upon scoring criteria. (PA)

Data from two standard-setting exercises were analyzed using the logistic regression model that assumes no variation in severity of raters, and results were compared with those obtained by logistic regression that allowed for severity variation. Results illustrate the importance of taking between-rater differences into account. (SLD)

Discusses multiple choice questions and presents a statistical approach to post-test correction for guessing that can be used in spreadsheets to automate the correction and generate a grade. Topics include the relationship between the learning objectives and multiple-choice assessments; and guessing correction by negative marking. (LRW)

Examines online discussions using lexical scoring techniques. Suggests that online conversations become more sophisticated as learners interact with each other over the duration of a course, that collaboration among learners fosters the social construction of knowledge and that evidence of such knowledge-building activities is embodied in the tone…

Clarifies key propositions of the central-curriculum-control model and presents teachers' beliefs about effects of centralized policies on practice, based on interviews with teachers from three urban districts. Curriculum-control policies contribute to content standardization and standard setting. They control what is taught, rather than how it is…

Reports on three studies conducted in the Netherlands about the reading reliability of lay and expert readers in rating content and language usage of students' writing performances in three kinds of writing assignments. Findings reveal that expert readers are more reliable in rating usage, whereas both lay and expert readers are reliable raters of…

"Test Scoring" provides insight into psychometric procedures as used by a professional testing company or in large-scale projects. The book contains an overview of standard test theory, a discussion of factor analytic theory, and an exploration of special applications and problems. (SLD)