Described herein are formulas and computational procedures for estimating the mean and second through fourth central moments of universe scores through multiple matrix sampling. Additionally, procedures are given for approximating the standard error associated with each estimate. All procedures are applicable when items are scored either…

This study investigated (a) interscorer reliability of the Bender-Gestalt Test by using more than one person to score the same test protocols; and (b) rate-rerate reliability of the Bender-Gestalt Test after a half-year interval. (Author)

Performance on Inhelder and Piaget's pendulum problem was obtained as a validating measure in a study of the transition from concrete to formal thinking. The sample consisted of 236 children aged from 10 to 14 years. (Editor)

This study is an in-depth investigation of the National Board for Professional Teaching Standards (NBPTS) bias-reduction training, from the perspective of assessors. The research examined how successful the bias training was in guiding assessors to recognize their biases and to identify actions to be used to reduce the impact of bias on their…

As automated scoring of complex constructed-response examinations reaches operational status, the process of evaluating the quality of resultant scores, particularly in contrast to scores of expert human graders, becomes as complex as the data itself. Using a vignette from the Architectural Registration Examination (ARE), this paper explores the…

Parallel merit reliability (PMR) indexes the same consistency of measurement that is reflected in a validity coefficient; it reflects the reliability of measurement across identical merit score cases. Research has identified the potential benefits of the PMR approach as providing item level and cut-score reliability indices without requiring…

Psychometric issues confronted when implementing a system of item response theory (IRT) tools for test development at the Educational Testing Service (ETS) are discussed. These issues include selecting and assessing the appropriateness of IRT models, choosing methods of IRT scaling for item pools, considering test scoring strategies, and applying…

Here in the United Kingdom, we are used to the idea of assessing pupils' work against Levels. In fact, perhaps we are a little too used to it. Our familiarity with the Level Descriptions in the National Curriculum, and the ways they might inform our Key Stage 3 assessments, can stop us from thinking even harder about exactly what it is that we are…

In efforts to clarify ambiguity in the scoring directions for part of the WISC, 100 children were given the test which was scored by two sets of criteria. Four sets of data were analyzed, with significant discrepancies apparent only between Verbal-Performance correlations secured by Wechsler in his standardization of the WISC and those secured in…

Estimates for the variances of empirically determined scoring weights are given. It is also shown that test item writers should write distractors that discriminate on the criterion variable when this type of scoring is used. (Author)

A study examined the validity of using the Minnesota Job Description Questionnaire to measure occupational reinforcer patterns (ORPs). Although ORP profiles (twenty-one adjusted scales) were developed a decade ago to operationalize a key variable in the Theory of Work Adjustment (Lofquist and Davis, 1969), little validity evidence exists. An…

AUTOMATIC MARKING AND SCORING MACHINES, PRECUT CARDS, AND TEACHING MACHINES WERE ILLUSTRATED IN THIS VOLUME. OTHER VOLUMES OF THIS SERIES ARE ED 003 738 THROUGH ED 003 746. (LP)