Experiences with competency testing at the elementary level in the area of English language are presented, as well as suggestions for improving the quality of competency tests. In order to modify curricula and requirements to meet the demands of assessment and to ensure sufficient student instruction, the following suggestions are made: (1)…

No-deadline sections of a personalized child development course and sections that had deadlines were compared in regard to proctor workload, proctor grading accuracy, and pressure on proctors. A total of 167 students in four sections of the course, and five proctors and one instructor per section, participated in the study. Students in the…

The scoring scheme of the National Assessment of Educational Progress (NAEP) is studied, as well as techniques for estimating its reliability. NAEP data are collected on students of age 13 in the fall, age 9 in the winter, and age 17 in the spring. The scoring task, involving hand scoring of open-ended items, may vary between 25,000 responses to…

As an alternative for or adjunct to paper-and-pencil tests for predicting personnel performance, the United States Air Force studied the use of peer ratings as an evaluative tool. Purpose of this study was to evaluate the psychometric characteristics of peer ratings among Air Force basic trainees. Peer ratings were obtained from more than 27,000…

Number right and elimination scores were analyzed on a 48-item college level mathematics test that was assembled from pretest data in three forms by varying the item orderings: easy-hard, uniform, or random. Half of the forms contained information explaining the item arrangement and suggesting strategies for taking the test. Several anxiety…

The norm-referenced score scale used by the National Foundation for Educational Research (NFER) is described. The usefulness of standardized scores is explained by a simple numerical example, and the formulas and computations are shown for calculating a mean, a standard deviation, and a deviation or z score. The need for a representative sample is…

The one parameter latent trait theory of Georg Rasch has two assumptions: that student abilities can be measured on an equal interval scale, and that the success of a student with a given item is a function of student achievement and item difficulty. The grade four Michigan Educational Assessment Program reading test was designed to measure…

When survey data are analyzed by computer, a codebook is necessary to show how raw scores are translated to computer-usable form. When data are tabulated by hand, the need for a codebook depends upon the number of respondents, the number and complexity of items, and the types of statistical manipulations required. During the process of coding,…

Two studies investigated examiner scoring agreement on the Oral Vocabulary, Draw-A-Design, and Draw-A-Child subtests of the McCarthy Scales of Children's Abilities. In study one, ten examiners scored four randomly selected normal children's protocols. Unanimous agreement occurred on scores for 52% of the Oral Vocabulary responses, 39% of the…

This paper describes a study of a computerized approach to scoring the Torrance Tests of Creative Thinking (TTCT). A total of 153 students from grades four through seven were involved, 100 in a developmental sample on which the computorized scoring procedures were developed, and a cross validation sample composed of the remaining 53. This research…

A potentially valuable measure of overconfidence on probabilistic multiple-choice tests was evaluated. The measure of overconfidence was based on probabilistic responses to nonsense items embedded in a vocabulary test. The test was administered under both confidence response and conventional choice response directions to 208 undergraduate…

The effects of incentive conditions on the results of a confidence test were investigated. Two hundred thirty high school subjects were administered a very difficult confidence scored test under two conditions: 1) that the test would count heavily on their grades (incentive condition) and 2) that the test was for research purposes and would not be…

An examinee is required to express his confidence in the correctness of each choice of a multiple-choice item in a probabilistic test. For the responses to be valid indicators the confidence expressed in each choice should be determined by an examinees' knowledge. This study assessed the relationship of the certainty of examinees' responses to…

The Student Orientations Survey (SOS) is a research inventory designed to assess students' expressed attitudes regarding curricular-instructional policies, their views on preferred modes of learning, student-faculty roles, etc. The SOS provides a means of profiling students' general orientations toward various philosophies, purposes, and processes…

Empirical results are presented as regards the implementation of a latent-trait psychometric model by means of conditional maximum likelihood estimation. Items are scored polychotomously into varying numbers of nominal categories and the test and item characteristic curves and information functions are examined. It is concluded that scoring items…