This paper evaluates the magnitude of the total error in estimates of the difference between an examinee's domain score and the cutoff score. An observed score based on a random sample of items from the domain, and an estimated cutoff score derived from a judgmental standard setting procedure are assumed. The work of Brennan and Lockwood (1980) is…

This report investigates an area of uncertainty in using the Angoff method for setting standards, namely whether or not a judge's conceptualizations of borderline group performance are realistic. Ratings are usually made with reference to the performance of this hypothetical group, therefore the Angoff method's success is dependent on this point.…

Although the Rotter Incomplete Sentence Blank (ISB):High School Form has been used to distinguish between normal and abnormal adolescents, it has been hypothesized that in facility placed juvenile delinquents' highly conflictual responses (i.e., those that index maladjustment) reflect removal from home and agency placement rather than long-term…

One means of learning about the processes operating in a multiple choice test is to include some test items, called nonsense items, which have no correct answer. This paper compares two versions of a mathematical model of test performance to interpret test data that includes both genuine and nonsense items. One formula is based on the usual…

Oral tests for speaking skills evaluate two major skills: linguistic competence, including accuracy of pronunciation, vocabulary, and structure, and communication ease. Four factors affect students' oral performance: verbal intelligence, short-term auditory and visual memory, sound-symbol association skill, and grammatical analysis. Personality…

The relationship between scores on a typical bar exam and the ability to practice law was investigated with 485 applicants who took the bar exam and a 2-day performance test involving basic oral and written legal tasks. These tasks consisted of simulated cases; each participant functioned as the attorney for the plantiff in one case and as the…

A representative group of 4,000 California high school seniors was randomly assigned one of five essay topics. Each essay was given two independent ratings based on criteria specified for each topic by an advisory group of English teachers. On the basis of the scores, a representative subset of 750 essays was randomly selected from the top…

The recent psycholinguistic-sociolinguistic trend in foreign language teaching indicates a shift of interest away from quantitative data towards qualitative information of different kinds. Validity and relevance are stressed and so new test formats are demanded, as well as new methods of dealing with student answers. Item analysis techniques used…

In the specific methods of standard setting in testing, judgments about individuals being tested, contrasting groups being tested, and judgments about the test items are discussed. In judgments about individual test-takers, assumptions are presented based on the knowledge and skills the test is intended to measure, the test-takers' skills at the…

Three alternative methods for placing post-secondary students into freshman English or remedial writing classes are compared. The study contrasted: (1) a proposed system-wide test combining multiple choice and essay scores; (2) the holistic essay scoring procedures used at separate university campuses; and (3) an analytic scoring rubric developed…

The aim of this study was to show that the superiority of corrected-for-guessing scores over number right scores as true score estimates depends on the ability of examinees to recognize situations where they can eliminate one or more alternatives as incorrect and to omit items where they would only be guessing randomly. Previous investigations…

The process typically employed by testing services in developing professional tests for national use is described: (1) determination of professional standards; (2) development of test specifications; (3) test construction; (4) test registration and administration; and (5) scoring, analysis, and reporting. To determine professional standards, input…

The purpose of this paper is to derive explicit estimates of the parameters of a latent structure model when the skills represented by the test items are hierarchically related. Two special cases are described, which may be used as an approximation to the Dayton and Macready model and also provide initial estimates in an iterative estimation…

WITH EXISTING COMPUTER TECHNOLOGY, TESTS FOR SCREENING COLLEGE APPLICANTS CAN BE WRITTEN BY COMPUTERS. RESULTS OF A 72-ITEM COMPUTER-WRITTEN SYNONYMS TEST WERE COMPARED WITH THOSE OF THE ETS WIDE RANGE VOCABULARY TEST. BOTH TESTS WERE ADMINISTERED IN THE FALL OF 1965 TO ENTERING UNIVERSITY OF IOWA FRESHMEN. AT THE END OF THE FIRST SEMESTER, THESE…