Often a written test is used as an inexpensive substitute for a performance measure. A specified minimum performance level or probability of successful performance can be translated into a minimum passing score for the written test most efficiently by measuring the performance of students whose written test scores are near the desired cutoff…

A specified minimum performance level can be translated into a minimum passing score for the written test by measuring the performance of students whose written test scores are near the desired cutoff score. Stochastic approximation methods accomplish this purpose. The up-and-down method and the Robbins-Monro process are compared. (Author/RL)

For tests used to make pass/fail decisions, the relevant standard error of measurement (SEM) is the SEM at the passing score. If the test is highly stratified, this SEM should be estimated by a split-halves approach. A formula and its derivation are provided. (Author)

Leo Nedelsky developed a method for determining absolute grading standards for multiple choice tests. His method required a group of judges to examine each test question and eliminate those responses which the lowest D- student should be able to reject as incorrect. The correct answer probabilities remaining were used in computing an expected test…

A measure of the usefulness of a pass/fail testing decision procedure is the ratio of the utility of the given procedure to the utility of a procedure based on knowledge of scores on a criterion measure. It is computed from scores for a representative sample of persons tested. Utility functions may be specified by the test user or set by…

To set a standard on the "beardedness" test (see TM 507 062) the probability that a student with a specific score will be judged as bearded must be estimated for each test score. To get an unbiased estimate of that probability, a representative sample of students at each test score level must be chosen. (BW)

The traditional reliability coefficient and standard error of measurement are not adequate measures of reliability for tests used to make pass/fail decisions. Answering the important reliability questions requires estimation of the joint distribution of true and observed scores. Lord's "Method 20" estimates this distribution without the…

This report describes a study conducted in response to a request for help in establishing decision rules for exempting prospective teachers from a proposed statewide testing requirement in Indiana. Having decided to use Scholastic Assessment Test (SAT) scores as a basis for exempting prospective teachers from the Pre-Professional Skills Test…

Four different systematic methods for selecting passing scores which differ primarily in the types of judgment they require were compared. The borderline group method and the contrasting groups method were each compared with the Nedelsky method at four schools and the Angoff method at another four schools. The Basic Skills Assessment Tests in…

Procedures are described for studying the reliability of decisions based on specific passing scores with tests made up of discrete items and designed to measure continuous rather than categorical traits. These procedures are based on the estimation of the joint distribution of true scores and observed scores. (CTM)

An empirical item characteristic curve shows the probability of a correct response as a function of the student's total test score. These curves can be estimated from large-scale pretest data. They enable test developers to select items that discriminate well in the score region where decisions are made. A similar set of curves can be used to…

The borderline group standard-setting method (BGSM), Nedelsky method (NM), and Angoff method (AM) were compared, using reading scores for 1,948 and mathematics scores for 2,191 sixth through ninth graders. The NM and AM were inconsistent with the BGSM. Passing scores were higher where students were more able. (SLD)

Practical methods of setting standards for the Basic Skills Assessment tests in secondary level reading, writer's skills, and mathematics are offered in this manual. An overview discusses the need for standards and includes a brief description of current practices in establishing them. In light of related social and political issues, it is advised…

This manual is written for the individual responsible for choosing the passing score on an educational or occupational test. It concentrates on practical advice to help select and apply a method for choosing the passing score. Decisions, standards, and judgments are defined and discussed in terms of considerations in choosing a passing score…

This report describes the development of a criterion-referenced proficiency examination for dental auxiliaries that consists of both written and performance tests in each of five areas: chairside assisting, patient education, diagnostic aids, therapeutics, and laboratory procedures. The content outlines of the tests are presented. The formation of…