Establishing cut scores using the Angoff method requires panelists to evaluate every item on a test and make a probability judgment. This can be time-consuming when there are large numbers of items on the test. Previous research using resampling studies suggest that it is possible to recommend stable Angoff-based cut score estimates using a…

The "Washington English Language Proficiency Assessment" (WELPA) is a No Child Left Behind (NCLB)-compliant instrument that is used in Grades K-12 as a formal and standardized method of measuring language proficiency. The test results provide important information for classifying English Language Learners (ELLs) and subsequently for…

Many mastery decisions are made based on assessment devices that are known to be less than perfectly reliable. A significant portion of examinees who have scores near the cutting score risk misclassification, even for instruments with relatively high retest reliability. Suggestions for minimizing this risk are offered. (Author/MT)

Educators were asked to read a description of a minimum proficiency test required for high school graduation and select a cutoff score for it. The 24 descriptions used were formed as all possible combinations of a test content, a level of student performance, a penalty for failing the test, and a community response to the test. Of the 223…

Multiple matrix sampling is applied to a variation of Angoff's standard setting method. Thirty-six experts (internists) and 190 items were divided into five groups, and borderline examinee performance was estimated. There was some variability in the cutting scores produced by the individual groups, but various components were well estimated. (SLD)

Some general questions about minimum competency tests are discussed, and various methods of setting standards are reviewed with major attention devoted to those methods used for dichotomizing a continuum. Methods reviewed under the heading of Absolute Judgments of Test Content include Nedelsky's, Angoff's, Ebel's, and Jaeger's. These methods are…

A general model along with four illustrations is presented for the consideration of budgetary constraints in the setting of passing scores in instructional programs involving remedial action for poor test performers. Budgetary constraints normally put an upper limit on any choice of passing score. Given relevant information, this limit may be…

Setting standards for the purpose of certification is frequently performed using judgmental techniques such as the Angoff method. This study was performed to identify types of items that judges find hard to rate accurately, that is, types of items on which examinees perform differently than predicted by the judges. Once identified these item types…

To set a standard on the "beardedness" test (see TM 507 062) the probability that a student with a specific score will be judged as bearded must be estimated for each test score. To get an unbiased estimate of that probability, a representative sample of students at each test score level must be chosen. (BW)

Livingston's (TM 507 218) response to Rowley (TM 507 062) is compared with the original Zieky and Livingston formulation of the Contrasting Groups Method of setting standards. (BW)

This reply to William A. Mehrens argues that although some psychometricians are reluctant to endorse the use of test data for educational decision making, it is desirable that measurement specialists provide decision makers with practical, understandable ways to use test data. (JAZ)

Three studies assessed the psychometric characteristics of the Direct Standard Setting Method (DSSM). The Angoff technique was also used in each study. The DSSM requires judges to consider an examination 10 items at a time and determine the minimum items in that set a candidate should answer correctly to receive the credential. Nine judges set a…

All New Jersey students in grades 3, 6, 9, and 11 are tested annually in basic reading and computation skills using the New Jersey Minimum Basic Skills (MBS) Tests. The MBS testing program was initiated in 1976. The former Educational Assessment Program tests were used during the tramsition, and test development activities were begun in 1977.…

Barbara Jordan served as the hearing officer for three-day adversary evaluation hearings about the pros and cons of minimum competency testing (MCT). This report is the complete transcript of the second day of proceedings. The pro team, lead by James Popham, began by presenting representatives of four states (Florida, California, Texas, and…

To replace traditional methods of minimum competency testing in personnel selection, a two stage cutting score procedure is proposed. The Angoff procedure is modified so that only a subset of test items, which assess essential job related skills, are used to determine the cutting score and to identify qualifed applicants. As a measure of item…