Setting standards for the purpose of certification is frequently performed using judgmental techniques such as the Angoff method. This study was performed to identify types of items that judges find hard to rate accurately, that is, types of items on which examinees perform differently than predicted by the judges. Once identified these item types…

The sources of variability in the Angoff standard-setting procedure, when applied to the Alabama High School Graduation Examination (AHSGE), were examined. The sources of variability examined are judges, rounds (replications), competencies (items), and interactions among these three sources. After training, the judges were given a statement of a…

An empirical item characteristic curve shows the probability of a correct response as a function of the student's total test score. These curves can be estimated from large-scale pretest data. They enable test developers to select items that discriminate well in the score region where decisions are made. A similar set of curves can be used to…

These five papers describe the methods, results, and implications of a multimethod approach to the establishment of standards for the three subject areas of the Alabama High School Graduation Examination (AHSGE). James E. McLean introduces the problems and methods involved by identifying three general approaches to scoring procedures found in the…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

The problem of setting standards has always been an issue in the educational community. This paper offers an outline of one state's procedure for setting a passing score for a competency-based test in mathematics. The Maryland Functional Mathematics Test (MFMT) becomes a graduation prerequisite for the graduating class of 1987. The procedures used…

Standards, passing scores, or cut scores have been seen as an element of criterion-referenced tests since their introduction. This paper discusses at least two issues surrounding the establishment of cut scores which appear to need clarification: (1) the theoretical definition of a cut score; and (2) decisions which must be made in selecting a…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

Teacher competency tests are being used more frequently to assess the knowledge and skills of prospective teachers. Educational policymakers face the dilemma of setting passing standards for these tests which will satisfy the desire for meaningful quality standards for teachers while meeting the necessity for making available a reasonable number…

The effects of failing to pass a high school exit exam were examined for the Georgia Basic Skills Test (GBST). Data were collected on a random sample of students who were tenth graders in 1983 and in 1984. The following issues were studied: (1) impact of failure on self esteem, as measured by the Piers-Harris Children's Self-Concept Scale (P-H);…

The National Teacher Examinations (NTE) Core Battery and Specialty Area tests were assessed to determine (1) test validity and (2) minimum performance standards for use in the state of Tennessee. The NTE was reviewed by 316 teacher education personnel, who focused on its relevance to teacher education programs. A group of 288 local school district…

Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…

The administration of the High School Proficiency Test (HSPT) in the Trenton (New Jersey) School District and the impact of a voluntary summer tutorial program on HSPT scores were examined. New Jersey requires that all ninth graders take the HSPT, and that all school districts achieve a 75 percent passing rate to become state-certified. The same…

A technical advisory committee assisted the Alabama State Department of Education in establishing passing scores and equating test forms of the Alabama High School Graduation Examination (AHSGE). The committee examined four methods of setting cutting scores: (1) Jensen's theoretical method--probability theory is used to set standards that are…