The sources of variability in the Angoff standard-setting procedure, when applied to the Alabama High School Graduation Examination (AHSGE), were examined. The sources of variability examined are judges, rounds (replications), competencies (items), and interactions among these three sources. After training, the judges were given a statement of a…

In order to evaluate standard setting procedures, apart from the more commonly applied approach of simply comparing the derived standards or failure rates across various techniques, this study investigated the errors of classification associated with the contrasting groups procedures. Monte Carlo simulations were employed to produce…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

The problem of setting standards has always been an issue in the educational community. This paper offers an outline of one state's procedure for setting a passing score for a competency-based test in mathematics. The Maryland Functional Mathematics Test (MFMT) becomes a graduation prerequisite for the graduating class of 1987. The procedures used…

Standards, passing scores, or cut scores have been seen as an element of criterion-referenced tests since their introduction. This paper discusses at least two issues surrounding the establishment of cut scores which appear to need clarification: (1) the theoretical definition of a cut score; and (2) decisions which must be made in selecting a…

This study examined the contribution of five categories of variables to the standard-setting recommendations of a representative sample of 241 judges recommending standards for the General Knowledge and Communication Skills Tests of the National Teacher Examinations (NTE) for the state of North Carolina. It was based on the assumption that…

Teacher competency tests are being used more frequently to assess the knowledge and skills of prospective teachers. Educational policymakers face the dilemma of setting passing standards for these tests which will satisfy the desire for meaningful quality standards for teachers while meeting the necessity for making available a reasonable number…

Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…

This report presents Fall, 1991 results of the New Jersey College Basic Skills Placement Testing which tests incoming college students and evaluates collegiate remedial courses. A summary of the findings notes that freshmen recorded poorer results on every section of the test compared to 1990 results, that in verbal skills 42 percent lacked…

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

Setting standards for the purpose of certification is frequently performed using judgmental techniques such as the Angoff method. This study was performed to identify types of items that judges find hard to rate accurately, that is, types of items on which examinees perform differently than predicted by the judges. Once identified these item types…

A technical advisory committee assisted the Alabama State Department of Education in establishing passing scores and equating test forms of the Alabama High School Graduation Examination (AHSGE). The committee examined four methods of setting cutting scores: (1) Jensen's theoretical method--probability theory is used to set standards that are…

The second round of litigation in the case of Debra P. v. Turlington has required the Federal courts to consider the question whether the Florida statute which requires public high school graduates to demonstrate the "ability to successfully apply basic skills to every day life situations" as measured by the State Student Assessment…

Florida state legislation has mandated the evaluation of its compensatory education programs. The Florida Accountability Act of 1976 called for minimum basic skills testing in grades 3, 5, 8, and 11 (subsequently amended to grade 10). In 1977, the Florida Compensatory Education Act mandated remedial programs for students performing below the…

To assist low achieving students in the mastery of instructional objectives in major subject areas, the Ministry of Education of Israel published definitions of Minimum Achievement Requirements (MAR) for specific subjects at all grade levels. To examine the feasibility of the MAR approach and to determine whether it contributed to the attainment…