Standard setting practices in states using the NTE (formerly the National Teacher Examinations) were examined for 1987. The NTE is composed of two segments: (1) a Core Battery covering the communication skills and general knowledge skills; and (2) a test of professional knowledge about teaching. The processes used to establish passing scores for…

Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

The impact of overall test length and difficulty on the expert judgments of item performance by the Nedelsky method were studied. Five university-level instructors predicting the performance of minimally competent candidates on a mathematics examination were fairly consistent in their assessments regardless of length or difficulty of the test.…

This paper describes the meeting of the Reading and Writing Advisory Committee of the New Jersey Basic Skills Council with selected high school English teachers and administrators. This panel established cut scores for statewide interpretation of the New Jersey College Basic Skills Placement Test (NJCBSPT). The NJCBSPT is administered to all…

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

Memphis State University conducted a study for the Tennessee Department of Education to determine the validity of 11 previously unvalidated, extensively revised, or new Educational Testing Service (ETS) tests as measures of the skills and knowledge required for specific initial certification endorsements of public school personnel in Tennessee.…

Comparative data and results of validation and standard-setting studies are presented for five subject-matter tests for teacher certification in two states. The five tests evaluated were available from the Educational Testing Service (ETS): one National Teacher Examination specialty area test (special education); and four tests from a consortium…

In 1988 a study was conducted to determine the validity of candidate teacher licensure examinations for use in Tennessee under the 1984 Comprehensive Education Reform Act. The Department of Education conducted a study to determine the validity of 11 previously unvalidated or extensively revised tests for certification and to make recommendations…

The licensure of public school personnel in Tennessee is a function of the State Department of Education (SDE). Additional requirements for this certification function were added by the Comprehensive Education Reform Act (Senate Bill Number 1) of the 1984 Tennessee General Assembly. The Act mandated that the SDE use tests to assess the competence…