In recent years educators have been utilizing judgmental methods, such as the ones advocated by Ebel and Angoff, to set minimum competency standards on test items. This study was designed to investigate the reliability and validity of these two procedures in setting minimum levels of performance on 175 vocational evaluator competency statements.…

Traditionally, judgmental standard setting methods have been used exclusively at the test item level. In this study, the Ebel and Angoff methods of standard setting were utilized to determine minimum competency standards on a list of 175 identified competency statements for vocational evaluators. The following research questions were addressed:…

On July 8, 9 and 10, 1981 the National Institute of Education (NIE) sponsored a "hearing" on minimum competency testing (MCT). The hearing, which was to clarify issues related to MCT, was modeled after adversarial and judicial evaluation approaches. The Northwest Regional Educational Laboratory was responsible for the overall evaluation…

In order to evaluate standard setting procedures, apart from the more commonly applied approach of simply comparing the derived standards or failure rates across various techniques, this study investigated the errors of classification associated with the contrasting groups procedures. Monte Carlo simulations were employed to produce…

This bulletin describes the technical adequacy of the Florida Teacher Certification Examination and includes discussions on establishing test reliability, test validity, passing scores, and protecting the test from cultural or ethnic bias. Chapter I describes the development of the examination: (1) development, identification, and validation of…

Maryland is one of the states which recently developed new requirements for high school graduation. A preliminary evaluation of these new state standards has raised a number of issues about graduation standards and their assessment. The Maryland State Department of Education examined statewide policies and guidelines for high schools between 1982…

This paper analyzes mastery learning as an alternative to curriculum planning and discusses implementation of the strategy in a prekindergarten through eighth-grade school district in Red Bank, New Jersey. The paper briefly describes district schools and circumstances affecting the school board's decision to implement mastery learning; discusses…

Practical and technical advice is provided for staff responsible for planning evaluations of Educational Consolidation and Improvement Act (ECIA) Chapter 1 migrant programs at the state level. The report is limited to evaluating achievement gains in basic skills; this is, however, acknowledged as only one facet of a comprehensive migrant program…

Participants in this conference of educators, convened to consider methods of evaluating teacher education students, focused upon the relationship between candidate quality and teacher effectiveness. Questions under consideration included: (1) pre-admission field experiences students should demonstrate; (2) optimum scores on aptitude and…

A preliminary survey of 32 school districts identified as having highly developed teacher evaluation systems was followed by the selection of 4 case study districts (Salt Lake City, Utah; Lake Washington, Washington; Greenwich, Connecticut; and Toledo, Ohio) representing diverse teacher evaluation processes and organizational environments. Common…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

A one-page introduction is followed by summaries of articles and documents on teacher competency testing. George F. Madaus argues that, although tests serve some useful functions, treating them as a major mechanism for reforming education is questionable. Peter A. Garcia examines the negative impact of testing on minority teachers and minorities…

Florida state legislation has mandated the evaluation of its compensatory education programs. The Florida Accountability Act of 1976 called for minimum basic skills testing in grades 3, 5, 8, and 11 (subsequently amended to grade 10). In 1977, the Florida Compensatory Education Act mandated remedial programs for students performing below the…