In this research report, we describe a study to map the scores of the "TOEFL® Essentials"™ test to the Canadian Language Benchmarks (CLB). The TOEFL Essentials test is a four-skills assessment of foundational English language skills and communication abilities in academic and general (daily life) contexts. At the time of writing this…

Many testing programs face the practical challenge of having limited resources to conduct comprehensive standard setting studies. Some researchers have suggested that replicating a group's recommended cut score on a full-length test may be possible by using a subset of the items. However, these studies were based on simulated data. This study…

The recent increase in the use of constructed-response items in educational assessment and the dissatisfaction with the nature of the decision that the judges must make using traditional standard-setting methods created a need to develop new and effective standard-setting procedures for tests that include both multiple-choice and…

Discusses the roles played by participants and the processes involved in a provincial standards-setting exercise for a large-scale assessment of student skills. Offers perspectives of a policy maker outside the exercise and an insider participant. Describes alternate notions of representativeness, stakes, and significance. (SLD)

To determine if a given standard-setting procedure will yield consistent evaluation outcomes, one of three parallel certifying examinations was administered to three classes of second year medical students. The results indicated that the standard-setting procedure is a significant factor in the determination of the evaluation outcome. (Author/BW)

Results of the fall 1993 administration of part two of the Medical Council of Canada's Evaluating Examination for 744 candidates provided evidence of the consistency of the pass/fail and cutting score definitions for the objective- structured clinical examination stations used across examiners. These results support the validity of this…

Issues related to the establishment of formal standards for student achievement on large-scale assessments are discussed, and two approaches to standard setting that have been used in Saskatchewan (Canada) are described. In spite of the general success of these programs, numerous issues to consider in future evaluations are raised. (SLD)

Compares two approaches for establishing student achievement standards and expectations for province-wide assessment in Saskatchewan (Canada). The first approach based standards on judges' estimates regarding the percentage of students who should be able to attain desired levels of performance. The second approach required judges to reach a…

It is argued that the modification of the Nedelsky procedure proposed by L. J. Gross is a valid approach to setting standards when clinical reasoning is measured using multiple-choice questions. An example from the Medical Council of Canada's Qualifying Examination for approximately 2,400 examinees demonstrates the procedure's value. (SLD)

The General Accounting Office (GAO), at the request of the House Committee on Education and Labor, Subcommittee on Elementary, Secondary, and Vocational Education, conducted studies on the extent and cost of testing in the United States, the experience of Canada in testing, and initial efforts to set standards for judging student performance on…