Two types of classification error are possible in competency tests: erroneous classification of an individual as a "master" of the subject (Type II error), and erroneous classification of a master as a "nonmaster" of the subject (Type I). If steps are taken to minimize Type II errors, an artificially high number of true masters…

The adequacy of a test developed for statewide assessment of basic mathematics skills was investigated. The test, comprised of multiple-choice items reflecting a series of behavioral objectives, was compared with a more extensive criterion measure generated from the same objectives by the application of a strict item sampling model. In many…

With the increasing emphasis on teacher competency testing, it is important to examine the usefulness of the currently available paper and pencil tests. At least 40 states in the United States now have, or are planning to have, teacher tests for initial certification. Some states have tests for career advancement, and 20 mandate tests for…

Six essays on technical measurement problems in criterion referenced tests and four essays by psychometricians proposing solutions are presented: (1) "Criterion-Referenced Measurement" and Other Such Terms, by Marvin C. Alkin which is an overview of the first six papers; (2) Selecting Objectives and Generating Test Items for Objectives-Based…

Administrative and technical problems were encountered in carrying out a minimum competency program for high school students in the Austin (Texas) Independent School District. The history of required minimum competency testing was reviewed briefly, and the process of clarifying and operationalizing the requirements was described within the Austin…

Computer adaptive testing systems are feasible for certification and licensure testing. This is in part due to the availability of extensive yet inexpensive computers. Modern item response theory, combined with computerized adaptive testing, yields a powerful new method of testing which provides greater accuracy and efficiency and less boredom for…

The feasibility of criterion referenced testing is held to be dependent on the tenability of two postulates: (1) that bias can be controlled in a principled manner from one test to the next; and (2) that one mental process measured by such tests may lawfully interact with another. Without the first postulate, criterion scores could not be…

A synthetic performance test is a job performance test that has been degraded to some degree in the range of tasks covered or in the fidelity of stimulus/response features. Since further development is needed before synthetic performance testing is valid and efficient, this research project focused on three objectives: to (1) identify problems…

The concept of performance levels in criterion-referenced assessment is explored by applying the idea to different types of tests commonly used in schools, mastery tests (including diagnostic tests) and achievement tests. In mastery tests, a threshold performance standard must be established for each criterion. Attainment of this threshold…

Three areas of concern for those considering competency-based graduation requirements are discussed. First, what is involved in implementing a competency-based graduation requirement? The first tasks are the specification of performance standards and the performance skill areas. Then, appropriate certification procedures can be selected, and their…