Norm-referenced tests are inappropriate for evaluating health care practitioners; criterion referenced tests better describe what is not being measured. Reliable assessment of competency should focus on the valid testing of reasonable numbers of important skills. Available from: Sage Publications, Inc., 275 South Beverly Drive, Beverly Hills,…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

This guide explains the benefits of and procedures for constructing and administering criterion-referenced performance tests in vocational education programs. Addressed in the individual sections are the following topics: the rationale for using task performance measures in vocational education; the predictive validity and physical fidelity of…

Research partially supported by the UCLA Center for the Study of Evaluation of Instructional Programs.

The need for better validation of professional licensing and certification examinations is discussed in Part I. Predictive criterion-related validation studies are difficult to develop, time consuming, impractical and expensive. Since training and knowledge variables are not necessarily sufficient to predict job proficiency, it appears logical to…

A set of pilot performance reference scales was developed based upon airborne Audio-Video Recording (AVR) of student performance in T-37 undergraduate Pilot Training. After selection of the training maneuvers to be studied, video tape recordings of the maneuvers were selected from video tape recordings already available from a previous research…

Locally developed occupational tests were administered to 16- and 17-year-olds in a government-sponsored vocational education program in the United Kingdom over a six-month period in 1984. Job skills were tested in two occupational areas: use of a micrometer and invoice completion. Some performance tests were designed by researchers and some by…

This symposium consists of five papers and presents some recent developments in adaptive testing which have applications to several military testing problems. The overview, by James R. McBride, defines adaptive testing and discusses some of its item selection and scoring strategies. Item response theory, or item characteristic curve theory, is…