Applied Performance Tests (APT) are defined as instruments designed to measure performance in an actual or simulated setting. They require at least a close approximation of the setting (if not the actual setting) to which the performance is expected to be transferred. This paper outlines measurement problems and issues that are unique to APT. It…

The validity and dependability of functional competency tests for adults are examined as they relate to the information needs of instructional decision makers. Test data from the Adult Performance Level (APL) Program (funded by the U.S. Office of Education at the University of Texas at Austin) is used to illustrate key points. In the discussion of…

The literature on criterion referenced testing is full of discussions concerning whether classical measurement techniques are appropriate, whether variance is necessary, whether new indices of reliability are needed, and the like. What appears to be lacking, however, is a clear and simple discussion of why the problems occur. This paper suggests…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

Attention has recently been focused on the need to design and validate instructional materials that guarantee competent student performance. In preparing such products, developers have come to rely on competency-based achievement tests. Unfortunately, expertise for constructing reliable and valid competency-based instruments is not currently…

The development and evaluation of prototype hands-on equipment, job sample performance tests for a high skilled technical Military Occupational Specialty (MOS) are described. An electronic maintenance MOS (26C20) was used as the research vehicle. The results led to the conclusion that valid and reliable performance tests could be constructed, but…

The reliabilities of two types of measurement plans were compared across six hypothetical distributions of true scores or abilities. The measurement plans were: (1) fixed-length, where the number of trials for all examinees is set in advance; and (2) trials-to-criterion, where examinees must keep trying until they complete a given number of trials…

The development of a simulation technique to evaluate performance of psychomotor skills in an undergraduate nursing program is described. This method is used as one admission requirement to an alternate route nursing program. With modifications, any health profession could use this technique where psychomotor skills performance is important.…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

Research partially supported by the UCLA Center for the Study of Evaluation of Instructional Programs.

A work sample criterion test was developed for General Vehicle Repairman, MOS 63C30 and 63C40. Test items covered three task categories: troubleshooting, corrective action, and preventive maintenance. Thirty-eight organizational mechanics were tested at Fort Knox, Kentucky. Data were also collected on the quality of performance, for example, use…

This report describes the development of a criterion-referenced proficiency examination for dental auxiliaries that consists of both written and performance tests in each of five areas: chairside assisting, patient education, diagnostic aids, therapeutics, and laboratory procedures. The content outlines of the tests are presented. The formation of…

A set of pilot performance reference scales was developed based upon airborne Audio-Video Recording (AVR) of student performance in T-37 undergraduate Pilot Training. After selection of the training maneuvers to be studied, video tape recordings of the maneuvers were selected from video tape recordings already available from a previous research…

Locally developed occupational tests were administered to 16- and 17-year-olds in a government-sponsored vocational education program in the United Kingdom over a six-month period in 1984. Job skills were tested in two occupational areas: use of a micrometer and invoice completion. Some performance tests were designed by researchers and some by…

This manual outlines the rationale for using the Criterion Referenced Test (CRT) approach and suggests specific guidelines for test developers to use in constructing test items. Methods for assessing the adequacy of a CRT are also provided. (Author/RC)