This study focuses on the Renaissance Teacher Work Sample's critical sections Assessment Plan and Analysis of Student Learning. Preliminary review of scoring data based on the sample revealed that preservice teachers at a large comprehensive institution teacher program appeared to be most challenged with designing assessments and analyzing student…

The paper describes the task matrix procedure for determining the task content for work samples in entry-level occupations within a specified occupational group or industry. The procedure enables the work sample developer to systematically obtain and organize task information from the Dictionary of Occupational Titles in order to identify those…

Challenges to classical psychometric theory are examined in the context of a broader range of fundamental, derived, and intuitive measurements in psychology; the challenges include content-referenced testing, latent trait theory, and generalizability theory. A taxonomy of psychological measurement is developed, based on: (1) purposes of…

Criteria are presented for vocational evaluators who use work samples as one means of determining the vocational potential of blind clients. Included are rationale for the use of work samples; specific steps for their administration, scoring, and use of norms; and criteria for modifying present work samples and developing new ones. A literature…

A project was conducted to develop and assess a highly job related personnel selection battery that could be administered to inexperienced applicants for positions as public assistance workers in departments of public welfare or unemployment offices. The Public Assistant Worker Job Trial (PAWJT) is called a job trial because instead of attempting…

The adverse impact of a content-valid job sample test of metal trades skills was compared to that of a well-constructed content-valid written achievement test for the same technical area. The adverse impact of the former was considerably less. Suggests that industrial psychologists should explore more fully the potential of performance testing.…

Addresses problems involved in developing and using performance tests, creating job-like testing situations, specifying measurable criteria, and controlling external factors to reduce problems of test reliability. Placing trainees in on-the-job training environments when training cannot be provided in the classroom or laboratory is recommended.…

A three-year research effort was conducted to design a crime laboratory proficiency testing program encompassing the United States. The objectives were to: (1) determine the feasibility of preparation and distribution of different classes of physical evidence; (2) assess the accuracy of criminalistics laboratories in the processing of selected…

This report describes the development of a criterion-referenced proficiency examination for dental auxiliaries that consists of both written and performance tests in each of five areas: chairside assisting, patient education, diagnostic aids, therapeutics, and laboratory procedures. The content outlines of the tests are presented. The formation of…

This manual is designed to help classroom teachers, instructional designers and test developers, construct sound, challenging and sophisticated paper and pencil exercises that simulate the data-gathering and decision process involved in diagnosing and resolving a problem. It is based on the authors' extensive experience in conducting training…

A test development plan is described to evaluate police enrolled in the law enforcement basic training course developed by California's Commission on Peace Officer Standards and Training (POST). Some general test methodologies are discussed: performance tests, knowledge tests, and situational tests, including role playing simulations and…

Construction of a work sample test, the Investigator Planning Exercise (IPE), for the job of detective in the Chicago (Illinois) Police Department is described. Simulated crime scenarios, a mock crime scene, and five checklists of necessary skills (i.e., ability to summarize and communicate facts, identify inconsistencies, and determine the next…

Locally developed occupational tests were administered to 16- and 17-year-olds in a government-sponsored vocational education program in the United Kingdom over a six-month period in 1984. Job skills were tested in two occupational areas: use of a micrometer and invoice completion. Some performance tests were designed by researchers and some by…

A prototype simulation measure of the negotiating skill of interpersonal competence is described, and results of an initial validation study are reported. Of eight negotiating skills identified by the Secretary's Commission on Achieving Necessary Skills of the U.S. Department of Labor, two were the focus of the measure: proposing and examining…

This packet contains a manual and a workbook for developing performance tests in vocational education. The manual gives an in-depth description of how to develop, score, and use performance tests. It includes the following sections: definitions of performance testing, steps in developing a performance test, selecting a performance development…