This study investigated two approaches for obtaining job ratings in order to determine which procedure provided the most stable ratings, given a constant number of raters. Specifically, it compared reliability estimates determined by averaging across individually obtained job ratings and reliability estimates based on consensus ratings from…

Management Engineering Teams (MET) were used in the development and testing of a methodology for determining non-aircrew officer grade requirements. The methodology tested was an extension of the Officer Grade Requirements (OGR) procedure developed during the 1963-1966 time period. In the OGR project, a criterion board rated 3,575 officer jobs for…

This report demonstrates the feasibility of covering a large number of classes in a single study that has both classification and selection applications. A job analysis of clerical and administrative positions in the Government of the U.S. Virgin Islands was accomplished by means of a single questionnaire comprised of 264 items of the following…

The relationship between job skills and specific tasks is difficult to analyze, since any one task may require multiple skills. In this study, a sequence of statistical evaluations was conducted to examine the reliability of a subject matter expert panel's association of tasks and job skills and the factor structure of the task by job skill…

This paper reports the development of an evaluation scale for paraprofessional residence hall counselors. The developmental processes are described, and data on reliability and validity are presented. (Author)

This paper describes the construction of a new examination for Federal Coal Mine Inspectors, using the Job Element (J-Scale) method. Headquarters administrators and field inspectors rated the importance of various job elements. The values given to 32 elements, a comparison of test and actual proficiency, ratings, and examples of the rating…

The Air Force Occupational Measurement Center conducts task-based occupational surveys of Air Force specialties that include supervisor ratings on recommended training emphasis for entry-level airmen. Priorities are input to the Instructional System Development training model, which guides the development and revision of specialty training…

This paper concerns two features of a project on the assessment of job potential: the J-Coefficient, and the J-Scale. The J-Coefficient is a means of determining the validity of a test for a position on the basis of (1) the Beta Weights for predicting test scores from a set of elements and (2) estimates of importance of each element in the…

A total of 168 Negro and 296 white Medical Technicians participated in this study. A nine-scale performance rating form was developed and administered. Every technician was rated by at least two supervisors. A test of job knowledge was also given to all subjects. Among the correlations found were: (1) Negro workers received distinctly higher…

Twenty-eight papers were presented covering numerous aspects and ramifications of personnel evaluation research methodology in military training. Attention was focused on such concerns as job analysis, testing of knowledge and performance, predictive ability of biographical inventories and psychiatric interviews, course evaluation techniques,…

This handbook was designed to assist practicing vocational educators in planning and preparing performance measures for evaluating the behavioral outcomes of instruction. It is particularly concerned with fulfilling the needs of individuals involved in manpower development and training programs. The nature of and need for performance testing is…

An objective procedure was developed and tested to determine the relative difficulty of Air Force jobs. Also investigated were (1) the measurement of task difficulty to allow comparability across specialties, (2) the quantitative appraisal of job demands based on component tasks being performed, and (3) the comparability of job difficulty to job…

This appendix to the final report of a study on effectiveness in work roles contains nine methodological appendixes that provide the technical details of the measures used in the five-year study. (CE 016 655 is the final report.) Appendixes A and B are reproductions of the interview schedules for phases 1 and 2 and appendixes C and D reproduce the…

A meta-analysis examines the predictive validity of three methods for evaluating the education and experiences (E&E) of applicants for entry and full-performance level jobs, focusing on federal white-collar jobs. The following are methods of rating education and experience: (1) Point, assigning points to the duration and type of past education…