The first step in developing or updating a licensure or certification examination is to conduct a job or task analysis. Following completion of the job analysis, a survey validation study is performed to validate the results of the job analysis and to obtain task ratings so that an examination blueprint may be created. Psychometricians and job…

Content validity is concerned with three components: (1) the job content; (2) the test content, and (3) the strength of the relationship between the two. A content validation study, to be considered adequate and defensible should include at least the following four procedures: (1) A thorough and accurate job analysis (to define the job content);…

This report describes the development, standardization, and validation of two parallel forms of the Officer Selection Battery, a 2-hour, group administrable, paper and pencil test for assessing men and women applying for the Reserve Officers Training Corps (ROTC). Based on an extensive job analysis, 1,400 experimental items in 12 job areas were…

Results of an eight-hour training program designed to minimize rating errors supported the hypothesis that low correlations were a result of rating errors made by supervisors. Of the five predictors, four correlated significantly with the performance ratings that were conducted after the supervisors had received the training. (Author)

The primary purpose of this study was to obtain estimates of the human attribute requirements of the job elements of the Position Analysis Questionnaire (PAQ). A secondary purpose was to explore the reliability of job-related ratings as a function of the number of raters. A taxonomy of 76 human attributes was used and ratings of the relevance of…

A quantitative model has been formulated which, when used along with existing job evaluation methods, aids in determining equitable grades for most commissioned officer positions. The model applies only to the grades of lieutenant through colonel. Each rater rated 15 duty positions on four overall factors, each consisting of 14 subfactors. The…

A set of tests that might be reasonably used as provisional criterion measures in research on scientific thinking, particularly creative thinking, were developed and an assessment was made of the suitability of these tests as criterion variables from the standpoint of their psychometric properties. The Tests of Scientific Thinking are performance…