The goal of this report was to test the use of sensor-based skill measures in evaluating performance differences in rifle marksmanship. Ten shots were collected from 30 novices and 9 experts. Three measures for breath control and one for trigger control were used to predict skill classification. The data were fitted with a logistic regression…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

Some theoretical concerns for competency-based evaluation instruments are discussed, and means of examining these instruments for validity and reliability are presented. The areas of concern include descriptions of the behavior, the level of response, and the nature of the evaluation. Two different types of instruments are examined to determine…

Research was conducted to assess the applicability of the Instructional Systems Development (ISD) job analysis procedures to nine technical aviation maintenance military occupational specialties (MOS). Job analysis questionnaires were developed for each of the nine aviation maintenance MOS's. Research teams administered the questionnaires to…

A proposed model for the validity of measures of professional competence treats validation as the evaluation of inferences drawn from test scores, focusing on evaluation, generalization, and extrapolation. The model is used to indicate strengths and weaknesses of assessments of professional competence: observations of performance, simulations, and…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

The rationale underlying tests of social intelligence and some of the problems inherent in those tests are discussed. To measure social intelligence, paper and pencil tests were developed which were "situation free." These tests employed "stereotypic behavior of individual others." The stimuli used in the behavioral tests were…

A synthetic performance test is a job performance test that has been degraded to some degree in the range of tasks covered or in the fidelity of stimulus/response features. Since further development is needed before synthetic performance testing is valid and efficient, this research project focused on three objectives: to (1) identify problems…

This volume contains the initial draft of a model for assessing students in vocational education programs in Georgia. Addressed in the first section of the draft are some of the components that are believed to be critical in the development of a model for assessing vocational student achievement, including selecting a program for use in developing…