Sports performance testing is one of the most common and important measures used in sport science. Performance testing protocols must have high reliability to ensure any changes are not due to measurement error or inter-individual differences. High validity is also important to ensure test performance reflects true performance. Time-trial…

Context: Validity arguments can be used to provide evidence that instructors are drawing accurate conclusions from the results of students' clinical performance assessments (PAs). Little research has been conducted in athletic training education to determine if the evidence supports the use of current PAs. Measurement theories designed to…

The goal of this report was to test the use of sensor-based skill measures in evaluating performance differences in rifle marksmanship. Ten shots were collected from 30 novices and 9 experts. Three measures for breath control and one for trigger control were used to predict skill classification. The data were fitted with a logistic regression…

In this article we examine empirical evidence on the criterion, predictive, transfer, and fairness aspects of validity of a large-scale language arts performance assessment, referred to as the Performance Assignment (PA). We use multilevel models to avoid biased inferences that might result from the naturally nested data. Specifically, we examine…

Blind vocational rehabilitation clients (N=100) were administered the Displacing and Turning tests of the Minnesota Rate of Manipulation Tests after three practice trials. Subjects essentially scored lower than people with normal vision, with their means on both tests being at the first percentile of the norms for sighted persons. (Author/DB)

One-third to one-half of all candidates for dental licensure in 35 states fail part of their initial examination, but most pass the second with little or no attempt at knowledge or clinical skills improvement. These data highlight discussion of issues in dental licensure, including the validity of clinical skills testing. (MSE)

Students generally do better on outcome-based performance tasks than on domain-specific tasks. Results on performance tasks must be interpreted in the context of instruction or guidance provided before or during their administration. Reliability is sometimes questionable, since teachers are highly influenced by students' overall academic…

Research was conducted to assess the applicability of the Instructional Systems Development (ISD) job analysis procedures to nine technical aviation maintenance military occupational specialties (MOS). Job analysis questionnaires were developed for each of the nine aviation maintenance MOS's. Research teams administered the questionnaires to…

Describes the results of a two-year study to evaluate an assessment center. Results indicate that it is a valuable, valid, job-related instrument for the selection of school administrators. (Author/JM)

A criterion-referenced test for a beginning archery class was developed and evaluated. Techniques for estimating test validity and reliability were applied to data. A method developed by R. A. Burk (1976) was used to establish a cutoff score that would distinguish between those mastering the class and nonmasters. (Authors/PP)

A proposed model for the validity of measures of professional competence treats validation as the evaluation of inferences drawn from test scores, focusing on evaluation, generalization, and extrapolation. The model is used to indicate strengths and weaknesses of assessments of professional competence: observations of performance, simulations, and…

Assessment of the overarching self-regulatory mechanisms, or executive functions, in any age group is challenging, in part due to the complexity of this domain, in part due to their dynamic essence, and in part due to the inextricable links between these central processes and the associated domain-specific processes, such as language, motor…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

This report is part of South Carolina's effort to move toward "100 percent performance funding" for the state's public colleges and universities and results from a task force's investigation of ways to assess critical thinking. The following eight major findings are reported: (1) policy makers must determine priorities; (2) critical…

Teachers must learn to distinguish among performance assessments of different quality and appropriateness. Design criteria (cognitive complexity, linguistic appropriateness, content quality and coverage, and meaningfulness) are judged by examining assessment tasks and scoring rubrics. Effects criteria (transfer, generalizability, instructional…