Context: Validity arguments can be used to provide evidence that instructors are drawing accurate conclusions from the results of students' clinical performance assessments (PAs). Little research has been conducted in athletic training education to determine if the evidence supports the use of current PAs. Measurement theories designed to…

Argues that if a testing situation is not similar to situations in which a child regularly performs linguistically, the test's ecological validity is compromised and its results must be viewed skeptically. (FL)

Examined the concurrent validity of the Objective Structured Assessment of Technical Skill (OSATS), a new test of technical skills for general surgery residents. Correlations between OSATS scores and faculty rankings were generally high for six senior residents but low for six junior residents at the University of Toronto. (MDM)

This study was concerned with reliability and accuracy of measurement of clinical performance in operative dentistry. The influences on reliability and accuracy of the nature of the rating scale (that is, the number and the specificity of scale points), the extent of clinical experience of the rater, and the training of raters were investigated.…

Students generally do better on outcome-based performance tasks than on domain-specific tasks. Results on performance tasks must be interpreted in the context of instruction or guidance provided before or during their administration. Reliability is sometimes questionable, since teachers are highly influenced by students' overall academic…

This study investigated Wechsler Adult Intelligence Scale-Revised (WAIS-R) profiles of deaf adolescents referred for academic difficulties. In addition, differences between referral deaf students and non-referral deaf peers were explored. The sample consisted of 28 severely-to-profoundly hearing impaired students enrolled in the School of…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

To improve the testing of students' skills in performing laboratory experiments, 92 Israeli high school physics teachers participated in the development of a list of weighted laboratory skills. Sensory-motor coordination was found to be a significant measured factor. Factors affecting reliability were also noted. (GDC)

Results of field testing for reliability and validity the Generalizable Mathematics Skills Student Self-Ratings (SSR), Teacher Ratings (TR), and Performance Test (PT) assessment instruments with 138 handicapped secondary students in vocational programs and their vocational teachers (N=5) found sufficient content and face validity and relatively…

Construct validity was investigated for three tests of clinical competence in medicine: National Board of Medical Examiners examination (NBME), California Psychological Inventory (CPI), and Resident Evaluation Form (REF). Scores from 166 residents were analyzed. Results suggested low construct validity for CPI and REF scales, and moderate…

This study focused on the validation of Generalizable Reasoning Skills assessment instruments with students with disabilities in secondary vocational programs. Results indicated that student self-ratings, teacher ratings, and a performance test were internally consistent and precise measures of reasoning skills for some uses but that most…

Analysis of scores of 118 visually impaired children on the Wechsler Intelligence Scale for Children (Revised) and the Wechsler Preschool and Primary Scales of Intelligence (Revised) found a consistent response pattern suggesting that the verbal as well as the performance tests provide useful assessment information. (Author/DB)

This paper responds to the demand generated among competency-based program participants and administrators for definitions of "competence" and new assessment techniques and instruments for its measurement. Discussion centers on three aspects of assessment: (1) the identification and definition of competencies relevant to life and work…

Describes recent efforts of the Center for Research in Evaluation, Standards and Student Testing (CRESST) to evaluate authentic assessment methods, such as portfolios and performance tests. When comparing the merits of authentic versus multiple-choice testing, it is wise to consider validity, reliability, consequences, fairness, generalization,…

After introductory material examining student skepticism toward testing and outlining the major problems encountered by instructors in test construction and grading, this monograph explores the optimum use of testing and performance evaluations in competency-based vocational education programs. Background information is then presented, including…