Discussion of testing methods that adequately measure the ability to perform manipulative tasks focuses on criterion-referenced performance tests (CRPT) to evaluate trainees. Topics discussed include predictive validity; physical fidelity; test construction; testing constraints; performance conditions; criteria for attainment standards; scoring…

A test of pharmacists' practice knowledge, for use in professional continuing education, was developed by having practitioners prepare 673 assessment items related to specific competencies. Item pool was refined by psychometric evaluation and content validation. Two parallel tests, each containing 120 items, were pilot-tested with first-year…

This literature review discusses the match between tests and curricula, measurement validity and instructional utility when sampling student performance in general and advantages/disadvantages of sampling performance in the curriculum. It concludes that sampling from the curriculum is not essential and outlines three critical features ensuring the…

In a counterbalanced, within subjects, repeated measures design, 130 undergraduates were administered the Computer-Assisted Hypnosis Scale (CAHS) and the Stanford Hypnotic Susceptibility Scale and were hypnotized. The CAHS was shown to be a psychometrically sound instrument for measuring hypnotic ability. (SLD)

Two experiments with approximately 377 newly enlisted Air Force personnel and 182 college students investigated the validity of a reading span test combining a knowledge verification task with a word memorization task. Results support the hypothesis that word recall reflects the amount of working memory functional in reading. (SLD)

Describes how alternative assessment differs from more traditional forms and outlines the forces causing the recent fascination with alternative assessment (demands for accountability, negative consequences of high-stakes testing, and increasing criticisms of standardized tests). Identifies some major issues involving alternative assessment,…

Comments that multiple-choice tests are objective, test some knowledge, and are easy to grade, but often ask for little more than rote recall. Offers a structure for multiple-choice questions that require evaluative thinking skills as well as knowledge of the facts. Includes discussion of objectivity, preparation, and memorization. (DK)

The Wechsler Individual Achievement Test assesses achievement in students in grades K-12, with subtests in reading, mathematics reasoning, spelling, reading comprehension, numerical operations, listening comprehension, oral expression, and written expression. The test was developed to assist in identification of students with learning…

Six medical school faculty evaluated the overall performance of eight students completing a surgery clerkship at the Michigan State University College of Human Medicine. Students were also evaluated by the National Board of Medical Examiners' Computer Based Examination (CBX). Faculty ratings correlated highly with scores produced by the CBX's…

Methods for evaluating the validity of job analysis data derived from activity inventories are proposed. The basic approach is to state assumptions about expected relationships and then check to see whether these relationships exist. The approach is illustrated through a survey of 38 nurses. (SLD)

Reviews legal arguments used to challenge traditional testing programs in prior litigation and indicates how these arguments might be applied in a performance-assessment application. Examines discrimination challenges to performance assessments in employment contexts. Suggests ways to deal with the psychometric issues most likely to be encountered…

Administrator competency testing is required in 15 states. Competency testing has traditionally been plagued by ambiguous objectives, questionable validity, an adverse effect on minority group members, and high costs. Offers recommendations for policymakers and for preparation programs. (41 references) (MLF)

Describes United States literacy characteristics, based on April 2000 reports from the Organisation for Economic Cooperation and Development and the U.S. Department of Education's Office of Educational Research and Improvement. Discusses Angoff methods for evaluating validity of high-stakes testing programs in Massachusetts and Virginia. (MLH)

The Objective Structured Clinical Examination (OSCE), initially developed for undergraduate medical education, has been adapted for assessment of clinical skills in podiatry students. A 12-month pilot study found the test had relatively low levels of reliability, high construct and criterion validity, and good stability of performance over time.…

Penetrates polarized rhetoric to examine four currently debated questions about high-stakes testing. Reframes certain questions: How can we provide instruction enabling students to score well on such tests without narrowing the curriculum? How can we restructure schools to help all children reach high standards? How can assessments be made more…