Descriptor
| Answer Keys | 3 |
| Scoring | 3 |
| Error of Measurement | 2 |
| Licensing Examinations… | 2 |
| Physicians | 2 |
| Adults | 1 |
| Cardiology | 1 |
| Certification | 1 |
| Criterion Referenced Tests | 1 |
| Evaluators | 1 |
| Generalizability Theory | 1 |
| More ▼ | |
Author
| Norcini, John J. | 3 |
| Shea, Judy A. | 1 |
Publication Type
| Journal Articles | 3 |
| Reports - Research | 3 |
| Speeches/Meeting Papers | 1 |
Education Level
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Peer reviewedNorcini, John J.; And Others – Evaluation and the Health Professions, 1990
Aggregate scoring was applied to a recertifying examination for medical professionals to generate an answer key and allow comparison of peer examinees. Results for 1,927 candidates for recertification indicate considerable agreement between the traditional answer key and the aggregate answer key. (TJH)
Descriptors: Answer Keys, Criterion Referenced Tests, Error of Measurement, Generalizability Theory
Peer reviewedNorcini, John J.; Shea, Judy A. – Academic Medicine, 1990
This study retrospectively applies aggregate scoring to the cardiology questions from a recertifying examination in general internal medicine. Three groups of experts were identified among the examinees and the remainder of the examinees were the participants (N=1887) of the study. Generalizability theory is applied to these data. (MLW)
Descriptors: Answer Keys, Cardiology, Certification, Higher Education
Peer reviewedNorcini, John J. – Journal of Educational Measurement, 1987
Answer keys for physician and teacher licensing examinations were studied. The impact of variability on total errors of measurement was examined for answer keys constructed using the aggregate method. Results indicated that, in some cases, scorers contributed to a sizable reduction in measurement error. (Author/GDC)
Descriptors: Adults, Answer Keys, Error of Measurement, Evaluators
