Moderation is put forward as they key strategy for improving the reliability of teacher assessment. However, for many teachers the word "moderation" conjures up ideas of uncomfortable situations in which marking is being checked by others and there are prolonged arguments about tiny features of individual work. In this article, the…

Since 2001, the University of Maryland University College (UMUC) Graduate School has been conducting outcomes assessment of student learning. The current 3-3-3 Model of assessment has been used at the program and school levels providing results that assist refinement of programs and courses. Though effective, this model employs multiple rubrics to…

Wilson asserts that the quest for absolute objectivity in scoring student writing--including the use of rubrics--creates harmful distance between reader and writer and ignores the unique, transactional characteristics of writing. She puts forth the view of Rosenblatt and other literacy theorists that meaning and value of texts are not rigidly…

Background: Two major conceptions of learning exist: reproducing new material and transforming material to make meaning. Teachers' understandings of what learning is probably influence their teaching practices and student academic performance. Aims: To validate a short scale derived from Tait, Entwistle, & McCune's (1998) ASSIST inventory and…

Case means and case failures in performance-based medical student evaluations were examined to evaluate the consistency of ratings made by two or more standardized patients (SPs) simulating the same case. Results demonstrate a need for caution in interpreting scores obtained from a case checklist completed by multiple SPs. (Author/MSE)

The use of paraprofessional editors to evaluate student writing, particularly in large college classes, allows teachers to give students more writing practice, provides more individual assistance for students, and helps teachers gain insight into student needs. Adoption of uniform criteria for evaluation also provides consistency and objectivity.…

Interrater reliability in numerical ratings of clerkship performance (n=1,482 students) in five surgery programs was studied. Raters were classified as accurate or moderately or significantly stringent or lenient. Results indicate that increasing the proportion of accurate raters would substantially improve the precision of class rankings. (MSE)

Reports on a study of the use of musical scores and rating scales by 80 pianists who listened to 21 trials of solo piano music. Found that the use of musical scores and rating scales did not improve interrater reliability. Discovered that the subjects were less consistent when evaluating slow musical pieces than faster pieces. (CFR)

Among the many possible aspects to assessing writing, one of the most problematic is coherence. The problems with marking coherence arise because it is by nature subjective. However, the reasonable probability of several readers reaching a consensus concerning the coherence of a text suggests that it may be possible to assign relatively reliable…

Reports on a study of 614 experienced music teachers, non-music teachers, college-level music students, and non-music students on the effect of sequential patterns and different modes of presentation of music teaching. Finds that experienced teachers' evaluations were significantly higher than those of university students. (CFR)

Two studies investigated interrater agreement among 10 clinical dental examiners who scored residual subgingival calculus after student scaling on 4,160 real and 92 manikin tooth surfaces. Interrater reliability was low. Results suggest a need in periodontics for effective examiner calibration methods and objective subgingival calculus detection…

The Center for the Study of Evaluation's (CSE) expository and narrative rating scales have been developed to meet the need for instructionally relevant methods for assessing students' writing competence. Research indicates that large numbers of raters can be trained in the use of these scales and that, during training and independent rating, they…

A study compared the influences of rhetorical and sentence-level features on holistic essay scores assigned by raters who are experienced writing instructors but not trained in English-as-a-Second-Language (ESL) instruction. In scoring six university-level essays, these raters placed emphasis on ESL sentence-level errors far more than on essays'…

A study compared student evaluations made by residency directors and deans in 2 medical schools, using 3 standard methods of ranking 20 students per school. Ordinal ranking showed substantial agreement for 15 of 16 residency directors. Two methods of clustering into fixed groups gave high agreement only for top students. (Author/MSE)

Medical school admission interview ratings for four entering classes (n=356 students) were compared with preadmission academic variables (admission test scores, undergraduate grades), student characteristics (age, gender, residence), and interviewer characteristics (gender, professional background, admission committee membership). Recommendations…