A study of the reliability of oral tests in a medical school illustrates the use of a balanced incomplete block design, chosen when not all participating examiners can rate each examinee, for experimental research. (MSE)

Fictitious student evaluations of a faculty member's teaching performance are presented to the reader in an exercise in interpreting such information. Evaluator comments reveal a widespread divergence of views. (MSE)

Test data were used to compare the grading of two forms of double mathematics: pure and applied math, and regular and advanced math. Results confirm expectations that in the former system, the grading is comparable, and in the latter, it is not necessarily comparable. Implications for student admission are discussed. (MSE)

In light of the growing need for individuals to be assessed or assess themselves on workplace learning, the different notions of reliability and validity in classical test theory are examined as they might apply to work-based learning. It is concluded that, under certain stated conditions, test reliability, validity, and comparability can be…

Concerns about and objections to competency-based assessment in higher education are examined, including superficiality, use of inference, neglect of knowledge and of process, and subjectivity. It is concluded that, although each objection raises an important issue, in each case, a well-designed competency-based assessment system can overcome…

The 15 components used for assessment in an introductory psychology course were examined to determine their relative value as predictors of overall performance. Multiple-choice tests were consistently found to be more effective than essay examinations, but arguments are presented for the retention of essays, with suggestions for their improvement.…

A study investigated the reliability and validity of the Study Process Questionnaire (Biggs) for 352 undergraduates in a Nigerian university. Although it was found that the concepts involved were relevant to this population and scales and subscales had adequate internal consistency, cross-cultural comparison of scores was problematic. (Author/MSE)

Examiners seeking guidance on multiple-choice and true/false tests are likely to encounter various faulty or questionable ideas. Twelve of these are discussed in detail, having to do mainly with the effects on test reliability of test length, guessing and scoring method (i.e. number-right scoring or negative marking). Some misunderstandings could…

The interrelationships of a variety of student aptitude and achievement measures are examined in a sample of 88 Australian undergraduate students, and the critial role of the data analyst in examining the relationships is discussed. (MSE)

Evaluation of the final examination should be part of the course evaluation and should include student perceptions of the exam's nature and the questions' quality. The final examination experience of two groups of undergraduate and graduate students are considered. (MSE)

Using an experimental mixed design, this study compared the traditional paper-and-pencil method for evaluating teaching with the online method. Replicating previous findings, the comparison revealed similar evaluation means of the two methods. However, the stability of teaching evaluations using paper-and-pencil twice was substantially higher than…

A problem-based, criterion-referenced examination of clinical competence was developed in order to positively influence students' learning in the direction of the faculty's clinical objectives. High satisfaction and high perceived relevance among students accompanied high reliability and validity. (MSE)

A study investigated general and vocational skills of 32 British business undergraduates before and after their field experiences, as perceived by the students and their employers. Although the parties agree that some skill development occurred during field experience, substantial discrepancies between student and employer perceptions of actual…