In the United States System of Education the growth of student evaluations from 1973 to 1993 has increased from 29% to 86% which in turn has increased the importance of student evaluations on faculty retention, tenure, and promotion. However, the impact student evaluations have had on student academic development generates complex educational…

The overclaiming technique is a novel assessment procedure that uses signal detection analysis to generate indices of knowledge accuracy (OC-accuracy) and self-enhancement (OC-bias). The technique has previously shown robustness over varied knowledge domains as well as low reactivity across administration contexts. Here we compared the OC-accuracy…

No published studies have sufficiently focused on essay topic writability from the perspective of college writers of the new millennium including native English speakers and ESL speakers. In this study, 500 college writers in Metro Toronto in Canada were interviewed to uncover if they found some essay topics easier than other topics. The results…

This article reports the results of an investigation of the convergent criterion-related validity of two computer-based tools for scoring concept maps and essays as part of the ongoing formative evaluation of these tools. In pairs, participants researched a science topic online and created a concept map of the topic. Later, participants…

Responses to a sample test were simulated for examinees under free-response and multiple-choice formats. Test score sets were correlated with randomly generated sets of unit-normal measures. The extent of superiority of free response tests was sufficiently small so that other considerations might justifiably dictate format choice. (Author/DWH)

The test scores of college freshmen given both a multiple choice test and an essay test of writing skills were compared to assess the validity of a multiple choice test compared with an essay test. (HOD)

Term papers written by 42 students in two subjects were assessed by their classmates and by lecturers in the relevant subjects. No difference occurred between lecturers and students in average marks, variations in marks, agreement in marks (reliability), or relationship between marks and performance in final examinations (validity). (Author/MSE)

This study attempted to establish the validity of an essay test of clinical judgment by defining the domain of clinical judgment and operationalizing this definition in a 12-item essay examination administered to 98 residents in internal medicine. The relationship between essay scores and other measures of competence was then examined and the…

Previous research on differences in the reliability, validity, and difficulty of essay tests given under different timing conditions has indicated that giving examinees more time to complete an essay may raise their scores to a certain extent, but does not change the meaning of those scores, or the rank ordering of students. There is no evidence…

Analysis of the use of a cloze-procedure test to measure the English-as-a-Second-Language (ESL) proficiency of Japanese college students revealed that the cloze test correlated significantly with an essay test and improved prediction of ESL proficiency, suggesting that carefully constructed cloze tests could be useful in integrative language…

The Advanced Placement Program reports grades to students and colleges on a 1 to 5 point scale derived from combining the separate scores on the multiple-choice and free-response sections of Advanced Placement Examinations (ADPEs). In this study, predictions of grades in first-semester college biology courses were made based on students' separate…