This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

Assessed equivalence of paper-and-pencil and computer versions of the Self-Directed Search (SDS) for 62 college students. The results showed a significant positive correlation in SDS scores for the two SDS forms; however, users strongly preferred the computer format. (Author)

Determined effects of various methods and formats on subjects' (N=253) responses to a Piagetian reasoning problem requiring control of variables. Results indicate that format but not method of task administration influences subjects' performance and that the influence is similar for various combinations of methods and format. (Author/JN)

Examined equivalence of mode of administration of the Career Decision-Making System, comparing paper-and-pencil version and computer-based version. Findings from 61 undergraduate students indicated that the computer-based version was significantly more reliable than paper-and-pencil version and was generally equivalent in other respects.…

Potential mechanisms mediating the facilitative effects of elaborative interrogation on associative memory were investigated with Canadian university students reading facts about Canadian provinces. One hundred subjects answered "why" questions about each fact, whereas 10 subjects in the control group did not. Conditions under which…

Reliabilities and concurrent validities of teacher-made multiple-choice and true-false tests were compared. No significant differences were found even when multiple-choice reliability was adjusted to equate testing time. (Author/MH)

A correlational analysis was performed to examine the relationship between recognition and recall test formats. A total of 236 college students completed one of four 80-item general knowledge tests; the forms contained 20 items of each of four formats: (1) true; (2) false; (3) multiple-choice; and (4) free response. Ninety-three of the subjects…

To help determine the role that test instrument formats play in evaluation, two parallel examinations were given to 227 second-year medical students. The tests were based on information presented in a medical case history. One required students to generate their own problem lists (the generate group); the other required the students to select…

The effect on examinee performance of the rule that multiple-choice (MC) test items require the acceptance of 1 choice was examined for 106 dental students presented with choices in MC and multiple true-false formats. MC items force examinees to select one choice, which causes artificial acceptance of correct/incorrect choices. (SLD)

Describes study that investigated the effects of computerized test administration on undergraduates' responses to the Minnesota Multiphasic Personality Inventory (MMPI), and discusses methodological considerations important in evaluating the sensitivity of personality inventories in different administration formats. Results analyze the effects of…

Two of the most popular assessment instruments for measuring college student educational outcomes are the College Outcome Measures Program (COMP) of the American College Testing Program (1987) and the Academic Profile of the Educational Testing Service (ETS). Characteristics of these tests were compared, and the sensitivity of each test to…

Three examinations administered to medical students were analyzed to determine differences among severities of judges' assessments and among grading periods. The examinations included essay, clinical, and oral forms of the tests. Twelve judges graded the three essays for 32 examinees during a 4-day grading session, which was divided into eight…

The random response technique was compared to a direct questionnaire, administered to college students, to investigate whether or not the responses predicted the social desirability of the item. Results suggest support for the hypothesis. A 33-item version of the Marlowe-Crowne Social Desirability Scale which was used is included. (GDC)

Studies with 220 college students found that multiple-choice test items with 3 items are more difficult than those with 4 items, and items with the none-of-these option are more difficult than those without this option. Neither format manipulation affected item discrimination. Implications for test construction are discussed. (SLD)

A part-form methodology was used to study the effect of varying degrees of multidimensionality on the consistency of pass/fail classification decisions obtained from simulated unidimensional item response theory (IRT) based licensure examinations. A control on the degree of form multidimensionality permitted an assessment throughout the range of…