This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

This study explores the transfer of assessment practices from f2f to online environments by college instructors, with a particular interest in the factors influencing assessment in online learning settings. Assessment is a critical aspect of the learning environment, and considerable research has suggested various methods of formative and…

Assessed equivalence of paper-and-pencil and computer versions of the Self-Directed Search (SDS) for 62 college students. The results showed a significant positive correlation in SDS scores for the two SDS forms; however, users strongly preferred the computer format. (Author)

Examined equivalence of mode of administration of the Career Decision-Making System, comparing paper-and-pencil version and computer-based version. Findings from 61 undergraduate students indicated that the computer-based version was significantly more reliable than paper-and-pencil version and was generally equivalent in other respects.…

An experiment was conducted that contrasted a variant of computerized adaptive testing, self-adapted testing, with two traditional tests. Participants completed a self-report of text anxiety and were randomly assigned to take one of the three tests of verbal ability. Subjects generally chose more difficult items as the test progressed. (Author/LMO)

A computerized adaptive testing procedure for measuring mathematical skills of 60 deaf college students was evaluated. Ability estimates were compared for stability to those obtained earlier from conventional testing. Adaptive testing increased measurement efficiency by reducing test length. Student attitudes toward computerized testing were…

Describes study that investigated the effects of computerized test administration on undergraduates' responses to the Minnesota Multiphasic Personality Inventory (MMPI), and discusses methodological considerations important in evaluating the sensitivity of personality inventories in different administration formats. Results analyze the effects of…

The effects of reviewing items and altering responses on the efficiency of computerized adaptive tests and resultant ability estimates of the examinees were explored for medical technology students (220 students could and 492 students could not review and alter their responses). Data do not support disallowing review. (SLD)

Individual differences in performance on 4 computer-controlled visual memory and recognition tasks as a function of performance on 5 paper-and-pencil spatial tests were studied for 90 psychology students attending the University of Rennes (France). Results show that spatial thinking is partially supported by visual memory. (SLD)

Two studies involving 274 Air Force recruits and 163 college students, respectively, investigated the relationship between priming effects and declarative knowledge acquisition within repetitive practice models. Individual differences in repetition-priming effects uniquely predicted learning differences relative to other cognitive measures.…

The relationship of an expert-system-scored constrained free-response item type to multiple-choice and free-response items was studied using data for 614 students on the College Board's Advanced Placement Computer Science (APCS) Examination. Implications for testing and the APCS test are discussed. (SLD)

Exploratory and confirmatory factor analyses were used to explore relationships among existing item types and three new computer-administered item types for the analytical scale of the Graduate Record Examination General Test. Results with 349 students indicate constructs the item types are measuring. (SLD)

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

According to item response theory (IRT), examinee ability estimation is independent of the particular set of test items administered from a calibrated pool. Although the most popular application of this feature of IRT is computerized adaptive (CA) testing, a recently proposed alternative is self-adapted (SA) testing, in which examinees choose the…

C. Davis and M. Cowles (1989) analyzed a total trait anxiety score on the Endler Multidimensional Anxiety Scales (EMAS)--a unidimensional construct that this multidimensional measure does not assess. Data are reanalyzed using the appropriate scoring procedure for the EMAS. Subjects included 145 undergraduates in 1 of 4 testing conditions. (SLD)