During the past few years, several Harvard paper surveys were converted to Web surveys. These were high-profile surveys endorsed by the Provost and the Dean of the College, and covered major portions of the university population (all undergraduates, all graduate students, tenured and non-tenured faculty). When planning for these surveys started in…

Technology today offers many new opportunities for innovation in educational assessment through rich new assessment tasks and potentially powerful scoring, reporting and real-time feedback mechanisms. One potential limitation for realizing the benefits of computer-based assessment in both instructional assessment and large scale testing comes in…

To what extent a blended learning configuration of face-to-face lectures, online on-demand video recordings of the face-to-face lectures and the offering of online quizzes with appropriate feedback has an additional positive impact on the performance of these students compared to the traditional face-to-face course approach? In a between-subjects…

A general evaluation design was developed to examine the effectiveness of a computer-based, multimedia simulation test on California smog check mechanics. The simulation test operated on an Apple Macintosh IIci, with a single touchscreen color monitor controlling a videodisc player; it had three parts: introduction-tutorial-help, data, and test.…

The strategies examinees employ when making item difficulty level choices in self-adapted computerized testing were investigated. Subjects were 148 college students (88 females and 60 males) in an introductory statistics course. The primary instrument was a self-adapted computerized algebra test used to measure student readiness for the statistics…

Concerned with the failure of multiple choice tests to measure composition--as opposed to grammar and usage--skills, college researchers studied the value of using writing samples to place students in composition classes. Evaluating the writing samples of 300 incoming freshmen, they did not find a high correlation between sample scores and…

The use of optical scanners and computers in educational testing is common where objective testing methods (such as true-false, matching, and multiple-choice items) are well-established means of evaluating educational achievement. Where non-objective testing methods (such as fill-in-the-blank, short-answer, and essay items) have been more common,…

Specific questions addressed in this study include how time limits affect a test's construct and predictive validities, how time limits affect an examinee's time allocation and test performance, and whether the assumption about how examinees answer items is valid. Interactions involving an examinee's sex and age are studied. Two parallel forms of…

The value of statistical research depends on valid comparisons which can usefully influence educational policy. Educational research needs to extend the measures of learning (such as the National Assessment of Educational Progress) through nationally-calibrated absolute measures and through computer-assisted and adaptive testing. Direct sampling…

The potential usefulness of computerized tests for supplementing paper-and-pencil measures for predicting job performance abilities was the objective of a series of studies. This report covers the initial test development and analysis research. Eight computerized tests were constructed to measure five personal attributes identified in previous…

Assessed affects of Computer-Assisted Self-Evaluation (CASE) system of multiple-choice testing. Learning and retention were examined in two equivalent groups of undergraduates. Students (N=34) receiving 24 quizzes with immediate feedback outperformed students (N=30) receiving two midterms with delayed feedback. (Author/DS)

Effects of altering test difficulty on examinee ability measures and test length in a computer adaptive test were studied for 225 medical technology students in 3 test difficulty conditions. Results suggest that, with an item pool of sufficient depth and breadth, acceptable targeting to test difficulty is possible. (SLD)

Two versions of a criterion-referenced videodisc-based instrument, SHIPS (Self-Help InterPersonal Skills), have been developed for high school students with hearing impairments. Students can choose either American Sign Language or English-based sign versions of assessment items. Field testing found that use of SHIPS enhanced data validity and…

Examined attitudes toward taking different formats of oral proficiency assessments across three languages: Spanish, Arabic, and Chinese. Students were administered both the tape-mediated Simulated Oral Proficiency Interview (SOPI) and a new Computerized Oral Proficiency Instrument (COPI). Questionnaire responses showed examinees, particularly…

This study investigated the comparability of scores for paper and computer versions of a writing test administered to eighth grade students. Two essay prompts were given on paper to a nationally representative sample as part of the 2002 main NAEP writing assessment. The same two essay prompts were subsequently administered on computer to a second…