Recent years have seen widespread adoption of automatic grading of physics homework problems. Although first-generation homework management systems provide feedback and assign scores based only on the answers, problem-solving performance on exams seems to be no worse for students using these systems than for those who receive detailed comments…

The Schwartz Outcome Scale-10 (SOS-10) is an effective measure of change in inpatient and outpatient populations, as well as student counseling centers, chemically dependent populations, and research projects. The utility of the SOS-10 in Canada is limited because there is currently no French version of this instrument. This study reports on a…

Faculty teaching distance courses continuously seek ways to maximize learning for students. Two practice with feedback strategies were examined in this study for their impact on students' achievement and attitudes in an upper-division university level web-based course. One format contained higher structure and dialog creating lower transactional…

This study assessed the hypothesis that the response time to an item increases as the positions of the item and the respondent on the continuum of the trait that is measured draw closer together. This hypothesis has previously been stated by several authors, but so far it does not seem to have been empirically assessed in a rigorous way. A…

The author explores current efforts by educators and policy makers to harness the power of educational technology for both assessment "of learning" and assessment "for learning" in K-12 classrooms. (Contains 1 figure.)

The Stoplight Task, a procedure involving a computer analog of a stoplight, was evaluated for assessing risk taking in humans. Seventeen participants earned points later exchangeable for money by completing a response requirement before the red light appeared on a simulated traffic light. The green light signaled to start responding; it changed to…

The ways in which experience and academic training influence the types of questions therapists ask of their clients were studied. Psychologists and psychology students of varying degrees of expertise (n=138) were provided an artificial intelligence program that simulated a date rape client's responses to typed questions and were asked to conduct a…

In this study, the relationships between simple learning by accretion and various cognitive ability variables were explored. Computerized tests of five sources of individual differences were administered to a sample of 714 Air Force recruits, along with a trigram-English word paired-associate task, which was presented as a foreign language…

This paper presents a study on the generation of mathematics test items using algorithmic methods. The history of this approach is briefly reviewed and is followed by a survey of the research to date on the statistical parallelism of algorithmically generated mathematics items. Results are presented for 8 parallel test forms generated using 16…

Item analysis procedures appropriate for domain-referenced classroom testing are described. A conceptual framework within which item statistics can be considered and promising statistics in light of this framework are presented. The sampling fluctuations of the more promising item statistics for sample sizes comparable to the typical classroom…

Linear programming models with 0-1 variables are useful for the construction of tests from an item bank. Most solution strategies for these models start with solving the relaxed 0-1 linear programming model, allowing the 0-1 variables to take on values between 0 and 1. Then, a 0-1 solution is found by just rounding, optimal rounding, or a…

Testing 1-2-3 is a general purpose testing system developed at the Computer-Based Education Research Laboratory at the University of Illinois for use on NovaNET computer-based education systems. The testing system can be used for: short, teacher-made quizzes, individualized examinations, computer managed instruction curriculum testing,…

This manual describes and explains the commands available in the ITEMBANK package (a comprehensive test item bank). True-false, multiple-choice, short-answer, and essay items, as well as the associated answers, can be accommodated. Content domains and behavior categories exist for item classification. Most menus have instant action. Items and…

The effects of presenting test items in random order or in a sequence parallel to the order of presentation were studied by testing 92 undergraduates in an introductory psychology course at Emporia State University (Kansas). Two test forms, sequential (S) and random (R), of multiple-choice questions were prepared for four 1-hour examinations…

This paper describes the implementation of a computer-based approach to scoring open-ended problem lists constructed to evaluate student and practitioner clinical judgment from real or simulated records. Based on 62 previously administered and scored problem lists, the program was written in BASIC for a Heathkit H11A computer (equivalent to DEC…